Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1nZm2i-0003OY-81 for pgsql-hackers@arkaria.postgresql.org; Thu, 31 Mar 2022 04:04:16 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1nZm2h-0003AA-6p for pgsql-hackers@arkaria.postgresql.org; Thu, 31 Mar 2022 04:04:15 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1nZm2g-00039z-Tx for pgsql-hackers@lists.postgresql.org; Thu, 31 Mar 2022 04:04:14 +0000 Received: from out5-smtp.messagingengine.com ([66.111.4.29]) by magus.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1nZm2e-0000TF-Ep for pgsql-hackers@lists.postgresql.org; Thu, 31 Mar 2022 04:04:14 +0000 Received: from compute3.internal (compute3.nyi.internal [10.202.2.43]) by mailout.nyi.internal (Postfix) with ESMTP id C2BE15C0210; Thu, 31 Mar 2022 00:04:09 -0400 (EDT) Received: from mailfrontend2 ([10.202.2.163]) by compute3.internal (MEProxy); Thu, 31 Mar 2022 00:04:09 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=anarazel.de; h= cc:cc:content-type:date:date:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:sender:subject :subject:to:to; s=fm1; bh=jpRF91N/IyZxH7ZaAx3ZtiAcRbZnjzNG7MszJG 2AIAQ=; b=PY+DWRdFTJhSy1cyEL4hwOrCOE42yCKBCFs8LUNnmjjfZOTVGAbxfF D6ew4s4FjlkexYaVNtf6fOkSIuLSYa4bXg6iAXJYoImrRK2k72I5JDZDG3gz96Eh 9nnZFgsYhfuMgy8UQ0abPPeH77VD5UmWIhfsS2uCxMx4KMp+nr3RjxwJZCZaRHXn Qwn0YgPKL8YRsg+lpx9U5uZBa+KW1utwRrhK06G3yG12awjAWCEtFI+w7nHYl5Af 3rbexCAp6KNJgpwfLeeuWYDs8s+gAbHDaiXCrnpbGXNU2EQJlNZF3TsLvwdwJg62 Q7rCN3Rya2UonHppDfNNJpgH3bJaByAA== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:cc:content-type:date:date:from:from :in-reply-to:in-reply-to:message-id:mime-version:references :reply-to:sender:subject:subject:to:to:x-me-proxy:x-me-proxy :x-me-sender:x-me-sender:x-sasl-enc; s=fm3; bh=jpRF91N/IyZxH7ZaA x3ZtiAcRbZnjzNG7MszJG2AIAQ=; b=K+3sdZH/knHpJUISUfPvG4NKheQ2u2mLn lmmHCxjgD3CMTg+bMNasXmSAB7qIK6p0Lfsqie9WhoduIhp1D8SVdDYMtRymHlrf 1M5snRSi8moDiIaUbygfYWTYFtSCjz4Eol0yAwn1CPXLutNh7HNfRosOqpaACz0M HCBVe7B3KVZHyfGeHJ7b3MUN39E6Y+zoCxyH8aCk9lZhJAabXxLIuYG957O53KIc riZf8as9Cd6QMQPRRolX+UHGlAL2KkUot6iTBGf4hbca1r6vdJZ+QP44PgK9Ypi3 xUlkfJAe8QJBfiuBE9GFtttOMg2fBe7Gljs44oOWvRTNXKDo0ykhA== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvvddrudeifedgjeegucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne cujfgurhepfffhvffukfhfgggtuggjsehttdertddttddvnecuhfhrohhmpeetnhgurhgv shcuhfhrvghunhguuceorghnughrvghssegrnhgrrhgriigvlhdruggvqeenucggtffrrg htthgvrhhnpedukefhkeelueegveetheelffffjeegleeuudelfeefuedtleffueejfffh ueffudenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhmpe grnhgurhgvshesrghnrghrrgiivghlrdguvg X-ME-Proxy: Received: by mail.messagingengine.com (Postfix) with ESMTPA; Thu, 31 Mar 2022 00:04:08 -0400 (EDT) Date: Wed, 30 Mar 2022 21:04:07 -0700 From: Andres Freund To: Peter Geoghegan Cc: Justin Pryzby , Robert Haas , Thomas Munro , Masahiko Sawada , PostgreSQL Hackers Subject: Re: Removing more vacuumlazy.c special cases, relfrozenxid optimizations Message-ID: <20220331040407.ole7orep6sj4iore@alap3.anarazel.de> References: <20220330061041.GE28503@telsasoft.com> <20220331020018.qht46hbua4gztmdf@alap3.anarazel.de> <20220331032844.j7wu5ijjpx3qay5c@alap3.anarazel.de> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk Hi, On 2022-03-30 20:35:25 -0700, Peter Geoghegan wrote: > On Wed, Mar 30, 2022 at 8:28 PM Andres Freund wrote: > > I triggered twice now, but it took a while longer the second time. > > Great. > > I wonder if you can get an RR recording... Started it, but looks like it's too slow. (gdb) p MyProcPid $1 = 2172500 (gdb) p vacrel->NewRelfrozenXid $3 = 717 (gdb) p vacrel->relfrozenxid $4 = 717 (gdb) p OldestXmin $5 = 5112 (gdb) p aggressive $6 = false There was another autovacuum of pg_database 10s before: 2022-03-30 20:35:17.622 PDT [2165344][autovacuum worker][5/3:0][] LOG: automatic vacuum of table "postgres.pg_catalog.pg_database": index scans: 1 pages: 0 removed, 3 remain, 3 scanned (100.00% of total) tuples: 61 removed, 4 remain, 1 are dead but not yet removable removable cutoff: 1921, older by 3 xids when operation ended new relfrozenxid: 717, which is 3 xids ahead of previous value index scan needed: 3 pages from table (100.00% of total) had 599 dead item identifiers removed index "pg_database_datname_index": pages: 2 in total, 0 newly deleted, 0 currently deleted, 0 reusable index "pg_database_oid_index": pages: 4 in total, 0 newly deleted, 0 currently deleted, 0 reusable I/O timings: read: 0.029 ms, write: 0.034 ms avg read rate: 134.120 MB/s, avg write rate: 89.413 MB/s buffer usage: 35 hits, 12 misses, 8 dirtied WAL usage: 12 records, 5 full page images, 27218 bytes system usage: CPU: user: 0.00 s, system: 0.00 s, elapsed: 0.00 s The dying backend: 2022-03-30 20:35:27.668 PDT [2172500][autovacuum worker][7/0:0][] DEBUG: autovacuum: processing database "contrib_regression_hstore" ... 2022-03-30 20:35:27.690 PDT [2172500][autovacuum worker][7/674:0][] CONTEXT: while cleaning up index "pg_database_oid_index" of relation "pg_catalog.pg_database" Greetings, Andres Freund