Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1mgDSt-0003I2-B3 for pgsql-bugs@arkaria.postgresql.org; Thu, 28 Oct 2021 22:01:39 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1mgDSq-0005iR-DG for pgsql-bugs@arkaria.postgresql.org; Thu, 28 Oct 2021 22:01:36 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1mgDSq-0005iI-5g for pgsql-bugs@lists.postgresql.org; Thu, 28 Oct 2021 22:01:36 +0000 Received: from out4-smtp.messagingengine.com ([66.111.4.28]) by magus.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1mgDSj-0003YC-3f for pgsql-bugs@lists.postgresql.org; Thu, 28 Oct 2021 22:01:35 +0000 Received: from compute5.internal (compute5.nyi.internal [10.202.2.45]) by mailout.nyi.internal (Postfix) with ESMTP id BDB755C0152; Thu, 28 Oct 2021 18:01:27 -0400 (EDT) Received: from mailfrontend2 ([10.202.2.163]) by compute5.internal (MEProxy); Thu, 28 Oct 2021 18:01:27 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=anarazel.de; h= date:from:to:cc:subject:message-id:references:mime-version :content-type:in-reply-to; s=fm2; bh=vgOd5vxK3XsYDrdn7idzs4VLP+q caUifSD22uvxS61s=; b=QRDTCfMfadwzf/NnIQx4tm6oYBHsfzlhwfSXV/jHxVs vc4KYtq5xlFmqUsPC/V7I94bHkXACYYUSgLFJU4g2Svo1KK2J4RGEpX1G6WWTlfX o4GWx/Izof9jmWqFug6KDdzsIBgWR6D4x2ji2ZmPZ3OuzuYimEioNzG7xmxs+n+H p/Xj0mum1j3JpcnYFH8vsNNeFL+Mb7QZnlOiCdN6hYiGGGmnH8VuOTiEp0JcsO0A HhitTmSx5W6kF3SMDwEL57TzWYFYq9+GhTGmxzCHaVpk9WMz9M6IMHoqCP1xtvdu ZpJKMIu2kPgEoJF5wKF0SiIvCKz9jIYe9t8G8wODOyg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm1; bh=vgOd5v xK3XsYDrdn7idzs4VLP+qcaUifSD22uvxS61s=; b=YUFvon9cDP56g4HUsz6sf5 HZpm2Q7Xt7izkt+Bk1bpHFc1gTEdNgZUxNt7wbCdIvGFoAxcjf1WISxSuirpepw3 PLULCCjC5Y6Od4g3Fcaty9bJitDwbKFPLVa2P457BhjnaBdTZ6y4DleRGI/DVD7q +lA2WC/zmQB5WutdOyyumqqaX39cjz8G4yINGx+8Om6RdKMHyoYLaR/af1uZbqqT xz29XYvzedARu3x85j44LGG/rw2v84l26lP0K4bzrv7dCUA3936jvEt3E4rA1BsR Vg5lI4SIPYf/MfdKxBItfbVdLxAK0R2d6M55msrE8rRLFzo/XMQUCTmqWyd3khgw == X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvtddrvdegfedgheekucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne cujfgurhepfffhvffukfhfgggtuggjsehttdertddttddvnecuhfhrohhmpeetnhgurhgv shcuhfhrvghunhguuceorghnughrvghssegrnhgrrhgriigvlhdruggvqeenucggtffrrg htthgvrhhnpedukefhkeelueegveetheelffffjeegleeuudelfeefuedtleffueejfffh ueffudenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhmpe grnhgurhgvshesrghnrghrrgiivghlrdguvg X-ME-Proxy: Received: by mail.messagingengine.com (Postfix) with ESMTPA; Thu, 28 Oct 2021 18:01:25 -0400 (EDT) Date: Thu, 28 Oct 2021 15:01:24 -0700 From: Andres Freund To: Kamigishi Rei Cc: Andrew Gierth , Alvaro Herrera , Peter Geoghegan , PostgreSQL mailing lists , Thomas Munro Subject: Re: BUG #17245: Index corruption involving deduplicated entries Message-ID: <20211028220124.n4vulzxp6i6fsq4t@alap3.anarazel.de> References: <202110250104.jve5vzdedck7@alvherre.pgsql> <87h7d57b3q.fsf@news-spur.riddles.org.uk> <20211028214209.kbv4ulehz36up6kq@alap3.anarazel.de> <125603c4-4403-dcbb-221e-fd1d4ef6ed83@koumakan.jp> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <125603c4-4403-dcbb-221e-fd1d4ef6ed83@koumakan.jp> List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk Hi, On 2021-10-29 00:46:29 +0300, Kamigishi Rei wrote: > The issue manifested again earlier today *after* a REINDEX followed by > enabling WAL replica logging on the 24th of October. I saved a snapshot of > the filesystem holding the data directory. Would that be useful for further > analysis? Yes, that's *quite* useful. I assume you can't just share that snapshot? Once we identified an affected heap and index page with the corruption, we should use pg_waldump to scan for all chanes to that table. Do you have the log file(s) from between the 24th and now? That might give us a good starting point for the LSN range to scan. Greetings, Andres Freund