Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1ruDfV-003bRU-Dw for pgsql-hackers@arkaria.postgresql.org; Tue, 09 Apr 2024 15:45:53 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1ruDfU-006vST-H9 for pgsql-hackers@arkaria.postgresql.org; Tue, 09 Apr 2024 15:45:52 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1ruDfU-006vSL-4F for pgsql-hackers@lists.postgresql.org; Tue, 09 Apr 2024 15:45:52 +0000 Received: from fout3-smtp.messagingengine.com ([103.168.172.146]) by makus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1ruDfR-00226f-Fv for pgsql-hackers@postgresql.org; Tue, 09 Apr 2024 15:45:50 +0000 Received: from compute6.internal (compute6.nyi.internal [10.202.2.47]) by mailfout.nyi.internal (Postfix) with ESMTP id BF9601380285; Tue, 9 Apr 2024 11:45:47 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute6.internal (MEProxy); Tue, 09 Apr 2024 11:45:47 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:cc:content-transfer-encoding :content-type:content-type:date:date:feedback-id:feedback-id :from:from:in-reply-to:in-reply-to:message-id:mime-version :reply-to:subject:subject:to:to:x-me-proxy:x-me-proxy :x-me-sender:x-me-sender:x-sasl-enc; s=fm2; t=1712677547; x= 1712763947; bh=yB3fbSz+ilEbdgmhf7za1j7r1JVE1lMh1auHGUVamQc=; b=N wrSSuKc3ENgcrbl2G8llY6UCttIaA+64GLhxVxsXYgiA5h15AY2bYO3m68evO6JY rJV23Tv7Wj5RSQIPyRwU0XqV4VZM3qokdN/1wgo0EhnLKgGG4ameJu/3c8lIaBiI q3yosgERuKYKgA2RYSQVLd+OB/yvt8VX19jveanstcexGneZflx6NaVKVZjuFB1U e8DKsThA+c15j3JxHux2oPRjM+8Pu0ZI9c8o/7z1uWssI/gszScNV81bDR1ACcKK ZjABCbbvoYdvTkZoCG8VY5XItvQ5gkxXBVB3moOFtlJgj1JKYI4ofiASDtsadU/C DezjWVIMb+EmqxaPFltMw== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvledrudehfedgtdduucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne cujfgurhepfffhvfevuffkgggtugfgjgesthekredttddtjeenucfhrhhomheptehlvhgr rhhoucfjvghrrhgvrhgruceorghlvhhhvghrrhgvsegrlhhvhhdrnhhoqdhiphdrohhrgh eqnecuggftrfgrthhtvghrnhepgfdtgeelgefgffdtieduudffhfevkefgudefteehgfet hfekvdegjeelhfethedvnecuffhomhgrihhnpegvnhhtvghrphhrihhsvggusgdrtghomh dpphhoshhtghhrvghsqhhlrdhorhhgnecuvehluhhsthgvrhfuihiivgeptdenucfrrghr rghmpehmrghilhhfrhhomheprghlvhhhvghrrhgvsegrlhhvhhdrnhhoqdhiphdrohhrgh X-ME-Proxy: Feedback-ID: ia2694551:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA; Tue, 9 Apr 2024 11:45:47 -0400 (EDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=alvh.no-ip.org; s=schmee; t=1712677545; bh=xjBeuxLCxmSU4QzhHK8RKxk5h50edqNOxoiNc4tReWE=; h=Date:From:To:Cc:Subject:In-Reply-To:From; b=kLGMCmAqw7e000ZGLAGtju8EeyG1/BHBiIcdEDDPolJdRfFTpkOAPgzoLZ2GgYyiO zQquoB3e7znl2LMX3f4Qdm6zERgvQwxiTwH6gOXOOdd+vMJdlpAU0oylRb3dEpvC0K v7bhjy5A5u/G7+jVXdwiHWi6iD+ns7Uf6tmD5hgKAY9fWixCW2QgHIvtdyHa5go506 qwRaaQTCbCv2iUIU1jeKoobqINQGN2pZd3YgU7VCRxKcCKfFht+xSWExMuD7TaPEls D15xQUSkvXOgId7QGb+3TTv8ZwD46BM1svJMWerd+AfIUYJbd+V1lLV/oqi7UURLpX wneULTZJgKfGQ== Received: by schmee.alvh.no-ip.org (Postfix, from userid 1000) id 3105E36E; Tue, 9 Apr 2024 17:45:45 +0200 (CEST) Date: Tue, 9 Apr 2024 17:45:45 +0200 From: Alvaro Herrera To: Stefan Fercot Cc: Robert Haas , Tomas Vondra , Michael Paquier , "pgsql-hackers@postgresql.org" Subject: Re: post-freeze damage control Message-ID: <202404091545.7zont3umry74@alvherre.pgsql> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk On 2024-Apr-09, Stefan Fercot wrote: > At some point, the only way to really validate a backup is to actually try to restore it. > And if people get encouraged to do that faster thanks to incremental backups, they could detect potential issues sooner. > Ultimately, users will still need their full backups and WAL archives. > If pg_combinebackup fails for any reason, the fix will be to perform the recovery from the full backup directly. > They still should be able to recover, just slower. I completely agree that people should be testing the feature so that we can fix any bugs as soon as possible. However, if my understanding is correct, restoring a full backup plus an incremental no longer needs the intervening WAL up to the incremental. Users wishing to save some disk space might be tempted to delete that WAL. If they do, and later it turns out that the full+incremental cannot be restored for whatever reason, they are in danger. But you're right that if they don't delete that WAL, then the full is restorable on its own. Maybe we should explicitly advise users to not delete that WAL from their archives, until pg_combinebackup is hammered a bit more. -- Álvaro Herrera Breisgau, Deutschland — https://www.EnterpriseDB.com/ "I must say, I am absolutely impressed with what pgsql's implementation of VALUES allows me to do. It's kind of ridiculous how much "work" goes away in my code. Too bad I can't do this at work (Oracle 8/9)." (Tom Allison) http://archives.postgresql.org/pgsql-general/2007-06/msg00016.php