Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1qTNXS-009NxR-Uy for pgsql-general@arkaria.postgresql.org; Tue, 08 Aug 2023 14:18:23 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1qTNXR-00Gesj-Ft for pgsql-general@arkaria.postgresql.org; Tue, 08 Aug 2023 14:18:21 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1qTNXQ-00GesZ-RA for pgsql-general@lists.postgresql.org; Tue, 08 Aug 2023 14:18:21 +0000 Received: from tamriel.snowman.net ([70.109.60.50]) by makus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1qTNXN-001Dmw-OC for pgsql-general@lists.postgresql.org; Tue, 08 Aug 2023 14:18:19 +0000 Received: by tamriel.snowman.net (Postfix, from userid 1000) id AA9495F7B7; Tue, 8 Aug 2023 10:18:12 -0400 (EDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=snowman.net; s=dkim; t=1691504292; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=vM0kSLt4O87VFbfCSQbrr05IVhSdlyiNycj8Y1Bv8AU=; b=PCHeKaPXMXq5mbbj0k66aRFjwAjJz0LR5/Fp5dEwDJG6AHIopytIWw4Z1AoDR+AxE87wF4 BrSW/zdTlQCYfCLae2ecqgXFYlot5rydLFAh/FJNMQbdVE/mR8ZdgBe5zGfLUV/95Gc5cu 7FIvT7/ghDxPn2JS1ZkfB1d3vTbLkqw= Date: Tue, 8 Aug 2023 10:18:12 -0400 From: Stephen Frost To: Meera Nair Cc: "pgsql-general@lists.postgresql.org" , Punit Pranesh Koujalgi Subject: Re: PostgreSQL 14.8 - server fails to start even though all transaction logs with base backup are restored Message-ID: References: MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="cARYMvk1lE+D97sy" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/2.1.4 (2021-12-11) List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk --cARYMvk1lE+D97sy Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Greetings, * Meera Nair (mnair@commvault.com) wrote: > We are following https://www.postgresql.org/docs/14/continuous-archiving.html#BACKUP-LOWLEVEL-BASE-BACKUP > Making An Exclusive Low-Level Backup. Exclusive backups have been removed, so you really don't want to be depending on it. > After restoring, we see the server fails to start with below error: Your archive doesn't seem to have all of the WAL which was generated during the backup, which means that your backup wasn't complete and the system cannot be restored from this backup. > We are restoring all the transaction logs required for base backup to be consistent. Evidently not, per the complaint from PG when it starts up. > BACKUP_END is present in the 000000040000000200000046 segment. Why did recovery fail to find this? It's possible to have multiple backups going concurrently. Presumably, this was from a different backup and that's why it wasn't picked up as being the end for this backup. You seem to have quite a few .backup files in your archive directory which would seem to support this. Not sure exactly what you're doing, but unless your goal is to spend a great deal of effort developing a PG backup solution, you're really better off using one of the existing solutions (eg: pg_basebackup or pgBackRest). If you are developing your own backup solution for PG, you definitely want to be using the new APIs and not using the exclusive backup method. Please review the current (15) documentation: https://www.postgresql.org/docs/current/continuous-archiving.html Thanks, Stephen --cARYMvk1lE+D97sy Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCgAdFiEEwf6gbxKhD863zrx/7WyKOINHZFUFAmTSTqIACgkQ7WyKOINH ZFX4/BAAt/KMPcCZsl1L1oUM6gLrrbpRPZCVaIs5V5hV5jXEGcviw3XrF5LjuWu6 31uXFgqR4SkU0sG4YLVvuOLfxuZZ6nuPdckTzcf3JjHB8xJKkMlcW+bmiRYrxICy ap5teY84nJcaOlNNHMZG1rYpMzurm9UIGtJODCZaG/hGk8UQBvAfbqJOy8Fnudvu RE+8a7opiEl6x3R7ODYjdZ+thqAmbtQ3sACVNJtxF3L2YXi3pyC0bsEZ6AgzqBqi +q/r1swG9UNNVz5LaRhe2jhztMPP4DjNda/9lfSMckskwikk75mmYt6tAD05SAle iV+z83cxjWW5iBQwDC2a9gQa1Bm5xE8y7AYJTb5PvWwpGS1dIhSwWraHi3hKjX77 FPoz/aQd5jSNs0lA4r96ve0kKzvymi9fDaD5ko1UTEToZZUMnT/CdPNOwUZiBDTB KJKfIiXYHJM25EKXdO92QtTUm8DP57uUZqISmYSCw3luWJW9I4ukXlEtOQT/CsJC tcQSvgamw1bf/C4gm1FiqrOjOoGAmNynqDlssXGGG2PjqSm0qxEuQzVK92fjgffD bffDIivjJiR3RFS1hVKMimM+GLaOBi2i/aGfeCSjOLSpvDbPtg4/729Wzhj+RY0H lrk/USXGKKb7Las2uPtO9jzm8TQ+Dk4XtEj4ksF3NZgbXz4RfZg= =tq6B -----END PGP SIGNATURE----- --cARYMvk1lE+D97sy--