From: Ron <ronljohnsonjr@gmail.com>
To: pgsql-admin@lists.postgresql.org
Subject: Re: pgbackrest archive.info got deleted unexpected
Date: Wed, 3 Aug 2022 07:02:08 -0500
Message-ID: <d9d0e8cf-c085-05d8-3d24-b1fa6ecbe307@gmail.com> (raw)
In-Reply-To: <PH0PR11MB51911C27148F788333BBC782D69C9@PH0PR11MB5191.namprd11.prod.outlook.com>
References: <PH0PR11MB51911C27148F788333BBC782D69C9@PH0PR11MB5191.namprd11.prod.outlook.com>
On 8/3/22 04:23, James Pang (chaolpan) wrote:
>
> Hi,
>
> We use pgbackrest 2.34 on RHEL8.4 to backup PGv13 database to AWS S3
> buckets , we found after some time successful backup , suddenly got below
> error:
>
> 2022-07-23 10:30:04.743 P00 INFO: archive-push:async command begin 2.38:
> [/pgdata/pg_wal] --archive-async --archive-push-queue-max=10240MB
> --compress-type=none --exec-id=813450-3a783f75 --log-level-console=off
> --log-level-stderr=off --pg1-path=/pgdata --process-max=2
> --repo1-path=/pgbackup --repo1-s3-bucket=xxxxxxxxx
> --repo1-s3-endpoint=s3-fips.us-west-2.amazonaws.com
> --repo1-s3-key-type=auto --repo1-s3-region=us-west-2 --repo1-type=s3
> --spool-path=/pgarchive/pgbackrest --stanza=xxxxxxx
>
> 2022-07-23 10:30:04.744 P00 INFO: push 1 WAL file(s) to archive:
> 00000001000000DB000000A4
>
> 2022-07-23 10:30:04.907 P00 ERROR: [103]: unable to find a valid repository:
>
> repo1: [FileMissingError] unable to
> load info file '/pgbackup/archive/xxxxxx/archive.info' or
> '/pgbackup/archive/xxxxxx/archive.info.copy':
>
> FileMissingError: unable to open missing file
> '/pgbackup/archive/xxxxxx/archive.info' for read
>
> FileMissingError: unable to open missing file
> '/pgbackup/archive/xxxxxx/archive.info.copy' for read
>
> HINT: archive.info cannot be opened
> but is required to push/get WAL segments.
>
> HINT: is archive_command configured
> correctly in postgresql.conf?
>
> HINT: has a stanza-create been performed?
>
> HINT: use --no-archive-check to
> disable archive checks during backup if you have an alternate archiving
> scheme.
>
> Then we login to check both archive.info and archive.info.copy got
> disappeared in S3 bucket , we do not have job or command to manually
> delete that file, and we do not recreate standza either, not sure why
> suddenly missed the archive.info. without the archive.info, we have to
> recreate pgbackrest stanza repo again, but all old backup pieces got
> invalid too.
>
> Could you help figure out how that happened ? we faced this issue several
> times .
>
This is certainly a question for AWS ("how do I audit bucket deletes?") or
the pgbackrest github site, not postgresql.
--
Angular momentum makes the world go 'round.
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-admin@postgresql.org
Cc: ronljohnsonjr@gmail.com, pgsql-admin@lists.postgresql.org
Subject: Re: pgbackrest archive.info got deleted unexpected
In-Reply-To: <d9d0e8cf-c085-05d8-3d24-b1fa6ecbe307@gmail.com>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox