public inbox for [email protected]
help / color / mirror / Atom feedFrom: Ron Johnson <[email protected]>
To: [email protected] <[email protected]>
Subject: Re: Verify or dump pgdata files
Date: Mon, 21 Oct 2024 12:21:45 -0400
Message-ID: <CANzqJaD0_WTaZG1FM9XWdwAVYX4TYimmtQADsL96yx06uUwjhQ@mail.gmail.com> (raw)
In-Reply-To: <DM8PR09MB6677514BB737524965A646CAB8432@DM8PR09MB6677.namprd09.prod.outlook.com>
References: <DM8PR09MB66778E385B20344549E6D3CDB8412@DM8PR09MB6677.namprd09.prod.outlook.com>
<CAJQ7xG4OLtxHZRqmnYH1pm9DYdtBXK_55DP5jarZFZSous+TNg@mail.gmail.com>
<DM8PR09MB6677514BB737524965A646CAB8432@DM8PR09MB6677.namprd09.prod.outlook.com>
Use PgBackRest or pg_basebackup. Not only do they correctly handle wal
files, but do checksums.
On Mon, Oct 21, 2024 at 11:51 AM Murthy Nunna <[email protected]> wrote:
> Hi Muhammad,
>
>
>
> Thank you for responding to my query.
>
>
>
> I don’t think checksum method will work in my situation because the source
> file would have changed by the time I run checksum. So, the checksum (or
> diff) will be different.
>
> I am doing rsync of active cluster.
>
>
>
> What I am looking for is physical (structural) verification of target file
> such as beginning block and end block, beginning of file and end of file
> etc. All I want to know is “completeness” and “readability” of the file by
> postgres.
>
>
>
> Thanks.
>
>
>
>
>
> *From:* Muhammad Ikram <[email protected]>
> *Sent:* Sunday, October 20, 2024 10:34 PM
> *To:* Murthy Nunna <[email protected]>
> *Cc:* [email protected]
> *Subject:* Re: Verify or dump pgdata files
>
>
>
> [EXTERNAL] – This message is from an external sender
>
> Hi,
>
>
>
> Could you use diff ? e.g.
>
>
>
> diff -qr /var/lib/pgsql/15/data /tmp/data
>
>
>
> Or
>
>
>
> pg_checksums --verify --data-dir=/pgdata (for checksum enabled databases)
>
>
>
> or do checksum on source and target and take diff between two checksum
> generated files e.g.
>
>
>
> cd /pgdata
> find . -type f -exec sha256sum {} \; > /tmp/source_checksums.txt
>
>
>
>
>
> Regards,
>
> Ikram
>
>
>
>
>
>
>
> On Sun, Oct 20, 2024 at 4:45 AM Murthy Nunna <[email protected]> wrote:
>
> Hi,
>
>
>
> We are currently using pg_waldump to verify integrity of WAL files after
> archiving them in external storage. If the WAL is incomplete pg_waldump
> returns error, which is great.
>
>
>
> Similarly, I am wondering if there is any utility that can be used against
> data files in /pgdata. Just to verify after “rsync” of /pgdata.
>
>
>
> Thanks in advance for your response.
>
>
>
>
>
>
>
>
>
>
--
Death to <Redacted>, and butter sauce.
Don't boil me, I'm still alive.
<Redacted> crustacean!
view thread (5+ messages) latest in thread
reply
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: [email protected]
Cc: [email protected]
Subject: Re: Verify or dump pgdata files
In-Reply-To: <CANzqJaD0_WTaZG1FM9XWdwAVYX4TYimmtQADsL96yx06uUwjhQ@mail.gmail.com>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox