public inbox for [email protected]  

help / color / mirror / Atom feed

From: Murthy Nunna <[email protected]>
To: Muhammad Ikram <[email protected]>
Cc: [email protected] <[email protected]>
Subject: RE: Verify or dump pgdata files
Date: Mon, 21 Oct 2024 15:51:44 +0000
Message-ID: <DM8PR09MB6677514BB737524965A646CAB8432@DM8PR09MB6677.namprd09.prod.outlook.com> (raw)
In-Reply-To: <CAJQ7xG4OLtxHZRqmnYH1pm9DYdtBXK_55DP5jarZFZSous+TNg@mail.gmail.com>
References: <DM8PR09MB66778E385B20344549E6D3CDB8412@DM8PR09MB6677.namprd09.prod.outlook.com>
	<CAJQ7xG4OLtxHZRqmnYH1pm9DYdtBXK_55DP5jarZFZSous+TNg@mail.gmail.com>

Hi Muhammad,

Thank you for responding to my query.

I don’t think checksum method will work in my situation because the source file would have changed by the time I run checksum. So, the checksum (or diff) will be different.
I am doing rsync of active cluster.

What I am looking for is physical (structural) verification of target file such as beginning block and end block, beginning of file and end of file etc. All I want to know is “completeness” and “readability” of the file by postgres.

Thanks.


From: Muhammad Ikram <[email protected]>
Sent: Sunday, October 20, 2024 10:34 PM
To: Murthy Nunna <[email protected]>
Cc: [email protected]
Subject: Re: Verify or dump pgdata files


[EXTERNAL] – This message is from an external sender
Hi,

Could you use diff ? e.g.

diff -qr /var/lib/pgsql/15/data /tmp/data

Or

pg_checksums --verify --data-dir=/pgdata  (for checksum enabled databases)

or do checksum on source and target and take diff between two checksum generated files e.g.

cd /pgdata
find . -type f -exec sha256sum {} \; > /tmp/source_checksums.txt


Regards,
Ikram



On Sun, Oct 20, 2024 at 4:45 AM Murthy Nunna <[email protected]<mailto:[email protected]>> wrote:
Hi,

We are currently using pg_waldump to verify integrity of WAL files after archiving them in external storage. If the WAL is incomplete pg_waldump returns error, which is great.

Similarly, I am wondering if there is any utility that can be used against data files in /pgdata. Just to verify after “rsync” of /pgdata.

Thanks in advance for your response.

view thread (5+ messages)  latest in thread

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: [email protected]
  Cc: [email protected], [email protected]
  Subject: RE: Verify or dump pgdata files
  In-Reply-To: <DM8PR09MB6677514BB737524965A646CAB8432@DM8PR09MB6677.namprd09.prod.outlook.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox