public inbox for [email protected]  
help / color / mirror / Atom feed
From: Christophe Pettus <[email protected]>
To: Laurenz Albe <[email protected]>
Cc: bruno vieira da silva <[email protected]>
Cc: [email protected]
Subject: Re: data checksums
Date: Tue, 6 Aug 2024 20:14:22 -0700
Message-ID: <[email protected]> (raw)
In-Reply-To: <[email protected]>
References: <CAB+Nuk8y88kvoRHsfN2Pjed9o_iM+9FbveU=4P8G0EQbzFP+qw@mail.gmail.com>
	<[email protected]>
	<[email protected]>



> On Aug 6, 2024, at 19:45, Laurenz Albe <[email protected]> wrote:
> I am surprised by that.  Would you say that most storage systems will happily give you a
> garbage block if there was a hardware problem somewhere?

"Most" is hard for me to judge.  HDDs can have uncorrected and undetected errors, definitely.  ZFS, for example, can correct those (within limits); XFS doesn't try.  I have been told that SSDs can have uncorrected/undetected errors as well, but I don't know details on that.

> Turning data checksums on will write WAL for hint bits, which can significantly increase
> the amount of WAL written.

I was curious about that, so I just did a quick experiment using pgbench, with identical databases except for checksums.  They both generated the same amount of WAL within 10% or so, so I don't think the impact is huge.  (And you need the hint bits for pg_rewind, which is a nice thing to have in your back pocket if required.)





view thread (8+ messages)  latest in thread

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: [email protected]
  Cc: [email protected], [email protected], [email protected], [email protected]
  Subject: Re: data checksums
  In-Reply-To: <[email protected]>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox