Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1sbWgU-00HDBu-2n for pgsql-general@arkaria.postgresql.org; Wed, 07 Aug 2024 02:45:54 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1sbWgS-0041EZ-2y for pgsql-general@arkaria.postgresql.org; Wed, 07 Aug 2024 02:45:52 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1sbWgR-0041EQ-Dp for pgsql-general@lists.postgresql.org; Wed, 07 Aug 2024 02:45:51 +0000 Received: from mail-ej1-x62c.google.com ([2a00:1450:4864:20::62c]) by makus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.94.2) (envelope-from ) id 1sbWgO-003TTo-6z for pgsql-general@lists.postgresql.org; Wed, 07 Aug 2024 02:45:49 +0000 Received: by mail-ej1-x62c.google.com with SMTP id a640c23a62f3a-a7a94478a4eso67890766b.1 for ; Tue, 06 Aug 2024 19:45:47 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cybertec-at.20230601.gappssmtp.com; s=20230601; t=1722998746; x=1723603546; darn=lists.postgresql.org; h=mime-version:user-agent:content-transfer-encoding:references :in-reply-to:date:cc:to:from:subject:message-id:from:to:cc:subject :date:message-id:reply-to; bh=LiX6wEsmzyjPeZvUewCXHMRKkWC7hVSB7KGFdJXNZ0Y=; b=1knhWkipRNgQUui68m9HzRnMd6wu/yLJm7C10cPp80d4TZClDmuOfq6+K2lV4PuEGR 4Xbz7G+bh/EMARFbitrqtq0K9YUjn1jrt76mkXCflki7YrhW3sBC3Cy4H+ZsAKlKQY5B mR3TH4qlR6f+PRlJCUBg+M1+S7LH4SmZecBmzoeOr+94iePubO+2edw2LupVj6otk+KD P3HaZr142UU58afYJCXH8RiSwIf3g/Zcx2ufVIj/WCVmtiGSjx3RllasAFbWCjGS84Rz E/NESugTUGBd2YIamvKYhtgeViWmXXLT+p6/HPTNCxjfgavxQEjZP0lXyCtZSYImgy2B MQ+w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1722998746; x=1723603546; h=mime-version:user-agent:content-transfer-encoding:references :in-reply-to:date:cc:to:from:subject:message-id:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=LiX6wEsmzyjPeZvUewCXHMRKkWC7hVSB7KGFdJXNZ0Y=; b=q6r4L2ZX1zsvmsegKARlEHiX986APGXgAd3rw/pkrfdU6K5b5xp8+A1d19DnmgzS/J hx2gwjfFDVhup4LGqx50jHa25L49nYaQ83IG4EdAAJddplqBQE5JChv408eXDg05AMnb NBFw72l4BQ6uToJrCSRo2SMxbNiqhJ6Ctpj1MtEYiIpKIWl061y0+RHBQOL/etMloMPo SvVEv0KBbomiSgwswf+M/yirJOW6CmcgC1Tb9e31I/HY8fRZBgZniEMavCk8unypubNX M00TTpJ2eV2QHsmXt3Obw64FPT0FFvAPs1g7yb3ljH8ot41y8hEoKXXdtFRBm+tBLl9n 9qHg== X-Gm-Message-State: AOJu0YzMV6kShvp0d6Ao82K3Vu3loDQ61RFC/mnSzN9qSSY2Cb001uzk 2hKN06Ih0MC0CJzEejebkORajgHnv1gFX1iMREHdj0Epmab3yZPCDTtA0kOHp4k= X-Google-Smtp-Source: AGHT+IGdGO/6mI4aIrd+nIT2fwbJDhGrLlHXSUGWusys+JNULeElBAV3NJntSq6SNKKz/dPvoI3EZw== X-Received: by 2002:a17:907:d9e:b0:a6f:e0f0:d669 with SMTP id a640c23a62f3a-a8079035e7dmr56325266b.12.1722998745379; Tue, 06 Aug 2024 19:45:45 -0700 (PDT) Received: from dynamic-pd01.res.v6.highway.a1.net ([2001:871:260:698c:28a4:9d4:f577:2862]) by smtp.gmail.com with ESMTPSA id a640c23a62f3a-a7dc9c0b62esm597953266b.62.2024.08.06.19.45.45 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 06 Aug 2024 19:45:45 -0700 (PDT) Message-ID: <830004cb0a514d803d13ab9abcfa15fbae365748.camel@cybertec.at> Subject: Re: data checksums From: Laurenz Albe To: Christophe Pettus , bruno vieira da silva Cc: pgsql-general@lists.postgresql.org Date: Wed, 07 Aug 2024 04:45:44 +0200 In-Reply-To: <15AB8DDB-7D4B-4272-801F-F5DD84E829E6@thebuild.com> References: <15AB8DDB-7D4B-4272-801F-F5DD84E829E6@thebuild.com> Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable User-Agent: Evolution 3.52.3 (3.52.3-1.fc40) MIME-Version: 1.0 List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk On Tue, 2024-08-06 at 09:29 -0700, Christophe Pettus wrote: >=20 > > On Aug 6, 2024, at 08:11, bruno vieira da silva = wrote: > >=20 > > so my question is why data checksums aren't enabled by default on pg? >=20 > At this point, mostly historical reasons. They're also superfluous if yo= ur underlying > file system or storage hardware does storage-level corruption checks (whi= ch most don't). I am surprised by that. Would you say that most storage systems will happi= ly give you a garbage block if there was a hardware problem somewhere? > > the pg doc=20 > > mentions a considerable performance penality, how considerable it is? >=20 > That line is probably somewhat out of date at this point. We haven't see= n a significant > slowdown in enabling them on any modern hardware. I always turn them on,= except on the > type of filesystems/hardware mentioned above. Turning data checksums on will write WAL for hint bits, which can significa= ntly increase the amount of WAL written. Yours, Laurenz Albe