Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1jYt6T-000723-69 for pgsql-hackers@arkaria.postgresql.org; Wed, 13 May 2020 15:15:25 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1jYt6R-0002RN-7H for pgsql-hackers@arkaria.postgresql.org; Wed, 13 May 2020 15:15:23 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1jYt6R-0002RF-0H for pgsql-hackers@lists.postgresql.org; Wed, 13 May 2020 15:15:23 +0000 Received: from momjian.us ([72.94.173.45]) by makus.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1jYt6O-0004g1-23 for pgsql-hackers@postgresql.org; Wed, 13 May 2020 15:15:21 +0000 Received: from bruce by momjian.us with local (Exim 4.92) (envelope-from ) id 1jYt6M-0006GN-Ae; Wed, 13 May 2020 11:15:18 -0400 Date: Wed, 13 May 2020 11:15:18 -0400 From: Bruce Momjian To: Kyotaro Horiguchi Cc: noah@leadboat.com, pgsql-hackers@postgresql.org Subject: Re: PG 13 release notes, first draft Message-ID: <20200513151518.GA20111@momjian.us> References: <20200512001204.GF4666@momjian.us> <20200512.130908.2082912530895654639.horikyota.ntt@gmail.com> <20200512203809.GA4666@momjian.us> <20200513.115633.157251733478541458.horikyota.ntt@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20200513.115633.157251733478541458.horikyota.ntt@gmail.com> User-Agent: Mutt/1.10.1 (2018-07-13) List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Precedence: bulk On Wed, May 13, 2020 at 11:56:33AM +0900, Kyotaro Horiguchi wrote: > > > > Allow skipping of WAL for new tables and indexes if wal_level is > > 'minimal' (Kyotaro Horiguchi) > > > > Relations larger than wal_skip_threshold will have their files > > fsync'ed rather than writing their WAL records. Previously this > > was done only for COPY operations, but the implementation had a > > bug that could cause data loss during crash recovery. > > I see it. It is giving weight on improvement. Looks good the overall > structure of the description above. However, wal-skipping is always > done regardless of table size. wal_skip_threshold is an optimization > to choose which to use fsync or FPI records (that is, not WAL records > in the common sense) at commit for speed. Well, as far as users are concerned, everything wrtiten to WAL is a WAL record. > So how about the following? > > All kinds of bulk-insertion are not WAL-logged then fsync'ed at > commit. Using FPI WAL records instead of fsync for relations smaller > than wal_skip_threshold. Previously this was done only for COPY > operations and always using fsync, but the implementation had a bug > that could cause data loss during crash recovery. That is too much detail for the release notes. We already will link to the docs. Why put it here? -- Bruce Momjian https://momjian.us EnterpriseDB https://enterprisedb.com + As you are, so once was I. As I am, so you will be. + + Ancient Roman grave inscription +