Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.96) (envelope-from ) id 1w0f3s-0026HY-2c for pgsql-hackers@arkaria.postgresql.org; Thu, 12 Mar 2026 12:22:45 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.96) (envelope-from ) id 1w0f3r-00EkCH-0j for pgsql-hackers@arkaria.postgresql.org; Thu, 12 Mar 2026 12:22:43 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.96) (envelope-from ) id 1w0f3q-00EkC7-2X for pgsql-hackers@lists.postgresql.org; Thu, 12 Mar 2026 12:22:43 +0000 Received: from mail.postgrespro.ru ([93.174.132.70]) by makus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.98.2) (envelope-from ) id 1w0f3o-00000001ld2-1S0E for pgsql-hackers@lists.postgresql.org; Thu, 12 Mar 2026 12:22:42 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=postgrespro.ru; s=mx2023; t=1773318156; bh=cctted6e0xuBm0foKbeUnmlRFl8YDcrQpnDz56tI+fo=; h=Message-ID:Date:User-Agent:Subject:From:To:Cc:References: In-Reply-To:From; b=hUPKW5f1djFGleObSCh/Vzcl0ffY7DVguQ0GOiQc1BrwgAOO49ZAD18KkI9vf2n0t /hkRVRZbpxArIdFtEFUdG9ZMZYZ6usQIeuS0lqBjFzLJKEqoNWmpa3Go8yH+90Z3Cg elGkb+yBYUP3rbgip14xIkYBXby2OPGqUM6fAgn+ineepl1wBHaTOniQvO0uBxEcHb vvuR3cwUP97NeeRtA+BI2RTAPpD/gGVCu6UVjw3FY+tXdYyA/XB9cPxXUtIoM9F70V TLlM/5ubGaCVELmZKyLE6t/ynKCyadgCeoFZnpaWi59sz1bzX1qc0t9Zp2Kgmd1LBB 2Q1t8fSy4fueg== Received: from [172.30.51.238] (debian11-template.l.postgrespro.ru [192.168.2.254]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: y.sokolov@postgrespro.ru) by mail.postgrespro.ru (Postfix/465) with ESMTPSA id 4EE376019F; Thu, 12 Mar 2026 15:22:36 +0300 (MSK) Message-ID: Date: Thu, 12 Mar 2026 15:22:35 +0300 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: Why clearing the VM doesn't require registering vm buffer in wal record From: Yura Sokolov To: Andres Freund , Matthias van de Meent Cc: Melanie Plageman , PostgreSQL Hackers , Robert Haas , Heikki Linnakangas , "Andrey M. Borodin" References: Content-Language: en-US In-Reply-To: Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-KSMG-AntiPhishing: NotDetected X-KSMG-AntiSpam-Interceptor-Info: not scanned X-KSMG-AntiSpam-Status: not scanned, disabled by settings X-KSMG-AntiVirus: Kaspersky Secure Mail Gateway, version 2.1.0.7854, bases: 2026/03/12 03:10:00 #28276559 X-KSMG-AntiVirus-Status: NotDetected, skipped X-KSMG-LinksScanning: not scanned, disabled by settings X-KSMG-Message-Action: skipped X-KSMG-Rule-ID: 1 List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk 12.03.2026 14:25, Yura Sokolov пишет: > 06.03.2026 00:01, Andres Freund пишет: >> Hi, >> >> On 2026-03-05 15:38:24 -0500, Andres Freund wrote: >>>> On Thu, 5 Mar 2026 at 21:16, Andres Freund wrote: >>>>> >>>>> But it does seem like it could be a problem for incremental backup / >>>>> walsummarizer? >>>> >>>> I don't think it is, because that doesn't do calculations for non-main >>>> forks, it considers those forks always changed and includes them in >>>> full. Or at least, that was the response I got when I raised concerns >>>> about the FSM back when the incremental backup feature was being >>>> developed [0]. >>> >>> There's explicit code for ignoring the FSM, but I don't see the same for the >>> VM. And that makes sense: VM changes are mostly WAL logged, just not >>> completely / generically (i.e. this complaint), whereas FSM changes are not >>> WAL logged at all. >> >> Unfortunately I can confirm that incremental backups end up with an outdated >> VM. > > That is why pg_probackup still archive VM at whole in incremental (WAL > parsing) backup. > That is why WAL-G's incremental backup in WAL-parsing mode is (was?) > considered unstable. > > I know the problem for couple of years. Excuse me I didn't write about. > > I didn't recognize fix could be as simple as registering VM buffers. > My bad. I fill so stupid :-( Should LSN properly set as well on vm page? To maximum of concurrent updates, of course. -- regards Yura Sokolov aka funny-falcon