Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.96) (envelope-from ) id 1w0eAP-0025VX-08 for pgsql-hackers@arkaria.postgresql.org; Thu, 12 Mar 2026 11:25:25 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.96) (envelope-from ) id 1w0eAN-00EVL6-0G for pgsql-hackers@arkaria.postgresql.org; Thu, 12 Mar 2026 11:25:23 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.96) (envelope-from ) id 1w0eAM-00EVKx-23 for pgsql-hackers@lists.postgresql.org; Thu, 12 Mar 2026 11:25:23 +0000 Received: from mail.postgrespro.ru ([93.174.132.70]) by magus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.98.2) (envelope-from ) id 1w0eAK-00000002I5G-1Qa6 for pgsql-hackers@lists.postgresql.org; Thu, 12 Mar 2026 11:25:22 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=postgrespro.ru; s=mx2023; t=1773314719; bh=wZa1Q0tZaEqxM4gv/8Hfy9s1elnNXeQGAnM+rA7sJC4=; h=Message-ID:Date:User-Agent:Subject:To:Cc:References:From: In-Reply-To:From; b=7bbcCsQx2IzC4qHO6xXwkm7jgOf7owBtbFxTlNpTxYWDVHgk9oDtQw7xhx1pgivP1 RzCrMPMZqB/3obcPe1beh/9B93TpvNXQ7Os4UPDMeAXsbk7coRaNak1wJmYxjjA2NF c+3GVGxMEjG26D4qytps81PTRpTwpTBfSBAmexy73TcUmJkguAhSW1L/p9TdVbO2GQ sDuXgy9VyMBsFfYOLb+gefs9HRgPozUUMKNM7R2G2tkyw1VkES5Au5lZEmRNgoAHPW ewFS1AA6NETX4pSKP7ehew6RZ0X+A3qOO/VQKkW0h5zThEBqEedcDSAsJhRZqIUow3 Jj1uMkU1hs4iw== Received: from [172.30.51.238] (debian11-template.l.postgrespro.ru [192.168.2.254]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: y.sokolov@postgrespro.ru) by mail.postgrespro.ru (Postfix/465) with ESMTPSA id 7ABE76044D; Thu, 12 Mar 2026 14:25:18 +0300 (MSK) Message-ID: Date: Thu, 12 Mar 2026 14:25:17 +0300 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: Why clearing the VM doesn't require registering vm buffer in wal record To: Andres Freund , Matthias van de Meent Cc: Melanie Plageman , PostgreSQL Hackers , Robert Haas , Heikki Linnakangas , "Andrey M. Borodin" References: Content-Language: en-US From: Yura Sokolov In-Reply-To: Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-KSMG-AntiPhishing: NotDetected X-KSMG-AntiSpam-Interceptor-Info: not scanned X-KSMG-AntiSpam-Status: not scanned, disabled by settings X-KSMG-AntiVirus: Kaspersky Secure Mail Gateway, version 2.1.0.7854, bases: 2026/03/12 03:10:00 #28276559 X-KSMG-AntiVirus-Status: NotDetected, skipped X-KSMG-LinksScanning: not scanned, disabled by settings X-KSMG-Message-Action: skipped X-KSMG-Rule-ID: 1 List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk 06.03.2026 00:01, Andres Freund пишет: > Hi, > > On 2026-03-05 15:38:24 -0500, Andres Freund wrote: >>> On Thu, 5 Mar 2026 at 21:16, Andres Freund wrote: >>>> >>>> But it does seem like it could be a problem for incremental backup / >>>> walsummarizer? >>> >>> I don't think it is, because that doesn't do calculations for non-main >>> forks, it considers those forks always changed and includes them in >>> full. Or at least, that was the response I got when I raised concerns >>> about the FSM back when the incremental backup feature was being >>> developed [0]. >> >> There's explicit code for ignoring the FSM, but I don't see the same for the >> VM. And that makes sense: VM changes are mostly WAL logged, just not >> completely / generically (i.e. this complaint), whereas FSM changes are not >> WAL logged at all. > > Unfortunately I can confirm that incremental backups end up with an outdated > VM. That is why pg_probackup still archive VM at whole in incremental (WAL parsing) backup. That is why WAL-G's incremental backup in WAL-parsing mode is (was?) considered unstable. I know the problem for couple of years. Excuse me I didn't write about. I didn't recognize fix could be as simple as registering VM buffers. My bad. I fill so stupid :-( It would be great if it will be fixed in all supported versions. -- regards Yura Sokolov aka funny-falcon