Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1oviZl-00007V-Ag for pgsql-hackers@arkaria.postgresql.org; Thu, 17 Nov 2022 17:21:21 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1oviZk-0003xo-8G for pgsql-hackers@arkaria.postgresql.org; Thu, 17 Nov 2022 17:21:20 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1oviZj-0003xe-U6 for pgsql-hackers@lists.postgresql.org; Thu, 17 Nov 2022 17:21:19 +0000 Received: from mail-lj1-x231.google.com ([2a00:1450:4864:20::231]) by makus.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.92) (envelope-from ) id 1oviZh-0000DO-E7 for pgsql-hackers@lists.postgresql.org; Thu, 17 Nov 2022 17:21:18 +0000 Received: by mail-lj1-x231.google.com with SMTP id a15so3562023ljb.7 for ; Thu, 17 Nov 2022 09:21:17 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=k1Z3bZt3DnKGvsRMjrnasmoQTc0rI6RmU+PnMhFFsIY=; b=Q9IegHtHQnHdpTVavgiV7T5h/8waDjljJOAEZ4Kl88C0cR3Fg3INCai6WCd6mcNknV zM1k07rOrpHY/rchhnao7nn2GnqxmPJ+yma0kogccFYw7CHD3ELMZ2hXsiSU0Qodmvqg 0VXMjVnUKrDgKZYPLt/R6jeeEIjFVAl0vuVNtnYzFapSCiPTUexfdssMvqc2wheqYQEw VkrlUYOZvnMj0dxOlV6IRVOBku5xgyvWe7GZkuwjJEq/78gx+IAskxvEy0obJfzBXH8k zOoIHoezBM7XxUxDL0f6FCD8VOCPFuiD331EO81oQfxSVujgR/X4ofTLQlOa+6pnarrs ivWw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=k1Z3bZt3DnKGvsRMjrnasmoQTc0rI6RmU+PnMhFFsIY=; b=PhExjZAqAclYdCHNL3UNwTl/4RNl8hvtDQjTf9kUc2yzatK5H6Mg3It923Y5qzftb5 EhktmxmR/WS/dNpN2SBPTM9el/SIa0U1XwKtt7Qmyye0C8QdyP2F22v7T9b6njWTY2ex EhgIfmJ59KKuRWbiaB/ajPOfLFHc30EQZBfC4Ki4vkUnV4kF4WirYVbGlhEyZVl/feuO cGhx2XUhqBdyTsOFnh2I916vIt8gguqt5U8CRpNIsrx1ze8V0uJruf6m7oWVI5Nb4os1 HLyDeL4zSqSE8DWs4JPbxQUjd5s8CVfszSeTunJ7w2uKl6Ia/yQ65tnIJAqIH9LL9wxS ULNQ== X-Gm-Message-State: ANoB5pnRq+L+q4STNJSGhYFOQezq7ctQVKrOH+pi0yB8sClxSY/wxOyi ZlRU4FNHyyCfyj3PopTGT2lcFZQrDf+N/2UL7sk= X-Google-Smtp-Source: AA0mqf4xwpdq/cAuP0Ym8tahyFjNOytyGx5YPz+dRCT9VoGjOyvjBGKMJFLTV7keZ7m4dZMAX7htHTLANPJmkg9c5AU= X-Received: by 2002:a05:651c:b26:b0:277:9847:286a with SMTP id b38-20020a05651c0b2600b002779847286amr1307963ljr.309.1668705674588; Thu, 17 Nov 2022 09:21:14 -0800 (PST) MIME-Version: 1.0 References: <20220319001556.atuqbmafvc73pa2k@alap3.anarazel.de> <20220707000446.hefgyu5xikxwt4md@alap3.anarazel.de> <20221116195232.wynvnlng2ivne76b@awork3.anarazel.de> <20221117162431.a3kqnpgjjsa7foxy@awork3.anarazel.de> In-Reply-To: <20221117162431.a3kqnpgjjsa7foxy@awork3.anarazel.de> From: Robert Haas Date: Thu, 17 Nov 2022 12:21:03 -0500 Message-ID: Subject: Re: Report checkpoint progress with pg_stat_progress_checkpoint (was: Report checkpoint progress in server logs) To: Andres Freund Cc: Melanie Plageman , Bharath Rupireddy , "Drouvot, Bertrand" , Nitin Jadhav , Matthias van de Meent , Ashutosh Sharma , Julien Rouhaud , Bruce Momjian , Tom Lane , Magnus Hagander , PostgreSQL Hackers Content-Type: text/plain; charset="UTF-8" List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk On Thu, Nov 17, 2022 at 11:24 AM Andres Freund wrote: > As an experiment, I added a progress report to BufferSync()'s first loop > (i.e. where it checks all buffers). On a 128GB shared_buffers cluster that > increases the time for a do-nothing checkpoint from ~235ms to ~280ms. If I > remove the changecount stuff and use a single write + write barrier, it ends > up as 250ms. Inlining brings it down a bit further, to 247ms. OK, I'd say that's pretty good evidence that we can't totally disregard the issue. -- Robert Haas EDB: http://www.enterprisedb.com