Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1o9F0n-0003Ao-CY for pgsql-hackers@arkaria.postgresql.org; Thu, 07 Jul 2022 00:04:53 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1o9F0m-0005nn-8b for pgsql-hackers@arkaria.postgresql.org; Thu, 07 Jul 2022 00:04:52 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1o9F0l-0005mo-68 for pgsql-hackers@lists.postgresql.org; Thu, 07 Jul 2022 00:04:51 +0000 Received: from out2-smtp.messagingengine.com ([66.111.4.26]) by makus.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1o9F0i-0006ug-MU for pgsql-hackers@lists.postgresql.org; Thu, 07 Jul 2022 00:04:50 +0000 Received: from compute2.internal (compute2.nyi.internal [10.202.2.46]) by mailout.nyi.internal (Postfix) with ESMTP id 0B9215C01A2; Wed, 6 Jul 2022 20:04:48 -0400 (EDT) Received: from mailfrontend2 ([10.202.2.163]) by compute2.internal (MEProxy); Wed, 06 Jul 2022 20:04:48 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=anarazel.de; h= cc:cc:content-type:date:date:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:sender:subject :subject:to:to; s=fm3; t=1657152288; x=1657238688; bh=D43h1nMC2w 7rKyeNuUrn5vY4/hCfar5swFhbNKB7QvA=; b=gBbivmZcC8QzrxW4vrtWWBBx18 Bg3uFguVrb7CCKEwkTLqVgluRkw6fTVMTXNkpS7zs9jP89600WqlBzfSSc1qR3X0 6LY8MPcikk77fyQgPqtBkB8B9PCXLcM4iHOtSkYWrUp1pjHDxlPAiKIrMSb2oqLs KjGMjdpiLjX+Amhe8ZcokYrGXnShCdKQ3fsFsi8sI7TZzAGSmpfLbJzxZz0QRWOZ PlhQpqqA+rRhMQfe5TQGuDL9P80mv3rrnHMRIGV2MneHM+/FEJsUjxv+dOHjEcGC uJ7SAaW84YtVR/8KGYWQZefj4WIbWt3ZrvPT36C/1+0VJ9ws34+H57STgraA== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:cc:content-type:date:date:feedback-id :feedback-id:from:from:in-reply-to:in-reply-to:message-id :mime-version:references:reply-to:sender:subject:subject:to:to :x-me-proxy:x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s= fm3; t=1657152288; x=1657238688; bh=D43h1nMC2w7rKyeNuUrn5vY4/hCf ar5swFhbNKB7QvA=; b=CnpFf0Msb4nIl08A3D+d3x5zpPvjgiZU7Sj6puxz+cNq RZFZB12DnHMfwlBLOthpwhHsQmnjpSy2EHa3Vio+uoDWaSesl1+GObYO/+Dpf1FH tok/dVUKALXYkyX5ZdE1Yui76FFwtN+raC1qyEKdZT1UGtR8kgRhS0wOOWwD+92E 8+/Li992o8HVnQujqyUKxGfJZaZ2dUumJ1snuv6cZuCCuMHlI/BoSDH/gC+TBfQ+ C6XK/GR1LwGRj21TL9CEHXVpqO0YfeOa9yRC3pgqc4oJAYiT8qTCpybHISpm9MrT JInXzsdkwD1ZVnX4QPpyn6rwxBlS3vWZK6AskLxPBQ== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvfedrudeigedgfeduucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne cujfgurhepfffhvfevuffkfhggtggujgesthdtredttddtvdenucfhrhhomheptehnughr vghsucfhrhgvuhhnugcuoegrnhgurhgvshesrghnrghrrgiivghlrdguvgeqnecuggftrf grthhtvghrnhepvdfffeevhfetveffgeeiteefhfdtvdffjeevhfeuteegleduheetvedu ieettddunecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomh eprghnughrvghssegrnhgrrhgriigvlhdruggv X-ME-Proxy: Feedback-ID: id4a34324:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA; Wed, 6 Jul 2022 20:04:47 -0400 (EDT) Date: Wed, 6 Jul 2022 17:04:46 -0700 From: Andres Freund To: Nitin Jadhav Cc: Bharath Rupireddy , Matthias van de Meent , Ashutosh Sharma , Julien Rouhaud , Bruce Momjian , Tom Lane , Magnus Hagander , PostgreSQL Hackers Subject: Re: Report checkpoint progress with pg_stat_progress_checkpoint (was: Report checkpoint progress in server logs) Message-ID: <20220707000446.hefgyu5xikxwt4md@alap3.anarazel.de> References: <20220319001556.atuqbmafvc73pa2k@alap3.anarazel.de> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk Hi, On 2022-06-13 19:08:35 +0530, Nitin Jadhav wrote: > > Have you measured the performance effects of this? On fast storage with large > > shared_buffers I've seen these loops in profiles. It's probably fine, but it'd > > be good to verify that. > > To understand the performance effects of the above, I have taken the > average of five checkpoints with the patch and without the patch in my > environment. Here are the results. > With patch: 269.65 s > Without patch: 269.60 s Those look like timed checkpoints - if the checkpoints are sleeping a part of the time, you're not going to see any potential overhead. To see whether this has an effect you'd have to make sure there's a certain number of dirty buffers (e.g. by doing CREATE TABLE AS some_query) and then do a manual checkpoint and time how long that times. Greetings, Andres Freund