Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1r13A6-00949f-J3 for pgsql-hackers@arkaria.postgresql.org; Thu, 09 Nov 2023 11:25:26 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1r13A4-00DDgQ-Va for pgsql-hackers@arkaria.postgresql.org; Thu, 09 Nov 2023 11:25:24 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1r13A4-00DDe8-2o for pgsql-hackers@lists.postgresql.org; Thu, 09 Nov 2023 11:25:24 +0000 Received: from out1-smtp.messagingengine.com ([66.111.4.25]) by magus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1r139w-005WUz-N4 for pgsql-hackers@lists.postgresql.org; Thu, 09 Nov 2023 11:25:23 +0000 Received: from compute6.internal (compute6.nyi.internal [10.202.2.47]) by mailout.nyi.internal (Postfix) with ESMTP id 368D85C0325; Thu, 9 Nov 2023 06:25:15 -0500 (EST) Received: from mailfrontend2 ([10.202.2.163]) by compute6.internal (MEProxy); Thu, 09 Nov 2023 06:25:15 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:cc:content-transfer-encoding :content-type:content-type:date:date:feedback-id:feedback-id :from:from:in-reply-to:in-reply-to:message-id:mime-version :reply-to:sender:subject:subject:to:to:x-me-proxy:x-me-proxy :x-me-sender:x-me-sender:x-sasl-enc; s=fm3; t=1699529115; x= 1699615515; bh=iuuIBkyx21Gnd9nI4TTPnzR2aCT+ZPw2poKCmjs8SHc=; b=b /mywPD6BRL7lf+fydrKC1p3C/UcT3rYJwB57QkXhgVZE90hTVr9rsAuqgmLi3lNl YSF+St37ygD/kH+I3aA8Xb29XQ6vONzLcsmsfKGZQ1k+Oit9c9M7W5cAbjNxUWHs 3zsqRde9N2HWssmNCTz6x5Pk8EF1avcR5mkNGjdriRk5VDc/hcgYlufJy155Pif2 bVo/+kyayutM3Yw7sEN0b9e/bJgsndbMZSckVEJ/iaivKBJ9oN6vFIq0+YpQv9KT amrAEjK68kvMs/oOeNkjG5QYtKAeMM4LSjIUeWKGmgl59Ht860uDhl/H3crVPmKB LbKzHouQkvRTR4oTaHhbA== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvkedruddvuddgvdeiucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne cujfgurhepfffhvfevuffkgggtugfgjgesthekredttddtjeenucfhrhhomheptehlvhgr rhhoucfjvghrrhgvrhgruceorghlvhhhvghrrhgvsegrlhhvhhdrnhhoqdhiphdrohhrgh eqnecuggftrfgrthhtvghrnhepvdektdffudfftdffffehfffhjeejhffgieeuueekjeek fffgudffhfduffffueevnecuffhomhgrihhnpegvnhhtvghrphhrihhsvggusgdrtghomh enucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhmpegrlhhv hhgvrhhrvgesrghlvhhhrdhnohdqihhprdhorhhg X-ME-Proxy: Feedback-ID: ia2694551:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA; Thu, 9 Nov 2023 06:25:14 -0500 (EST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=alvh.no-ip.org; s=schmee; t=1699529113; bh=Lvasq86y4hE4uwgXUlUfTXCVKgUepORKvPX7PWXdI7c=; h=Date:From:To:Cc:Subject:In-Reply-To:From; b=JpiLZC01ajCYchsyxzPARguResNTWQTFOlilu8WNXODRwRjlDhXzI3aoJ5mXhf0KL PTSrd7aGnv9atns/LRpwUh1JqDCFJVcCb9N7h6YoMonAdLugx4m7iEAkAjEPNm0yDf 9Ba8slNtNigKrIsNq3dBy6qTkvSemlnZH3fJyXCEIdpDANvZHkeMH1cDuezRpOzMpb D7X+0aotgjhMw+gB7UALfJdZ7C95lP/O7Y6MywEhTGaZxePNMICQK8zt7yQdHoqVcf 3hE9C2ockKFG77k54R3J+2mkGoMnnHjoB+/hjLn2eEw4w3OOPyIVrSMlBGt6cHFBkx Ask8TJekcJz9Q== Received: by perhan.alvh.no-ip.org (Postfix, from userid 1000) id 2C2A6C1; Thu, 9 Nov 2023 12:25:13 +0100 (CET) Date: Thu, 9 Nov 2023 12:25:13 +0100 From: Alvaro Herrera To: Ants Aasma Cc: "Andrey M. Borodin" , Dilip Kumar , PostgreSQL Hackers Subject: Re: SLRU optimization - configurable buffer pool and partitioning the SLRU lock Message-ID: <202311091125.uqjmb757b4kb@alvherre.pgsql> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk IMO the whole area of SLRU buffering is in horrible shape and many users are struggling with overall PG performance because of it. An improvement doesn't have to be perfect -- it just has to be much better than the current situation, which should be easy enough. We can continue to improve later, using more scalable algorithms or ones that allow us to raise the limits higher. The only point on which we do not have full consensus yet is the need to have one GUC per SLRU, and a lot of effort seems focused on trying to fix the problem without adding so many GUCs (for example, using shared buffers instead, or use a single "scaling" GUC). I think that hinders progress. Let's just add multiple GUCs, and users can leave most of them alone and only adjust the one with which they have a performance problems; it's not going to be the same one for everybody. -- Álvaro Herrera 48°01'N 7°57'E — https://www.EnterpriseDB.com/ "Sallah, I said NO camels! That's FIVE camels; can't you count?" (Indiana Jones)