Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1ZZ1cW-0002Dk-Vo for pgsql-hackers@arkaria.postgresql.org; Mon, 07 Sep 2015 18:58:25 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.84) (envelope-from ) id 1ZZ1cW-0000dW-1g for pgsql-hackers@arkaria.postgresql.org; Mon, 07 Sep 2015 18:58:24 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84) (envelope-from ) id 1ZZ1bA-0004y8-US for pgsql-hackers@postgresql.org; Mon, 07 Sep 2015 18:57:00 +0000 Received: from smtp-auth.no-ip.com ([8.23.224.61] helo=out.smtp-auth.no-ip.com) by magus.postgresql.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.84) (envelope-from ) id 1ZZ1b1-0001OU-3c for pgsql-hackers@postgresql.org; Mon, 07 Sep 2015 18:57:00 +0000 X-No-IP: alvh.no-ip.org@noip-smtp X-Report-Spam-To: abuse@no-ip.com Received: from alvin.alvh.no-ip.org (unknown [200.104.169.63]) (Authenticated sender: alvh.no-ip.org@noip-smtp) by smtp-auth.no-ip.com (Postfix) with ESMTPA id A86E4400425; Mon, 7 Sep 2015 11:56:42 -0700 (PDT) Received: by alvin.alvh.no-ip.org (Postfix, from userid 1000) id D4943F2D; Mon, 7 Sep 2015 15:56:39 -0300 (CLT) Date: Mon, 7 Sep 2015 15:56:39 -0300 From: Alvaro Herrera To: Andres Freund Cc: Amit Kapila , pgsql-hackers Subject: Re: Speed up Clog Access by increasing CLOG buffers Message-ID: <20150907185639.GQ2912@alvherre.pgsql> References: <20150903114137.GE27649@awork2.anarazel.de> <20150907133410.GO2912@alvherre.pgsql> <20150907164908.GB5084@alap3.anarazel.de> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <20150907164908.GB5084@alap3.anarazel.de> User-Agent: Mutt/1.5.23 (2014-03-12) X-Pg-Spam-Score: -2.4 (--) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-hackers Precedence: bulk Sender: pgsql-hackers-owner@postgresql.org Andres Freund wrote: > On 2015-09-07 10:34:10 -0300, Alvaro Herrera wrote: > > I wonder if it would make sense to explore an idea that has been floated > > for years now -- to have pg_clog pages be allocated as part of shared > > buffers rather than have their own separate pool. That way, no separate > > hardcoded allocation limit is needed. It's probably pretty tricky to > > implement, though :-( > > I still think that'd be a good plan, especially as it'd also let us use > a lot of related infrastructure. I doubt we could just use the standard > cache replacement mechanism though - it's not particularly efficient > either... I also have my doubts that a hash table lookup at every clog > lookup is going to be ok performancewise. Yeah. I guess we'd have to mark buffers as unusable for regular pages ("somehow"), and have a separate lookup mechanism. As I said, it is likely to be tricky. -- Álvaro Herrera http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Remote DBA, Training & Services -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers