X-Original-To: pgsql-performance-postgresql.org@localhost.postgresql.org Received: from localhost (unknown [200.46.204.144]) by svr1.postgresql.org (Postfix) with ESMTP id CD1E7329EEB for ; Fri, 15 Oct 2004 20:24:32 +0100 (BST) Received: from svr1.postgresql.org ([200.46.204.71]) by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024) with ESMTP id 35839-08 for ; Fri, 15 Oct 2004 19:24:25 +0000 (GMT) Received: from cmailg3.svr.pol.co.uk (cmailg3.svr.pol.co.uk [195.92.195.173]) by svr1.postgresql.org (Postfix) with ESMTP id 0C0C4329E4A for ; Fri, 15 Oct 2004 20:24:26 +0100 (BST) Received: from modem-3812.rhino.dialup.pol.co.uk ([62.137.110.228] helo=happyplace) by cmailg3.svr.pol.co.uk with smtp (Exim 4.14) id 1CIXga-0008Eq-2P; Fri, 15 Oct 2004 20:24:20 +0100 From: "Simon Riggs" To: "Bruce Momjian" , "Tom Lane" Cc: "Timothy D. Witham" , , , Subject: Re: [Testperf-general] Re: First set of OSDL Shared Memscalability results, some wierdness ... Date: Fri, 15 Oct 2004 20:42:39 +0100 Message-ID: MIME-Version: 1.0 Content-Type: text/plain; charset="US-ASCII" Content-Transfer-Encoding: 7bit X-Priority: 3 (Normal) X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook IMO, Build 9.0.2416 (9.0.2911.0) Importance: Normal In-Reply-To: <200410151657.i9FGvZQ13745@candle.pha.pa.us> X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2600.0000 X-Virus-Scanned: by amavisd-new at hub.org X-Spam-Status: No, hits=0.0 tagged_above=0.0 required=5.0 tests= X-Spam-Level: X-Archive-Number: 200410/230 X-Sequence-Number: 8706 > Bruce Momjian > Tom Lane wrote: > > > I've been thinking about implementing a scheme that helps you > decide how > > > big the shared_buffers SHOULD BE, by making the LRU list > bigger than the > > > cache itself, so you'd be able to see whether there is > beneficial effect in > > > increasing shared_buffers. > > > > ARC already keeps such a list --- couldn't you learn what you want to > > know from the existing data structure? It'd be fairly cool if we could > > put out warnings "you ought to increase shared_buffers" analogous to the > > existing facility for noting excessive checkpointing. First off, many thanks for taking the time to provide the real detail on the code. That gives us some much needed direction in interpreting the oprofile output. > > Agreed. ARC already keeps a list of buffers it had to push out recently > so if it needs them again soon it knows its sizing of recent/frequent > might be off (I think). Anyway, such a log report would be super-cool, > say if you pushed out a buffer and needed it very soon, and the ARC > buffers are already at their maximum for that buffer pool. > OK, I guess I hadn't realised we were half-way there. The "increase shared_buffers" warning would be useful, but it would be much cooler to have some guidance as to how big to set it, especially since this requires a restart of the server. What I had in mind was a way of keeping track of how the buffer cache hit ratio would look at various sizes of shared_buffers, for example 50%, 80%, 120%, 150%, 200% and 400% say. That way you'd stand a chance of plotting the curve and thereby assessing how much memory could be allocated. I've got a few ideas, but I need to check out the code first. I'll investigate both simple/complex options as an 8.1 feature. Best Regards, Simon Riggs