X-Original-To: pgsql-performance@postgresql.org Received: from localhost (postgresql.org [64.49.215.8]) by postgresql.org (Postfix) with ESMTP id 760F5474E4F for ; Fri, 14 Feb 2003 01:04:35 -0500 (EST) Received: from sss.pgh.pa.us (unknown [192.204.191.242]) by postgresql.org (Postfix) with ESMTP id CF7C6474E42 for ; Fri, 14 Feb 2003 01:04:34 -0500 (EST) Received: from sss2.sss.pgh.pa.us (tgl@localhost [127.0.0.1]) by sss.pgh.pa.us (8.12.6/8.12.6) with ESMTP id h1E64Y5u004591; Fri, 14 Feb 2003 01:04:34 -0500 (EST) To: Kevin Brown Cc: pgsql-performance@postgresql.org Subject: Re: Tuning scenarios (was Changing the default configuration) In-reply-to: <20030214053124.GQ1833@filer> References: <303E00EBDD07B943924382E153890E5434A909@cuthbert.rcsinc.local> <26004.1044980414@sss.pgh.pa.us> <3E492E06.2030702@postgresql.org> <200302110918.48614.josh@agliodbs.com> <26582.1044984365@sss.pgh.pa.us> <3E493415.9090004@postgresql.org> <26850.1044985975@sss.pgh.pa.us> <20030214053124.GQ1833@filer> Comments: In-reply-to Kevin Brown message dated "Thu, 13 Feb 2003 21:31:24 -0800" Date: Fri, 14 Feb 2003 01:04:34 -0500 Message-ID: <4590.1045202674@sss.pgh.pa.us> From: Tom Lane X-Virus-Scanned: by AMaViS new-20020517 X-Archive-Number: 200302/75 X-Sequence-Number: 1131 Kevin Brown writes: > You don't have any real confidence in pgbench. Fair enough. What > *would* you have confidence in? Measurements on your actual application? In fairness to pgbench, most of its problems come from people running it at tiny scale factors, where it reduces to an exercise in how many angels can dance on the same pin (or, how many backends can contend to update the same row). And in that regime it runs into two or three different Postgres limitations that might or might not have any relevance to your real-world application --- dead-index-row references used to be the worst, but I think probably aren't anymore in 7.3. But those same limitations cause the results to be unstable from run to run, which is why I don't have a lot of faith in reports of pgbench numbers. You need to work quite hard to get reproducible numbers out of it. No, I don't have a better benchmark in my pocket :-( regards, tom lane