X-Original-To: pgsql-performance-postgresql.org@localhost.postgresql.org Received: from localhost (unknown [200.46.204.144]) by svr1.postgresql.org (Postfix) with ESMTP id BC161537F0 for ; Fri, 15 Apr 2005 18:23:42 -0300 (ADT) Received: from svr1.postgresql.org ([200.46.204.71]) by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024) with ESMTP id 22964-01 for ; Fri, 15 Apr 2005 21:23:32 +0000 (GMT) Received: from sss.pgh.pa.us (sss.pgh.pa.us [66.207.139.130]) by svr1.postgresql.org (Postfix) with ESMTP id 8CBF2539C6 for ; Fri, 15 Apr 2005 18:23:32 -0300 (ADT) Received: from sss2.sss.pgh.pa.us (tgl@localhost [127.0.0.1]) by sss.pgh.pa.us (8.13.1/8.13.1) with ESMTP id j3FLNYwd006866; Fri, 15 Apr 2005 17:23:34 -0400 (EDT) To: "Thomas F.O'Connell" Cc: PgSQL - Performance Subject: Re: pgbench Comparison of 7.4.7 to 8.0.2 In-reply-to: <2784476415a96bb0912ebca41edb3d84@sitening.com> References: <2784476415a96bb0912ebca41edb3d84@sitening.com> Comments: In-reply-to "Thomas F.O'Connell" message dated "Fri, 15 Apr 2005 16:02:29 -0500" Date: Fri, 15 Apr 2005 17:23:34 -0400 Message-ID: <6865.1113600214@sss.pgh.pa.us> From: Tom Lane X-Virus-Scanned: by amavisd-new at hub.org X-Spam-Status: No, hits=0.006 tagged_above=0 required=5 tests=AWL X-Spam-Level: X-Archive-Number: 200504/367 X-Sequence-Number: 11764 "Thomas F.O'Connell" writes: > http://www.sitening.com/pgbench.html You need to run *many* more transactions than that to get pgbench numbers that aren't mostly noise. In my experience 1000 transactions per client is a rock-bottom minimum to get repeatable numbers; 10000 per is better. Also, in any run where #clients >= scaling factor, what you're measuring is primarily contention to update the "branches" rows. Which is not necessarily a bad thing to check, but it's generally not the most interesting performance domain (if your app is like that you need to redesign the app...) > To me, it looks like basic transactional performance is modestly > improved at 8.0 across a variety of metrics. That's what I would expect --- we usually do some performance work in every release cycle, but there was not a huge amount of it for 8.0. However, these numbers don't prove much either way. regards, tom lane