Received: from localhost (unknown [200.46.208.211]) by mail.postgresql.org (Postfix) with ESMTP id 333C6632516 for ; Tue, 17 Mar 2009 01:17:37 -0300 (ADT) Received: from mail.postgresql.org ([200.46.204.86]) by localhost (mx1.hub.org [200.46.208.211]) (amavisd-maia, port 10024) with ESMTP id 66229-01 for ; Tue, 17 Mar 2009 01:17:30 -0300 (ADT) X-Greylist: from auto-whitelisted by SQLgrey-1.7.6 Received: from westnet.com (westnet.com [216.187.52.2]) by mail.postgresql.org (Postfix) with ESMTP id A24BC635167 for ; Tue, 17 Mar 2009 01:17:29 -0300 (ADT) Received: from westnet.com (localhost [127.0.0.1]) by westnet.com (8.14.0/8.14.0) with ESMTP id n2H4HPwf007216; Tue, 17 Mar 2009 00:17:25 -0400 (EDT) Received: from localhost (gsmith@localhost) by westnet.com (8.14.0/8.13.2/Submit) with ESMTP id n2H4HObv007213; Tue, 17 Mar 2009 00:17:24 -0400 (EDT) X-Authentication-Warning: westnet.com: gsmith owned process doing -bs Date: Tue, 17 Mar 2009 00:17:24 -0400 (EDT) From: Greg Smith X-X-Sender: gsmith@westnet.com To: Gregory Stark cc: "ml@bortal.de" , pgsql-performance@postgresql.org Subject: Re: Postgres benchmarking with pgbench In-Reply-To: <87ljr50zqp.fsf@oxford.xeocode.com> Message-ID: References: <49BE2E84.2040506@bortal.de> <87bps132t1.fsf@oxford.xeocode.com> <87ljr50zqp.fsf@oxford.xeocode.com> User-Agent: Alpine 2.01 (GSO 1184 2008-12-16) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed X-Virus-Scanned: Maia Mailguard 1.0.1 X-Spam-Status: No, hits=0 tagged_above=0 required=5 tests=none X-Spam-Level: X-Archive-Number: 200903/226 X-Sequence-Number: 33148 On Tue, 17 Mar 2009, Gregory Stark wrote: > I think pgbench is just not that great a model for real-world usage pgbench's default workload isn't a good model for anything. It wasn't a particularly real-world test when the TPC-B it's based on was created, and that was way back in 1990. And pgbench isn't even a good implementation of that spec (the rows are too narrow, comments about that in pgbench.c). At this point, the only good thing you can say about pgbench is that it's been a useful tool for comparing successive releases of PostgreSQL in a relatively fair way. Basically, it measures what pgbench measures, and that has only a loose relationship with what people want a database to do. -- * Greg Smith gsmith@gregsmith.com http://www.gregsmith.com Baltimore, MD