Message-ID: <4815F648.9050901@agliodbs.com>
Date: Mon, 28 Apr 2008 09:07:36 -0700
From: Josh Berkus <josh@agliodbs.com>
User-Agent: Thunderbird 2.0.0.12 (Macintosh/20080213)
MIME-Version: 1.0
To: Gregory Stark <stark@enterprisedb.com>
CC: Euler Taveira de Oliveira <euler@timbira.com>,
	Greg Smith <gsmith@gregsmith.com>,
	postgres performance list <pgsql-performance@postgresql.org>
Subject: Re: Benchmarks WAS: Sun Talks about MySQL
References: <480F8C2D.6010806@emproshunts.com>
	<4811D1DD.9030401@otg-nc.com>	<20080425130105.GA19447@crankycanuck.ca>
	<36e682920804250741p33d621f3gf35e6bdebe2e0531@mail.gmail.com>
	<20080425152053.GE19447@crankycanuck.ca>
	<Pine.GSO.4.64.0804251942060.28069@westnet.com>
	<481278E7.9030504@timbira.com>
	<87wsmlm90e.fsf@oxford.xeocode.com>	<4814BDB8.2030108@agliodbs.com>
	<877iei9w4r.fsf@oxford.xeocode.com>
In-Reply-To: <877iei9w4r.fsf@oxford.xeocode.com>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit

Greg,

> What I was referring to by "passing" TPC-E was the criteria for a conformant
> benchmark run. TPC-C has iirc, only two relevant criteria: "95th percentile
> response time < 5s" and "average response time < 95th percentile response
> time". You can pass those even if 1 transaction in 20 takes 10-20s which is
> more than enough to cover checkpoints and other random sources of inconsistent
> performance.

We can do this now.  I'm unhappy because we're at about 1/4 of Oracle 
performance, but we certainly pass -- even with 8.2.

--Josh