Date: Tue, 9 Sep 2008 11:51:13 -0400
From: Andrew Sullivan <ajs@commandprompt.com>
To: pgsql-general@postgresql.org
Subject: Re: PostgreSQL TPC-H test result?
Message-ID: <20080909155113.GM59092@commandprompt.com>
Mail-Followup-To: Andrew Sullivan <ajs@commandprompt.com>,
	pgsql-general@postgresql.org
References: <BLU139-DS5AB90A6E11E3F439F0006CD540@phx.gbl>
	<20080909123947.GA59092@commandprompt.com>
	<BLU139-DS28D9D90A25BD2AD8CDEF0CD540@phx.gbl>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <BLU139-DS28D9D90A25BD2AD8CDEF0CD540@phx.gbl>
User-Agent: Mutt/1.5.17 (2007-11-01)

On Tue, Sep 09, 2008 at 10:06:01PM +0800, Amber wrote:
> Yes, we don't care about the performance results, but we do care about the point that PostgreSQL can't give the correct results of TPC-H queries.
> 

I have never heard a reputable source claim this.  I have grave doubts
about their claim: they don't specify what implementation of TPC-H
they use.  They don't actually have the right, AIUI, to claim they
tested under TPC-H, since their results aren't listed anywhere on
http://www.tpc.org/tpch/results/tpch_results.asp?orderby=dbms.  It
could well be that they made up something that kinda does something
like TPC-H, tailored to how their database works, and then claimed
others can't do the job.  That's nice marketing material, but it's not
a meaningful test result.

Without access to the methodology, you should be wary of accepting any
of the conclusions.

There is, I understand, an implementation of something like TPC-H that
you could use to test it yourself.  http://osdldbt.sourceforge.net/.
DBT-3 is supposed to be that workload.  Please note that the license
does not allow you to publish competitive tests for marketing
reasons.  but you could see for yourself whether the claim is true
that way.

A
-- 
Andrew Sullivan
ajs@commandprompt.com
+1 503 667 4564 x104
http://www.commandprompt.com/