pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Jan Wieck <JanWieck@Yahoo.com>
To: Josh Berkus <josh@agliodbs.com>
Cc: pgsql-advocacy@postgresql.org
Cc: pgsql-performance@postgresql.org
Subject: Re: [PERFORM] MySQL vs PG TPC-H benchmarks
Date: Wed, 21 Apr 2004 15:38:47 -0400
Message-ID: <4086CDC7.5000204@Yahoo.com> (raw)
In-Reply-To: <200404211047.03808.josh@agliodbs.com>
References: <200404211031.31007.josh@agliodbs.com>
	<200404211047.03808.josh@agliodbs.com>

Josh Berkus wrote:

> Folks,
> 
> I've sent a polite e-mail to Mr. Gomez offering our help.  Please, nobody 
> flame him!
> 

Please keep in mind that the entire test has, other than a similar 
database schema and query types maybe, nothing to do with a TPC-H. I 
don't see any kind of SUT. Foreign key support on the DB level is not 
required by any of the TPC benchmarks. But the System Under Test, which 
is the combination of middleware application and database together with 
all computers and network components these parts are running on, must 
implement all the required semantics, like ACID properties, referential 
integrity &c. One could implement a TPC-H with flat files, it's just a 
major pain in the middleware.

A proper TPC benchmark implementation would for example be a complete 
PHP+DB application, where the user interaction is done by an emulated 
"browser" and what is measured is the http response times, not anything 
going on between PHP and the DB. Assuming that all requirements of the 
TPC specification are implemented by either using available DB features, 
or including appropriate workarounds in the PHP code, that would very 
well lead to something that can compare PHP+MySQL vs. PHP+PostgreSQL.

All TPC benchmarks I have seen are performed by timing such a system 
after a considerable rampup time, giving the DB system a chance to 
properly populate caches and so forth. Rebooting the machine just before 
the test is the wrong thing here and will especially kill any advanced 
cache algorithms like ARC.


Jan

-- 
#======================================================================#
# It's easier to get forgiveness for being wrong than for being right. #
# Let's break this rule - forgive me.                                  #
#================================================== JanWieck@Yahoo.com #




view thread (19+ messages)  latest in thread

Message-ID: <4086CDC7.5000204@Yahoo.com>
Permalink:  ../4086CDC7.5000204@Yahoo.com/
Also on:    postgresql.org/message-id/4086CDC7.5000204@Yahoo.com

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: JanWieck@Yahoo.com, josh@agliodbs.com, pgsql-advocacy@postgresql.org
  Subject: Re: [PERFORM] MySQL vs PG TPC-H benchmarks
  In-Reply-To: <4086CDC7.5000204@Yahoo.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox