pg.ddx.io pgsql-performance@postgresql.org mailing list archive
help / color / mirror / Atom feedPerformance Baseline Script
6+ messages / 5 participants
[nested] [flat]
* Performance Baseline Script
@ 2003-02-18 19:48 Keith Bottner <kbottner@istation.com>
2003-02-18 20:43 ` Re: Performance Baseline Script Josh Berkus <josh@agliodbs.com>
0 siblings, 1 reply; 6+ messages in thread
From: Keith Bottner @ 2003-02-18 19:48 UTC (permalink / raw)
To: pgsql-performance
Does there currently exist any kind of script that can be run on
Postgres to conduct a complete feature coverage test with varying
dataset sizes to compare performance between functionality changes?
The interest of course is to get a baseline of performance and then to
see how manipulation of internal algorithms or vacuum frequency or WAL
logs being place on a separate physical disk affect the performance of
the various features with various dataset sizes.
If not, how many people would be interested in such a script being
written?
Keith Bottner
kbottner@istation.com
"Vegetarian - that's an old Indian word meaning 'lousy hunter.'" - Andy
Rooney
^ permalink raw reply [nested|flat] 6+ messages in thread
* Re: Performance Baseline Script
2003-02-18 19:48 Performance Baseline Script Keith Bottner <kbottner@istation.com>
@ 2003-02-18 20:43 ` Josh Berkus <josh@agliodbs.com>
2003-02-19 15:03 ` Re: Performance Baseline Script Tom Lane <tgl@sss.pgh.pa.us>
0 siblings, 1 reply; 6+ messages in thread
From: Josh Berkus @ 2003-02-18 20:43 UTC (permalink / raw)
To: kbottner@istation.com; pgsql-performance
Keith,
> Does there currently exist any kind of script that can be run on
> Postgres to conduct a complete feature coverage test with varying
> dataset sizes to compare performance between functionality changes?
No.
> If not, how many people would be interested in such a script being
> written?
Just about everyon on this list, as well as Advocacy and Hackers, to
judge by the current long-running thread on the topic, which has
meandered across several lists.
-Josh Berkus
^ permalink raw reply [nested|flat] 6+ messages in thread
* Re: Performance Baseline Script
2003-02-18 19:48 Performance Baseline Script Keith Bottner <kbottner@istation.com>
2003-02-18 20:43 ` Re: Performance Baseline Script Josh Berkus <josh@agliodbs.com>
@ 2003-02-19 15:03 ` Tom Lane <tgl@sss.pgh.pa.us>
2003-02-19 15:15 ` Re: Performance Baseline Script Justin Clift <justin@postgresql.org>
0 siblings, 1 reply; 6+ messages in thread
From: Tom Lane @ 2003-02-19 15:03 UTC (permalink / raw)
To: Josh Berkus <josh@agliodbs.com>; +Cc: kbottner@istation.com; pgsql-performance
"Josh Berkus" <josh@agliodbs.com> writes:
> Keith,
>> Does there currently exist any kind of script that can be run on
>> Postgres to conduct a complete feature coverage test with varying
>> dataset sizes to compare performance between functionality changes?
> No.
If you squint properly, OSDB (http://osdb.sourceforge.net/) might be
thought to do this, or at least be a starting point for it.
regards, tom lane
^ permalink raw reply [nested|flat] 6+ messages in thread
* Re: Performance Baseline Script
2003-02-18 19:48 Performance Baseline Script Keith Bottner <kbottner@istation.com>
2003-02-18 20:43 ` Re: Performance Baseline Script Josh Berkus <josh@agliodbs.com>
2003-02-19 15:03 ` Re: Performance Baseline Script Tom Lane <tgl@sss.pgh.pa.us>
@ 2003-02-19 15:15 ` Justin Clift <justin@postgresql.org>
2003-02-19 15:42 ` Re: Performance Baseline Script Andrew Sullivan <andrew@libertyrms.info>
0 siblings, 1 reply; 6+ messages in thread
From: Justin Clift @ 2003-02-19 15:15 UTC (permalink / raw)
To: Tom Lane <tgl@sss.pgh.pa.us>; +Cc: Josh Berkus <josh@agliodbs.com>; kbottner@istation.com; pgsql-performance
Tom Lane wrote:
> "Josh Berkus" <josh@agliodbs.com> writes:
>
>>Keith,
>>
>>>Does there currently exist any kind of script that can be run on
>>>Postgres to conduct a complete feature coverage test with varying
>>>dataset sizes to compare performance between functionality changes?
>
>>No.
>
> If you squint properly, OSDB (http://osdb.sourceforge.net/) might be
> thought to do this, or at least be a starting point for it.
As a side thought, just today found out that the TPC organisation
provides all kinds of code freely for building/running the TPC-x tests.
Didn't know that before.
Sure, we can't submit results yet, but we might at least be able to run
the tests and see if anything interesting turns up. People have talked
about the TPC tests before, but not sure if anyone has really looked at
making them runnable on PostgreSQL for everyone yet.
Regards and best wishes,
Justin Clift
> regards, tom lane
--
"My grandfather once told me that there are two kinds of people: those
who work and those who take the credit. He told me to try to be in the
first group; there was less competition there."
- Indira Gandhi
^ permalink raw reply [nested|flat] 6+ messages in thread
* Re: Performance Baseline Script
2003-02-18 19:48 Performance Baseline Script Keith Bottner <kbottner@istation.com>
2003-02-18 20:43 ` Re: Performance Baseline Script Josh Berkus <josh@agliodbs.com>
2003-02-19 15:03 ` Re: Performance Baseline Script Tom Lane <tgl@sss.pgh.pa.us>
2003-02-19 15:15 ` Re: Performance Baseline Script Justin Clift <justin@postgresql.org>
@ 2003-02-19 15:42 ` Andrew Sullivan <andrew@libertyrms.info>
2003-02-20 02:17 ` Re: Performance Baseline Script Justin Clift <justin@postgresql.org>
0 siblings, 1 reply; 6+ messages in thread
From: Andrew Sullivan @ 2003-02-19 15:42 UTC (permalink / raw)
To: pgsql-performance
On Thu, Feb 20, 2003 at 01:45:25AM +1030, Justin Clift wrote:
> As a side thought, just today found out that the TPC organisation
> provides all kinds of code freely for building/running the TPC-x tests.
Yes, but be careful what you mean there.
It is _not_ a TPC test unless it is run under tightly-controlled and
-audited conditions as specified by TPC. And that effectively means
you have to pay them. In other words, it's not a TPC test unless you
can get it published by them.
That doesn't mean you can't run a test "based on the documents
provided by the TPC for test definition _x_". Just make sure you
walk on the correct side of the intellectual property line, or you'll
be hearing from their lawyers.
A
--
----
Andrew Sullivan 204-4141 Yonge Street
Liberty RMS Toronto, Ontario Canada
<andrew@libertyrms.info> M2P 2A8
+1 416 646 3304 x110
^ permalink raw reply [nested|flat] 6+ messages in thread
* Re: Performance Baseline Script
2003-02-18 19:48 Performance Baseline Script Keith Bottner <kbottner@istation.com>
2003-02-18 20:43 ` Re: Performance Baseline Script Josh Berkus <josh@agliodbs.com>
2003-02-19 15:03 ` Re: Performance Baseline Script Tom Lane <tgl@sss.pgh.pa.us>
2003-02-19 15:15 ` Re: Performance Baseline Script Justin Clift <justin@postgresql.org>
2003-02-19 15:42 ` Re: Performance Baseline Script Andrew Sullivan <andrew@libertyrms.info>
@ 2003-02-20 02:17 ` Justin Clift <justin@postgresql.org>
0 siblings, 0 replies; 6+ messages in thread
From: Justin Clift @ 2003-02-20 02:17 UTC (permalink / raw)
To: Andrew Sullivan <andrew@libertyrms.info>; +Cc: pgsql-performance
Andrew Sullivan wrote:
> On Thu, Feb 20, 2003 at 01:45:25AM +1030, Justin Clift wrote:
>
>>As a side thought, just today found out that the TPC organisation
>>provides all kinds of code freely for building/running the TPC-x tests.
>
> Yes, but be careful what you mean there.
>
> It is _not_ a TPC test unless it is run under tightly-controlled and
> -audited conditions as specified by TPC. And that effectively means
> you have to pay them. In other words, it's not a TPC test unless you
> can get it published by them.
>
> That doesn't mean you can't run a test "based on the documents
> provided by the TPC for test definition _x_". Just make sure you
> walk on the correct side of the intellectual property line, or you'll
> be hearing from their lawyers.
Good point.
What I was thinking about was that we could likely get the "test suite"
of code that the TPC publishes and ensure that it works with PostgreSQL.
The reason I'm thinking of is that if any of the existing PostgreSQL
support companies (or an alliance of them), decided to become a member
of the TPC in order to submit results then the difficuly of entry would
be that bit lower, and there would be people around at that stage who'd
already gained good experience with the test suite(s).
:-)
Regards and best wishes,
Justin Clift
> A
--
"My grandfather once told me that there are two kinds of people: those
who work and those who take the credit. He told me to try to be in the
first group; there was less competition there."
- Indira Gandhi
^ permalink raw reply [nested|flat] 6+ messages in thread
end of thread, other threads:[~2003-02-20 02:17 UTC | newest]
Thread overview: 6+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2003-02-18 19:48 Performance Baseline Script Keith Bottner <kbottner@istation.com>
2003-02-18 20:43 ` Josh Berkus <josh@agliodbs.com>
2003-02-19 15:03 ` Tom Lane <tgl@sss.pgh.pa.us>
2003-02-19 15:15 ` Justin Clift <justin@postgresql.org>
2003-02-19 15:42 ` Andrew Sullivan <andrew@libertyrms.info>
2003-02-20 02:17 ` Justin Clift <justin@postgresql.org>
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox