pg.ddx.io pgsql-performance@postgresql.org mailing list archive
help / color / mirror / Atom feedOSDL Database Test Suite 3 is available on PostgreSQL
6+ messages / 5 participants
[nested] [flat]
* OSDL Database Test Suite 3 is available on PostgreSQL
@ 2003-08-01 18:04 Jenny Zhang <jenny@osdl.org>
2003-08-01 18:57 ` Re: [PERFORM] OSDL Database Test Suite 3 is available on PostgreSQL Josh Berkus <josh@agliodbs.com>
2003-08-04 13:33 ` Re: [PERFORM] OSDL Database Test Suite 3 is available on PostgreSQL Manfred Koizar <mkoi-pg@aon.at>
2003-08-04 16:39 ` Re: [PERFORM] OSDL Database Test Suite 3 is available on PostgreSQL Shridhar Daithankar <shridhar_daithankar@persistent.co.in>
0 siblings, 3 replies; 6+ messages in thread
From: Jenny Zhang @ 2003-08-01 18:04 UTC (permalink / raw)
To: pgsql-performance; pgsql-general@postgresql.org; +Cc: osdldbt-general@lists.sourceforge.net
OSDL has ported OSDL Database Test Suite 3(OSDL-DBT3) to PostgreSQL.
It drives the database with an ad-hoc decision support workload. It
helps database developers and users to identify database performance
issues.
OSDL-DBT3 is derived from TPC-H benchmark. TPC-H is an ad-hoc decision
support benchmark. It has 22 complicated queries doing a lot of
table/index scanning, sorting and grouping by. Details about TPC-H can
be found at: http://www.tpc.org/tpch/
Though OSDL-DBT3 is based on TPC-H, it deviates from TPC-H
significantly. It skipped many of the requirements for audit purpose,
as well as added flexibility. OSDL-DBT3 performance test results are
not comparable to TPC-H results.
OSDL-DBT3 tarball can be downloaded from:
http://sourceforge.net/projects/osdldbt/
The source can be downloaded from source forge cvs tree and osdl bk tree
http://cvs.sourceforge.net/cgi-bin/viewcvs.cgi/osdldbt/dbt3/
bk://developer.osdl.org/dbt3
OSDL-DBT3 is also implemented on OSDL Scalable Test Platform(STP). The
platform provides a framework where users run a set of performance and
scalability tests on various hardware platforms. Currently, OSDL-DBT3
is running against PostgreSQL 7.3.3 only. We plan to improve it so that
it can run against PostgreSQL patches. To find more information about
STP, visit: http://www.osdl.org/stp/.
A sample OSDL-DBT3 test result report can be found at:
http://khack.osdl.org/stp/276912/
Your comments are welcome,
Regards,
Jenny
--
Jenny Zhang
Open Source Development Lab Inc
12725 SW Millikan Way
Suite 400
Beaverton, OR 97005
(503)626-2455 ext 31
^ permalink raw reply [nested|flat] 6+ messages in thread
* Re: [PERFORM] OSDL Database Test Suite 3 is available on PostgreSQL
2003-08-01 18:04 OSDL Database Test Suite 3 is available on PostgreSQL Jenny Zhang <jenny@osdl.org>
@ 2003-08-01 18:57 ` Josh Berkus <josh@agliodbs.com>
2 siblings, 0 replies; 6+ messages in thread
From: Josh Berkus @ 2003-08-01 18:57 UTC (permalink / raw)
To: Jenny Zhang <jenny@osdl.org>; pgsql-performance; pgsql-general@postgresql.org; +Cc: osdldbt-general@lists.sourceforge.net
Jenny,
> OSDL has ported OSDL Database Test Suite 3(OSDL-DBT3) to PostgreSQL.
> It drives the database with an ad-hoc decision support workload. It
> helps database developers and users to identify database performance
> issues.
Way, way, cool! We've been waiting for something like this eagerly. I
really look forward to trying it out.
Further, OSDL-DBT3 can hopefully serve as the kernel of our internal
performance option testing suite. We'll evaluate very soon.
Thanks so much for your hard work!
--
Josh Berkus
PostgreSQL Core Team
San Francisco
^ permalink raw reply [nested|flat] 6+ messages in thread
* Re: [PERFORM] OSDL Database Test Suite 3 is available on PostgreSQL
2003-08-01 18:04 OSDL Database Test Suite 3 is available on PostgreSQL Jenny Zhang <jenny@osdl.org>
@ 2003-08-04 13:33 ` Manfred Koizar <mkoi-pg@aon.at>
2003-08-04 16:07 ` Re: [PERFORM] OSDL Database Test Suite 3 is available on PostgreSQL scott.marlowe <scott.marlowe@ihs.com>
2003-08-04 16:09 ` Re: [PERFORM] OSDL Database Test Suite 3 is available on PostgreSQL scott.marlowe <scott.marlowe@ihs.com>
2 siblings, 2 replies; 6+ messages in thread
From: Manfred Koizar @ 2003-08-04 13:33 UTC (permalink / raw)
To: Jenny Zhang <jenny@osdl.org>; +Cc: pgsql-performance; pgsql-general@postgresql.org; osdldbt-general@lists.sourceforge.net
On 01 Aug 2003 11:04:10 -0700, Jenny Zhang <jenny@osdl.org> wrote:
>A sample OSDL-DBT3 test result report can be found at:
>http://khack.osdl.org/stp/276912/
>
>Your comments are welcome,
| effective_cache_size | 1000
With 4GB of memory this is definitely too low and *can* (note that I
don't say *must*) lead the planner to wrong decisions.
| shared_buffers | 15200
... looks reasonable. Did you test with other values?
| sort_mem | 524288
This is a bit high, IMHO, but might be ok given that DBT3 is not run
with many concurrent sessions (right?).
http://khack.osdl.org/stp/276912/results/plot/vmstat_swap.png shows
some swapping activity towards the end of the run which could be
caused by a too high sort_mem setting.
Servus
Manfred
^ permalink raw reply [nested|flat] 6+ messages in thread
* Re: [PERFORM] OSDL Database Test Suite 3 is available on PostgreSQL
2003-08-01 18:04 OSDL Database Test Suite 3 is available on PostgreSQL Jenny Zhang <jenny@osdl.org>
2003-08-04 13:33 ` Re: [PERFORM] OSDL Database Test Suite 3 is available on PostgreSQL Manfred Koizar <mkoi-pg@aon.at>
@ 2003-08-04 16:07 ` scott.marlowe <scott.marlowe@ihs.com>
1 sibling, 0 replies; 6+ messages in thread
From: scott.marlowe @ 2003-08-04 16:07 UTC (permalink / raw)
To: Manfred Koizar <mkoi-pg@aon.at>; +Cc: Jenny Zhang <jenny@osdl.org>; pgsql-performance; pgsql-general@postgresql.org; osdldbt-general@lists.sourceforge.net
On Mon, 4 Aug 2003, Manfred Koizar wrote:
> On 01 Aug 2003 11:04:10 -0700, Jenny Zhang <jenny@osdl.org> wrote:
> >A sample OSDL-DBT3 test result report can be found at:
> >http://khack.osdl.org/stp/276912/
> >
> >Your comments are welcome,
>
> | effective_cache_size | 1000
>
> With 4GB of memory this is definitely too low and *can* (note that I
> don't say *must*) lead the planner to wrong decisions.
>
> | shared_buffers | 15200
>
> ... looks reasonable. Did you test with other values?
>
> | sort_mem | 524288
>
> This is a bit high, IMHO, but might be ok given that DBT3 is not run
> with many concurrent sessions (right?).
> http://khack.osdl.org/stp/276912/results/plot/vmstat_swap.png shows
> some swapping activity towards the end of the run which could be
> caused by a too high sort_mem setting.
And, as always, don't forget to set effect_cache_size.
^ permalink raw reply [nested|flat] 6+ messages in thread
* Re: [PERFORM] OSDL Database Test Suite 3 is available on PostgreSQL
2003-08-01 18:04 OSDL Database Test Suite 3 is available on PostgreSQL Jenny Zhang <jenny@osdl.org>
2003-08-04 13:33 ` Re: [PERFORM] OSDL Database Test Suite 3 is available on PostgreSQL Manfred Koizar <mkoi-pg@aon.at>
@ 2003-08-04 16:09 ` scott.marlowe <scott.marlowe@ihs.com>
1 sibling, 0 replies; 6+ messages in thread
From: scott.marlowe @ 2003-08-04 16:09 UTC (permalink / raw)
To: Manfred Koizar <mkoi-pg@aon.at>; +Cc: Jenny Zhang <jenny@osdl.org>; pgsql-performance; pgsql-general@postgresql.org; osdldbt-general@lists.sourceforge.net
On Mon, 4 Aug 2003, Manfred Koizar wrote:
> On 01 Aug 2003 11:04:10 -0700, Jenny Zhang <jenny@osdl.org> wrote:
> >A sample OSDL-DBT3 test result report can be found at:
> >http://khack.osdl.org/stp/276912/
> >
> >Your comments are welcome,
>
> | effective_cache_size | 1000
>
> With 4GB of memory this is definitely too low and *can* (note that I
> don't say *must*) lead the planner to wrong decisions.
>
> | shared_buffers | 15200
>
> ... looks reasonable. Did you test with other values?
>
> | sort_mem | 524288
>
> This is a bit high, IMHO, but might be ok given that DBT3 is not run
> with many concurrent sessions (right?).
> http://khack.osdl.org/stp/276912/results/plot/vmstat_swap.png shows
> some swapping activity towards the end of the run which could be
> caused by a too high sort_mem setting.
Sorry, my last email shot off out of the gun before it was completed...
To repeat: Don't forget to set effective_cache_size the same way as
shared buffers (i.e. it's in 8k blocks for most systems.) If you have a
machine with 4 gig ram, and 3 gigs is available as disk cache, then
divide out 3 gigs by 8k to get the right number. My quick calculation
shows that being about 393216 blocks.
^ permalink raw reply [nested|flat] 6+ messages in thread
* Re: [PERFORM] OSDL Database Test Suite 3 is available on PostgreSQL
2003-08-01 18:04 OSDL Database Test Suite 3 is available on PostgreSQL Jenny Zhang <jenny@osdl.org>
@ 2003-08-04 16:39 ` Shridhar Daithankar <shridhar_daithankar@persistent.co.in>
2 siblings, 0 replies; 6+ messages in thread
From: Shridhar Daithankar @ 2003-08-04 16:39 UTC (permalink / raw)
To: pgsql-performance; pgsql-general@postgresql.org; osdldbt-general@lists.sourceforge.net
On 4 Aug 2003 at 15:33, Manfred Koizar wrote:
> On 01 Aug 2003 11:04:10 -0700, Jenny Zhang <jenny@osdl.org> wrote:
> >A sample OSDL-DBT3 test result report can be found at:
> >http://khack.osdl.org/stp/276912/
> >
> >Your comments are welcome,
I could not get postgresql .conf so I will combine the comments.
1. Effective cache size, already mentioned
2. Sort memory already mentioned.
3. Was WAL put on different drive?
4. Can you try with autovacuum daemon and 7.4beta when it comes out..
5. What was the file system? Ext2/Ext3/reiser/XFS?
<Scratching head>
Is there any comparison available for other databases.. Could be interesting to
see..:-)
</Scratching head>
Thanks for the good work. I understand it must have been quite an effort to run
it..
Keep it up..
Bye
Shridhar
--
Fourth Law of Revision: It is usually impractical to worry beforehand about
interferences -- if you have none, someone will make one for you.
^ permalink raw reply [nested|flat] 6+ messages in thread
end of thread, other threads:[~2003-08-04 16:39 UTC | newest]
Thread overview: 6+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2003-08-01 18:04 OSDL Database Test Suite 3 is available on PostgreSQL Jenny Zhang <jenny@osdl.org>
2003-08-01 18:57 ` Josh Berkus <josh@agliodbs.com>
2003-08-04 13:33 ` Manfred Koizar <mkoi-pg@aon.at>
2003-08-04 16:07 ` scott.marlowe <scott.marlowe@ihs.com>
2003-08-04 16:09 ` scott.marlowe <scott.marlowe@ihs.com>
2003-08-04 16:39 ` Shridhar Daithankar <shridhar_daithankar@persistent.co.in>
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox