From: Mark Wong <markw@osdl.org>
To: Luke Lonergan <llonergan@greenplum.com>
Cc: Andrew Dunstan <andrew@dunslane.net>
Cc: Alvaro Herrera <alvherre@surnet.cl>
Cc: Bruce Momjian <pgman@candle.pha.pa.us>
Cc: Alon Goldshuv <agoldshuv@greenplum.com>
Cc: pgsql-patches@postgresql.org
Cc: maryedie@osdl.org
Subject: Re: COPY FROM performance improvements
Date: Thu, 21 Jul 2005 14:55:07 -0700
Message-ID: <200507212154.j6LLsdjA002847@smtp.osdl.org> (raw)
In-Reply-To: <BEE623DE.7F0A%llonergan@greenplum.com>
References: <42C05F88.7000105@dunslane.net>
<BEE623DE.7F0A%llonergan@greenplum.com>
I just ran through a few tests with the v14 patch against 100GB of data
from dbt3 and found a 30% improvement; 3.6 hours vs 5.3 hours. Just to
give a few details, I only loaded data and started a COPY in parallel
for each the data files:
http://www.testing.osdl.org/projects/dbt3testing/results/fast_copy/
Here's a visual of my disk layout, for those familiar with the database schema:
http://www.testing.osdl.org/projects/dbt3testing/results/fast_copy/layout-dev4-010-dbt3.html
I have 6 arrays of fourteen 15k rpm drives in a split-bus configuration
attached to a 4-way itanium2 via 6 compaq smartarray pci-x controllers.
Let me know if you have any questions.
Mark
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-performance@postgresql.org
Cc: markw@osdl.org, llonergan@greenplum.com, andrew@dunslane.net, alvherre@surnet.cl, pgman@candle.pha.pa.us, agoldshuv@greenplum.com, pgsql-patches@postgresql.org, maryedie@osdl.org
Subject: Re: COPY FROM performance improvements
In-Reply-To: <200507212154.j6LLsdjA002847@smtp.osdl.org>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox