From: Luke Lonergan <llonergan@greenplum.com>
To: Mark Wong <markw@osdl.org>
Cc: Andrew Dunstan <andrew@dunslane.net>
Cc: Alvaro Herrera <alvherre@surnet.cl>
Cc: Bruce Momjian <pgman@candle.pha.pa.us>
Cc: Alon Goldshuv <agoldshuv@greenplum.com>
Cc: pgsql-performance@postgresql.org
Cc: maryedie@osdl.org
Subject: Re: [PATCHES] COPY FROM performance improvements
Date: Fri, 22 Jul 2005 21:09:10 -0700
Message-ID: <BF0710F6.97DE%llonergan@greenplum.com> (raw)
In-Reply-To: <200507221946.j6MJkljA024095@smtp.osdl.org>
Mark,
On 7/22/05 12:47 PM, "Mark Wong" <markw@osdl.org> wrote:
> On a single spindle:
>
> $ time dd if=/dev/zero of=bigfile bs=8k count=2000000
> 2000000+0 records in
> 2000000+0 records out
>
> real 2m8.569s
> user 0m0.725s
> sys 0m19.633s
This is super fast! 124MB/s seems too fast for true write performance on a
single spindle.
> But here are some number for my 12-disk lvm2 striped volume.
So, software striping on how many controllers?
> $ time dd if=/dev/zero of=bigfile3 bs=8k count=4000000
> 4000000+0 records in
> 4000000+0 records out
>
> real 1m17.059s
> user 0m1.479s
> sys 0m41.293s
Again - super fast at 416MB/s. How many controllers?
When we had our problems with the cciss driver and the smartarray 5i/6
controllers, we found the only way to get any performance out of them was to
run them in JBOD mode and software stripe. However, when we did so the CPU
usage skyrocketed and the performance of simple SCSI adapters was 50% faster
with less CPU consumption. These numbers show 100*(42.8/67) = 64% CPU
consumption, I'd expect less with 2 simple U320 SCSI controllers.
- Luke
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-performance@postgresql.org
Cc: llonergan@greenplum.com, markw@osdl.org, andrew@dunslane.net, alvherre@surnet.cl, pgman@candle.pha.pa.us, agoldshuv@greenplum.com, maryedie@osdl.org
Subject: Re: [PATCHES] COPY FROM performance improvements
In-Reply-To: <BF0710F6.97DE%llonergan@greenplum.com>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox