From: Luke Lonergan <llonergan@greenplum.com>
To: Joshua D. Drake <jd@commandprompt.com>
To: Patrick Welche <prlw1@newn.cam.ac.uk>
Cc: Mark Wong <markw@osdl.org>
Cc: pgsql-performance@postgresql.org
Cc: maryedie@osdl.org
Subject: Re: [PATCHES] COPY FROM performance improvements
Date: Fri, 22 Jul 2005 12:28:43 -0700
Message-ID: <BF0696FB.9795%llonergan@greenplum.com> (raw)
In-Reply-To: <42E128BD.2000104@commandprompt.com>
Joshua,
On 7/22/05 10:11 AM, "Joshua D. Drake" <jd@commandprompt.com> wrote:
> The database server is a PE (Power Edge) 6600
>
> Database Server IO:
>
> [root@master root]# /sbin/hdparm -tT /dev/sda
>
> /dev/sda:
> Timing buffer-cache reads: 1888 MB in 2.00 seconds = 944.00 MB/sec
> Timing buffered disk reads: 32 MB in 3.06 seconds = 10.46 MB/sec
>
> Second Database Server IO:
>
> [root@pq-slave root]# /sbin/hdparm -tT /dev/sda
>
> /dev/sda:
> Timing buffer-cache reads: 1816 MB in 2.00 seconds = 908.00 MB/sec
> Timing buffered disk reads: 26 MB in 3.11 seconds = 8.36 MB/sec
> [root@pq-slave root]#
Can you post the "time dd if=/dev/zero of=bigfile bs=8k count=500000"
results? Also do the reverse (read the file) with "time dd if=bigfile
of=/dev/null bs=8k".
I think you are observing what we've known for a while, hardware RAID is
horribly slow. We've not found a hardware RAID adapter of this class yet
that shows reasonable read or write performance. The Adaptec 2400R or the
LSI or others have terrible internal I/O compared to raw SCSI with software
RAID, and even the CPU usage is higher on these cards while doing slower I/O
than linux SW RAID.
Notably - we've found that the 3Ware RAID controller does a better job than
the low end SCSI RAID at HW RAID support, and also exports JBOD at high
speeds. If you export JBOD on the low end SCSI RAID adapters, the
performance is also very poor, though generally faster than using HW RAID.
- Luke
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-performance@postgresql.org
Cc: llonergan@greenplum.com, jd@commandprompt.com, prlw1@newn.cam.ac.uk, markw@osdl.org, maryedie@osdl.org
Subject: Re: [PATCHES] COPY FROM performance improvements
In-Reply-To: <BF0696FB.9795%llonergan@greenplum.com>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox