From: Alan Stange <stange@rentec.com>
To: Luke Lonergan <llonergan@greenplum.com>
Cc: Dave Cramer <pg@fastcrypt.com>
Cc: Greg Stark <gsstark@mit.edu>
Cc: Joshua Marsh <icub3d@gmail.com>
Cc: pgsql-performance@postgresql.org
Subject: Re: Hardware/OS recommendations for large databases (
Date: Fri, 18 Nov 2005 12:31:33 -0500
Message-ID: <437E0FF5.5090203@rentec.com> (raw)
In-Reply-To: <BFA33EAC.1404E%llonergan@greenplum.com>
References: <BFA33EAC.1404E%llonergan@greenplum.com>
Luke Lonergan wrote:
> Alan,
>
> On 11/18/05 8:13 AM, "Alan Stange" <stange@rentec.com> wrote:
>
> I told you in my initial post that I was observing numbers in
> excess of
> what you claiming, but you seemed to think I didn't know how to
> measure
> an IO rate.
>
> Prove me wrong, post your data.
>
> I should note too that our system uses about 20% of a single cpu when
> performing a table scan at >100MB/s of IO. I think you claimed the
> system would be cpu bound at this low IO rate.
>
>
> See above.
Here's the output from one iteration of iostat -k 60 while the box is
doing a select count(1) on a 238GB table.
avg-cpu: %user %nice %sys %iowait %idle
0.99 0.00 17.97 32.40 48.64
Device: tps kB_read/s kB_wrtn/s kB_read kB_wrtn
sdd 345.95 130732.53 0.00 7843952 0
We're reading 130MB/s for a full minute. About 20% of a single cpu was
being used. The remainder being idle.
We've done nothing fancy and achieved results you claim shouldn't be
possible. This is a system that was re-installed yesterday, no tuning
was done to the file systems, kernel or storage array.
What am I doing wrong?
9 years ago I co-designed a petabyte data store with a goal of 1GB/s IO
(for a DOE lab). And now I don't know what I'm doing,
Cheers,
-- Alan
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-performance@postgresql.org
Cc: stange@rentec.com, llonergan@greenplum.com, pg@fastcrypt.com, gsstark@mit.edu, icub3d@gmail.com
Subject: Re: Hardware/OS recommendations for large databases (
In-Reply-To: <437E0FF5.5090203@rentec.com>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox