From: Jim C. Nasby <jnasby@pervasive.com>
To: Luke Lonergan <llonergan@greenplum.com>
Cc: Mike Biamonte <mike@dbeat.com>
Cc: pgsql-performance@postgresql.org
Subject: Re: Huge Data sets, simple queries
Date: Mon, 30 Jan 2006 14:25:24 -0600
Message-ID: <20060130202524.GB3920@pervasive.com> (raw)
In-Reply-To: <C0001F60.1B354%llonergan@greenplum.com>
References: <007101c623a9$82207c10$0200a8c0@videobox>
<C0001F60.1B354%llonergan@greenplum.com>
On Fri, Jan 27, 2006 at 07:05:04PM -0800, Luke Lonergan wrote:
> Sounds like you are running into the limits of your disk subsystem. You are
> scanning all of the data in the transactions table, so you will be limited
> by the disk bandwidth you have ? and using RAID-10, you should divide the
> number of disk drives by 2 and multiply by their indiividual bandwidth
> (around 60MB/s) and that?s what you can expect in terms of performance. So,
> if you have 8 drives, you should expect to get 4 x 60 MB/s = 240 MB/s in
> bandwidth. That means that if you are dealing with 24,000 MB of data in the
> ?transactions? table, then you will scan it in 100 seconds.
Why divide by 2? A good raid controller should be able to send read
requests to both drives out of the mirrored set to fully utilize the
bandwidth. Of course, that probably won't come into play unless the OS
decides that it's going to read-ahead fairly large chunks of the table
at a time...
Also, some vmstat output would certainly help clarify where the
bottleneck is...
--
Jim C. Nasby, Sr. Engineering Consultant jnasby@pervasive.com
Pervasive Software http://pervasive.com work: 512-231-6117
vcard: http://jim.nasby.net/pervasive.vcf cell: 512-569-9461
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-performance@postgresql.org
Cc: jnasby@pervasive.com, llonergan@greenplum.com, mike@dbeat.com
Subject: Re: Huge Data sets, simple queries
In-Reply-To: <20060130202524.GB3920@pervasive.com>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox