From: Luke Lonergan <llonergan@greenplum.com>
To: Jim C. Nasby <jnasby@pervasive.com>
Cc: Mike Biamonte <mike@dbeat.com>
Cc: pgsql-performance@postgresql.org
Subject: Re: Huge Data sets, simple queries
Date: Tue, 31 Jan 2006 14:52:57 -0800
Message-ID: <C0052A49.1B62D%llonergan@greenplum.com> (raw)
In-Reply-To: <20060131192145.GU95850@pervasive.com>
Jim,
On 1/31/06 11:21 AM, "Jim C. Nasby" <jnasby@pervasive.com> wrote:
> (BTW, I did some testing that seems to confirm this)
>
> Why couldn't you double the bandwidth? If you're doing a largish read
> you should be able to do something like have drive a read the first
> track, drive b the second, etc. Of course that means that the controller
> or OS would have to be able to stitch things back together.
It's because your alternating reads are skipping in chunks across the
platter. Disks work at their max internal rate when reading sequential
data, and the cache is often built to buffer a track-at-a-time, so
alternating pieces that are not contiguous has the effect of halving the max
internal sustained bandwidth of each drive - the total is equal to one
drive's sustained internal bandwidth.
This works differently for RAID0, where the chunks are allocated to each
drive and laid down contiguously on each, so that when they're read back,
each drive runs at it's sustained sequential throughput.
The alternating technique in mirroring might improve rotational latency for
random seeking - a trick that Tandem exploited, but it won't improve
bandwidth.
> As for software raid, I'm wondering how well that works if you can't use
> a BBU to allow write caching/re-ordering...
Works great with standard OS write caching.
- Luke
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-performance@postgresql.org
Cc: llonergan@greenplum.com, jnasby@pervasive.com, mike@dbeat.com
Subject: Re: Huge Data sets, simple queries
In-Reply-To: <C0052A49.1B62D%llonergan@greenplum.com>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox