From: Greg Spiegelberg <gspiegelberg@cranel.com>
To: scott.marlowe <scott.marlowe@ihs.com>
Cc: Iain <iain@mst.co.jp>
Cc: Shane Wright <me@shanewright.co.uk>
Cc: pgsql-admin@postgresql.org
Subject: Re: hanging for 30sec when checkpointing
Date: Wed, 04 Feb 2004 13:09:35 -0500
Message-ID: <4021355F.8060304@cranel.com> (raw)
In-Reply-To: <Pine.LNX.4.33.0402040929220.28468-100000@css120.ihs.com>
References: <Pine.LNX.4.33.0402040929220.28468-100000@css120.ihs.com>
scott.marlowe wrote:
> On Wed, 4 Feb 2004, Iain wrote:
>
>>If I understand checkpoints correctly, data that is already written to the
>>WAL (and flushed to disk) is being written to the DB (flushing to disk).
>>Meanwhile, other writer transactions are continuing to busily write to the
>>WAL. In which case a disk bandwidth problem (other than kernal config
>>issues) may be helped by placing the WAL files on a disk (and maybe even
>>controller) seperate from the DB.
>
>
> Also, running on SCSI drives will be much faster than running on IDE
> drives if the IDE drives have their caches disabled like they should,
> since they lie otherwise. Since SCSI disks don't usually lie, and are
> designed to handle multiple requests in parallel, they are much faster as
> parallel load increases. If you're writing a lot, you should either have
> a great number of IDE drives with the write cache turned off, like some of
> the newer storage devices made of ~100 IDE drives, or you should have
> SCSI. SCSI's advantage won't be as great as the number of drives
> approaches infinity. But for 1 to 10 drives my guess is that SCSI is
> gonna be a clear winner under parallel load.
Don't forget the file system. Most journaling file systems are great
for reliability but aren't always so hot come performance and those
that are may require tweaking. Linux EXT3, IMO, works best when the
journal is kept on a different device and the file system is mounted
with the data=writeback option. Those 2 things in our test environment
were worth a speedup of close to 14%.
--
Greg Spiegelberg
Sr. Product Development Engineer
Cranel, Incorporated.
Phone: 614.318.4314
Fax: 614.431.8388
Email: gspiegelberg@Cranel.com
Cranel. Technology. Integrity. Focus.
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients from your mail client; the link fills in
the headers below: reply via email
Some clients, webmail especially, drop In-Reply-To and References from
a link, and the reply then starts a new thread: use the mbox below.
To: pgsql-admin@postgresql.org
Cc: gspiegelberg@cranel.com, scott.marlowe@ihs.com, iain@mst.co.jp, me@shanewright.co.uk
Subject: Re: hanging for 30sec when checkpointing
In-Reply-To: <4021355F.8060304@cranel.com>
References: <Pine.LNX.4.33.0402040929220.28468-100000@css120.ihs.com> <4021355F.8060304@cranel.com>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox