pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Thomas Harold <tgh@tgharold.com>
Cc: pgsql-performance@postgresql.org
Subject: Re: two disks - best way to use them?
Date: Mon, 05 Dec 2005 11:45:21 -0500
Message-ID: <43946EA1.8090908@tgharold.com> (raw)
In-Reply-To: <Pine.LNX.4.62.0512050808440.2807@qnivq.ynat.uz>
References: <00fb01c5f772$59471410$0200a8c0@dell8200>
	<6.2.5.6.0.20051202145746.01dc7b68@earthlink.net>
	<43946148.9010607@tgharold.com>
	<Pine.LNX.4.62.0512050808440.2807@qnivq.ynat.uz>

David Lang wrote:

> the application can' tell the difference, but the reason for seperating 
> them isn't for the application, it's so that different pieces of 
> hardware can work on different things without having to bounce back and 
> forth between them.
> 
> useing the same drives with LVM doesn't achieve this goal.
> 
> the problem is that the WAL is doing a LOT of writes, and postgres waits 
> until each write is completed before going on to the next thing (for 
> safety), if a disk is dedicated to the WAL then the head doesn't move 
> much. if the disk is used for other things as well then the heads have 
> to move across the disk surface between the WAL and where the data is. 
> this drasticly slows down the number of items that can go into the WAL, 
> and therefor slows down the entire system.
> 
> this slowdown isn't even something as simple as cutting your speed in 
> half (half the time spent working on the WAL, half spent on the data 
> itself), it's more like 10% spent on the WAL, 10% spent on the data, and 
> 80% moveing back and forth between them (I am probably wrong on the 
> exact numbers, but it is something similarly drastic)

Yeah, I don't think I was clear about the config.  It's (4) disks setup 
as a pair of RAID1 sets.  My original config was pgsql on the first RAID 
set (data and WAL).  I'm now experimenting with putting the data/pg_xlog 
folder on the 2nd set of disks.

Under the old setup (everything on the original RAID1 set, in a 
dedicated 32GB LVM volume), I was seeing 80-90% wait percentages in 
"top".  My understanding is that this is an indicator of an overloaded / 
bottlenecked disk system.  This was while doing massive inserts into a 
test table (millions of narrow rows).  I'm waiting to see what happens 
once I have data/pg_xlog on the 2nd disk set.

Thanks for the input.



view thread (11+ messages)  latest in thread

Message-ID: <43946EA1.8090908@tgharold.com>
Permalink:  ../43946EA1.8090908@tgharold.com/
Also on:    postgresql.org/message-id/43946EA1.8090908@tgharold.com

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: tgh@tgharold.com
  Subject: Re: two disks - best way to use them?
  In-Reply-To: <43946EA1.8090908@tgharold.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox