pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Greg Smith <gsmith@gregsmith.com>
To: David Brain <dbrain@bandwidth.com>
Cc: pgsql-performance@postgresql.org
Subject: Re: 1 or 2 servers for large DB scenario.
Date: Fri, 25 Jan 2008 11:55:43 -0500 (EST)
Message-ID: <Pine.GSO.4.64.0801251144100.13300@westnet.com> (raw)
In-Reply-To: <A97726DE-B9AA-470A-A111-32DB145CAD4A@bandwidth.com>
References: <A97726DE-B9AA-470A-A111-32DB145CAD4A@bandwidth.com>

On Fri, 25 Jan 2008, David Brain wrote:

> The hardware storing this DB (a software RAID6) array seems to be very 
> IO bound for writes and this is restricting our insert performance to 
> ~50TPS.

If you're seeing <100TPS you should consider if it's because you're 
limited by how fast WAL commits can make it to disk.  If you really want 
good insert performance, there is no substitute for getting a disk 
controller with a good battery-backed cache to work around that.  You 
could just put the WAL xlog directory on a RAID-1 pair of disks to 
accelerate that, you don't have to move the whole database to a new 
controller.

> Also are there any settings that might boost our TPS on the existing hardware 
> (sync=off isn't an option..

Having a good write cache lets you run almost as fast as when fsync is 
off.

> Verson of  Postgresql is 8.2.3.

I'm hearing an echo here...8.2 versions before 8.2.4 have a bug related to 
statistics that can limit performance in several situations.  You should 
consider an upgrade just to remove that as a potential contributor to your 
issues.

To do a quick check on whether this is impacting things, run top, press 
"c" to show the full process lines, and note whether the statistics 
collector process is taking up a significant amount of CPU time.  If it 
is, you're definately being nailed by the bug, and you really need that 
upgrade.

--
* Greg Smith gsmith@gregsmith.com http://www.gregsmith.com Baltimore, MD



view thread (7+ messages)  latest in thread

Message-ID: <Pine.GSO.4.64.0801251144100.13300@westnet.com>
Permalink:  ../Pine.GSO.4.64.0801251144100.13300@westnet.com/
Also on:    postgresql.org/message-id/Pine.GSO.4.64.0801251144100.13300@westnet.com

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: gsmith@gregsmith.com, dbrain@bandwidth.com
  Subject: Re: 1 or 2 servers for large DB scenario.
  In-Reply-To: <Pine.GSO.4.64.0801251144100.13300@westnet.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox