pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Mike Glover <mpg4@duluoz.net>
To: pgsql-performance@postgresql.org
Subject: RAID or manual split?
Date: Tue, 17 Feb 2004 13:53:42 -0800
Message-ID: <20040217135342.1924326f.mpg4@duluoz.net> (raw)


It seems, that if I know the type and frequency of the queries a
database will be seeing, I could split the database by hand over
multiple disks and get better performance that I would with a RAID array
with similar hardware.  Most of the data is volatile
and easily replaceable (and the rest is backed up independently), so
redundancy isn't importand, and I'm willing to do some ongoing
maintenance if I can get a decent speed boost.  Am I misguided, or might
this work? details of my setup are below:

Six large (3-7 Mrow) 'summary' tables, each being updated continuously
by 5-20 processes with about 0.5 transactions/second/process.  

Periodically (currently every two weeks), join queries are
performed between one of the 'summary' tables(same one each time) and
each of the other five.  Each join touches most rows of both tables,
indexes aren't used.  Results are written into a separate group of
'inventory' tables (about 500 Krow each), one for each join.

There are frequent (100-1000/day) queries of both the
inventory and summary tables using the primary key -- always using the
index and returning < 10 rows.

We're currently getting (barely) acceptable performance from a single
15k U160 SCSI disk, but db size and activity are growing quickly. 
I've got more disks and a battery-backed LSI card on order.

-mike


-- 
Mike Glover
GPG Key ID BFD19F2C <mpg4@duluoz.net>

view thread (3+ messages)  latest in thread

Message-ID: <20040217135342.1924326f.mpg4@duluoz.net>
Permalink:  ../20040217135342.1924326f.mpg4@duluoz.net/
Also on:    postgresql.org/message-id/20040217135342.1924326f.mpg4@duluoz.net

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: mpg4@duluoz.net
  Subject: Re: RAID or manual split?
  In-Reply-To: <20040217135342.1924326f.mpg4@duluoz.net>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox