From: Andrew Sullivan <andrew@libertyrms.info>
To: pgsql-performance@postgresql.org
Subject: Re: Hardware recommendations to scale to silly load
Date: Wed, 27 Aug 2003 07:40:07 -0400
Message-ID: <20030827114007.GD13190@libertyrms.info> (raw)
In-Reply-To: <1061948112.15800.53.camel@gibraltar.mattclark.net>
References: <1061948112.15800.53.camel@gibraltar.mattclark.net>
On Wed, Aug 27, 2003 at 02:35:13AM +0100, matt wrote:
> I need to increase the overall performance by a factor of 10, while at
> the same time the DB size increases by a factor of 50. e.g. 3000
> inserts/updates or 25,000 selects per second, over a 25GB database with
> most used tables of 5,000,000 and 1,000,000 rows.
Your problem is mostly going to be disk related. You can only get in
there as many tuples in a second as your disk rotates per second. I
suspect what you need is really expensive disk hardware (sorry to
tell you that) set up as RAID 1+0 on fibre channel or something.
3000 write transactions per second is probably too much to ask for
any standard hardware.
But given that you are batching this once a week, and trying to avoid
big expenses, are you use this is the right approach? Perhaps you
should consider a redesign using COPY and such?
A
--
----
Andrew Sullivan 204-4141 Yonge Street
Liberty RMS Toronto, Ontario Canada
<andrew@libertyrms.info> M2P 2A8
+1 416 646 3304 x110
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients from your mail client; the link fills in
the headers below: reply via email
Some clients, webmail especially, drop In-Reply-To and References from
a link, and the reply then starts a new thread: use the mbox below.
To: pgsql-performance@postgresql.org
Cc: andrew@libertyrms.info
Subject: Re: Hardware recommendations to scale to silly load
In-Reply-To: <20030827114007.GD13190@libertyrms.info>
References: <1061948112.15800.53.camel@gibraltar.mattclark.net> <20030827114007.GD13190@libertyrms.info>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox