From: Scott Marlowe <scott.marlowe@gmail.com>
To: Matthew Wakeling <matthew@flymine.org>
Cc: pgsql-performance@postgresql.org <pgsql-performance@postgresql.org>
Subject: Re: Need help with 8.4 Performance Testing
Date: Tue, 9 Dec 2008 10:46:37 -0700
Message-ID: <dcc563d10812090946pf1dcc0bxe881294edbebb66b@mail.gmail.com> (raw)
In-Reply-To: <alpine.DEB.1.10.0812091732130.4666@aragorn.flymine.org>
References: <200812071138.01215.josh@agliodbs.com>
<Pine.GSO.4.64.0812081442410.5242@westnet.com>
<dcc563d10812081231y6c71601am677ba828ff0b515e@mail.gmail.com>
<Pine.GSO.4.64.0812081731510.26019@westnet.com>
<b42b73150812081723qdf7f203tcba3c3660023890f@mail.gmail.com>
<Pine.GSO.4.64.0812082225470.13669@westnet.com>
<493E6DBE.2040605@verizon.net>
<BDFBB77C9E07BE4A984DAAE981D19F961ACA17D9FC@EXVMBX018-1.exch018.msoutlookonline.net>
<dcc563d10812090921l90fd2eci8e1d163258d49ce0@mail.gmail.com>
<alpine.DEB.1.10.0812091732130.4666@aragorn.flymine.org>
On Tue, Dec 9, 2008 at 10:35 AM, Matthew Wakeling <matthew@flymine.org> wrote:
> On Tue, 9 Dec 2008, Scott Marlowe wrote:
>>
>> I wonder how many hard drives it would take to be CPU bound on random
>> access patterns? About 40 to 60? And probably 15k / SAS drives to
>> boot. Cause that's what we're looking at in the next few years where
>> I work.
>
> There's a problem with that thinking. That is, in order to exercise many
> spindles, you will need to have just as many (if not more) concurrent
> requests. And if you have many concurrent requests, then you can spread them
> over multiple CPUs. So it's more a case of "How many hard drives PER CPU".
> It also becomes a matter of whether Postgres can scale that well.
For us, all that is true. We typically have a dozen or more
concurrent requests running at once. We'll likely see that increase
linearly with our increase in users over the next year or so. We
bought the machines with dual quad core opterons knowing the 6,8 and
12 core opterons were due out on the same socket design in the next
year or so and we could upgrade those too if needed. PostgreSQL seems
to scale well in most tests I've seen to at least 16 cores, and after
that it's anyone's guess. The Sparc Niagra seems capable of scaling
to 32 threads on 8 cores with pgsql 8.2 quite well.
I worry about the linux kernel scaling that well, and we might have to
look at open solaris or something like the solaris kernel under ubuntu
distro to get better scaling.
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-performance@postgresql.org
Cc: scott.marlowe@gmail.com, matthew@flymine.org
Subject: Re: Need help with 8.4 Performance Testing
In-Reply-To: <dcc563d10812090946pf1dcc0bxe881294edbebb66b@mail.gmail.com>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox