pg.ddx.io pgsql-performance@postgresql.org mailing list archive
help / color / mirror / Atom feedIBM P-series machines (was: Excessive context switching on SMP Xeons)
3+ messages / 3 participants
[nested] [flat]
* IBM P-series machines (was: Excessive context switching on SMP Xeons)
@ 2004-10-11 17:38 Andrew Sullivan <ajs@crankycanuck.ca>
0 siblings, 1 reply; 3+ messages in thread
From: Andrew Sullivan @ 2004-10-11 17:38 UTC (permalink / raw)
To: pgsql-performance
On Tue, Oct 05, 2004 at 09:47:36AM -0700, Josh Berkus wrote:
> As long as you're on x86, scaling outward is the way to go. If you want to
> continue to scale upwards, ask Andrew Sullivan about his experiences running
> PostgreSQL on big IBM boxes. But if you consider an quad-Opteron server
> expensive, I don't think that's an option for you.
Well, they're not that big, and both Chris Browne and Andrew Hammond
are at least as qualified to talk about this as I. But since Josh
mentioned it, I'll put some anecdotal rablings here just in case
anyone is interested.
We used to run our systems on Solaris 7, then 8, on Sun E4500s. We
found the performance on those boxes surprisingly bad under certain
pathological loads. I ultimately traced this to some remarkably poor
shared memory handling by Solaris: during relatively heavy load
(in particular, thousands of selects per second on the same set of
tuples) we'd see an incredible number of semaphore operations, and
concluded that the buffer handling was killing us.
I think we could have tuned this away, but for independent reasons we
decided to dump Sun gear (the hardware had become unreliable, and we
were not satisfied with the service we were getting). We ended up
choosing IBM P650s as a replacement.
The 650s are not cheap, but boy are they fast. I don't have any
numbers I can share, but I can tell you that we recently had a few
days in which our write load was as large as the entire write load
for last year, and you couldn't tell. It is too early for us to say
whether the P series lives up to its billing in terms of relibility:
the real reason we use these machines is reliability, so if
approaching 100% uptime isn't important to you, the speed may not be
worth it.
We're also, for the record, doing experiments with Opterons. So far,
we're impressed, and you can buy a lot of Opteron for the cost of one
P650.
A
--
Andrew Sullivan | ajs@crankycanuck.ca
I remember when computers were frustrating because they *did* exactly what
you told them to. That actually seems sort of quaint now.
--J.D. Baldwin
^ permalink raw reply [nested|flat] 3+ messages in thread
* Re: IBM P-series machines (was: Excessive context
@ 2004-10-11 18:20 Rod Taylor <pg@rbt.ca>
parent: Andrew Sullivan <ajs@crankycanuck.ca>
0 siblings, 1 reply; 3+ messages in thread
From: Rod Taylor @ 2004-10-11 18:20 UTC (permalink / raw)
To: Andrew Sullivan <ajs@crankycanuck.ca>; +Cc: pgsql-performance
On Mon, 2004-10-11 at 13:38, Andrew Sullivan wrote:
> On Tue, Oct 05, 2004 at 09:47:36AM -0700, Josh Berkus wrote:
> > As long as you're on x86, scaling outward is the way to go. If you want to
> > continue to scale upwards, ask Andrew Sullivan about his experiences running
> > PostgreSQL on big IBM boxes. But if you consider an quad-Opteron server
> > expensive, I don't think that's an option for you.
> The 650s are not cheap, but boy are they fast. I don't have any
> numbers I can share, but I can tell you that we recently had a few
> days in which our write load was as large as the entire write load
> for last year, and you couldn't tell. It is too early for us to say
> whether the P series lives up to its billing in terms of relibility:
> the real reason we use these machines is reliability, so if
> approaching 100% uptime isn't important to you, the speed may not be
> worth it.
Agreed completely, and the 570 knocks the 650 out of the water -- nearly
double the performance for math heavy queries. Beware vendor support for
Linux on these things though -- we ran into many of the same issues with
vendor support on the IBM machines as we did with the Opterons.
^ permalink raw reply [nested|flat] 3+ messages in thread
* Re: IBM P-series machines (was: Excessive context
@ 2004-10-12 01:34 Christopher Browne <cbbrowne@acm.org>
parent: Rod Taylor <pg@rbt.ca>
0 siblings, 0 replies; 3+ messages in thread
From: Christopher Browne @ 2004-10-12 01:34 UTC (permalink / raw)
To: pgsql-performance
pg@rbt.ca (Rod Taylor) wrote:
> On Mon, 2004-10-11 at 13:38, Andrew Sullivan wrote:
>> On Tue, Oct 05, 2004 at 09:47:36AM -0700, Josh Berkus wrote:
>> > As long as you're on x86, scaling outward is the way to go. If
>> > you want to continue to scale upwards, ask Andrew Sullivan about
>> > his experiences running PostgreSQL on big IBM boxes. But if you
>> > consider an quad-Opteron server expensive, I don't think that's
>> > an option for you.
>
>> The 650s are not cheap, but boy are they fast. I don't have any
>> numbers I can share, but I can tell you that we recently had a few
>> days in which our write load was as large as the entire write load
>> for last year, and you couldn't tell. It is too early for us to
>> say whether the P series lives up to its billing in terms of
>> relibility: the real reason we use these machines is reliability,
>> so if approaching 100% uptime isn't important to you, the speed may
>> not be worth it.
>
> Agreed completely, and the 570 knocks the 650 out of the water --
> nearly double the performance for math heavy queries. Beware vendor
> support for Linux on these things though -- we ran into many of the
> same issues with vendor support on the IBM machines as we did with
> the Opterons.
The 650s are running AIX, not Linux.
Based on the "Signal 11" issue, I'm not certain what would be the
'best' answer. It appears that the problem relates to proprietary
bits of AIX libc. In theory, that would have been more easily
resolvable with a source-available GLIBC.
On the other hand, I'm not sure what happens to support for any of the
interesting hardware extensions. I'm not sure, for instance, that we
could run HACMP on Linux on this hardware.
As for "vendor support" for Opteron, that sure looks like a
trainwreck... If you're going through IBM, then they won't want to
respond to any issues if you're not running a "bog-standard" RHAS/RHES
release from Red Hat. And that, on Opteron, is preposterous, because
there's plenty of the bits of Opteron support that only ever got put
in Linux 2.6, whilst RHAT is still back in the 2.4 days.
In a way, that's just as well, at this point. There's plenty of stuff
surrounding this that is still pretty experimental; the longer RHAT
waits to support 2.6, the greater the likelihood that Linux support
for Opteron will have settled down to the point that the result will
actually be supportable by RHAT, and by proxy, by IBM and others.
There is some risk that if RHAT waits _too_ long for 2.6, people will
have already jumped ship to SuSE. No benefits without risks...
--
(reverse (concatenate 'string "gro.mca" "@" "enworbbc"))
http://www.ntlug.org/~cbbrowne/rdbms.html
If at first you don't succeed, then you didn't do it right!
If at first you don't succeed, then skydiving definitely isn't for you.
^ permalink raw reply [nested|flat] 3+ messages in thread
end of thread, other threads:[~2004-10-12 01:34 UTC | newest]
Thread overview: 3+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2004-10-11 17:38 IBM P-series machines (was: Excessive context switching on SMP Xeons) Andrew Sullivan <ajs@crankycanuck.ca>
2004-10-11 18:20 ` Re: IBM P-series machines (was: Excessive context Rod Taylor <pg@rbt.ca>
2004-10-12 01:34 ` Re: IBM P-series machines (was: Excessive context Christopher Browne <cbbrowne@acm.org>
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox