X-Original-To: pgsql-performance-postgresql.org@localhost.postgresql.org Received: from localhost (unknown [200.46.204.2]) by svr1.postgresql.org (Postfix) with ESMTP id 22126D1B470 for ; Tue, 2 Mar 2004 18:57:43 +0000 (GMT) Received: from svr1.postgresql.org ([200.46.204.71]) by localhost (neptune.hub.org [200.46.204.2]) (amavisd-new, port 10024) with ESMTP id 94772-03 for ; Tue, 2 Mar 2004 14:57:35 -0400 (AST) Received: from redhotpenguin.com (c-24-7-88-83.client.comcast.net [24.7.88.83]) by svr1.postgresql.org (Postfix) with ESMTP id A2EC7D1BB43 for ; Tue, 2 Mar 2004 14:57:31 -0400 (AST) Received: (qmail 7013 invoked by uid 506); 2 Mar 2004 18:57:30 -0000 Received: from fred@redhotpenguin.com by poster.redhotpenguin.com by uid 502 with qmail-scanner-1.16 (clamscan: 0.65. spamassassin: 2.44. Clear:SA:0(-1.2/5.0):. Processed in 1.877205 secs); 02 Mar 2004 18:57:30 -0000 Received: from unknown (HELO harpua.redhotpenguin.com) (fred@redhotpenguin.com@192.168.0.3) by 192.168.0.2 with RC4-MD5 encrypted SMTP; 2 Mar 2004 18:57:28 -0000 Subject: Re: Scaling further up From: Fred Moyer Reply-To: fred@redhotpenguin.com To: William Yu , Anjan Dave Cc: pgsql-performance@postgresql.org In-Reply-To: References: <4BAFBB6B9CC46F41B2AD7D9F4BBAF78509802F@vt-pe2550-001.vantage.vantage.com> Content-Type: text/plain Organization: Red Hot Penguin Consulting LLC Message-Id: <1078225047.2707.67.camel@harpua.redhotpenguin.com> Mime-Version: 1.0 X-Mailer: Ximian Evolution 1.4.5 Date: Tue, 02 Mar 2004 10:57:27 +0000 Content-Transfer-Encoding: 7bit X-Virus-Scanned: by amavisd-new at postgresql.org X-Archive-Number: 200403/18 X-Sequence-Number: 5874 On Tue, 2004-03-02 at 17:42, William Yu wrote: > Anjan Dave wrote: > > We have a Quad-Intel XEON 2.0GHz (1MB cache), 12GB memory, running RH9, > > PG 7.4.0. There's an internal U320, 10K RPM RAID-10 setup on 4 drives. > > > > We are expecting a pretty high load, a few thousands of 'concurrent' > > users executing either select, insert, update, statments. > > The quick and dirty method would be to upgrade to the recently announced > 3GHz Xeon MPs with 4MB of L3. My semi-educated guess is that you'd get > another +60% there due to the huge L3 hiding the Xeon's shared bus penalty. If you are going to have thousands of 'concurrent' users you should seriously consider the 2.6 kernel if you are running Linux or as an alternative going with FreeBSD. You will need to load test your system and become an expert on tuning Postgres to get the absolute maximum performance from each and every query you have. And you will need lots of hard drives. By lots I mean dozen(s) in a raid 10 array with a good controller. Thousands of concurrent users means hundreds or thousands of transactions per second. I've personally seen it scale that far but in my opinion you will need a lot more hard drives and ram than cpu.