X-Original-To: pgsql-performance-postgresql.org@localhost.postgresql.org Received: from localhost (unknown [64.117.224.130]) by svr1.postgresql.org (Postfix) with ESMTP id BCFE3D1B8BF for ; Wed, 27 Aug 2003 08:40:15 -0300 (ADT) Received: from svr1.postgresql.org ([64.117.224.193]) by localhost (neptune.hub.org [64.117.224.130]) (amavisd-new, port 10024) with ESMTP id 75293-07 for ; Wed, 27 Aug 2003 08:40:07 -0300 (ADT) Received: from mail.libertyrms.com (unknown [209.167.124.227]) by svr1.postgresql.org (Postfix) with ESMTP id 2039FD1B550 for ; Wed, 27 Aug 2003 08:40:04 -0300 (ADT) Received: from [10.1.2.130] (helo=dba2) by mail.libertyrms.com with esmtp (Exim 3.22 #3 (Debian)) id 19ryel-0002QQ-00 for ; Wed, 27 Aug 2003 07:40:07 -0400 Received: by dba2 (Postfix, from userid 1019) id 5BC42CF15; Wed, 27 Aug 2003 07:40:07 -0400 (EDT) Date: Wed, 27 Aug 2003 07:40:07 -0400 From: Andrew Sullivan To: pgsql-performance@postgresql.org Subject: Re: Hardware recommendations to scale to silly load Message-ID: <20030827114007.GD13190@libertyrms.info> Mail-Followup-To: Andrew Sullivan , pgsql-performance@postgresql.org References: <1061948112.15800.53.camel@gibraltar.mattclark.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <1061948112.15800.53.camel@gibraltar.mattclark.net> User-Agent: Mutt/1.5.4i X-Virus-Scanned: by amavisd-new at postgresql.org X-Archive-Number: 200308/373 X-Sequence-Number: 3189 On Wed, Aug 27, 2003 at 02:35:13AM +0100, matt wrote: > I need to increase the overall performance by a factor of 10, while at > the same time the DB size increases by a factor of 50. e.g. 3000 > inserts/updates or 25,000 selects per second, over a 25GB database with > most used tables of 5,000,000 and 1,000,000 rows. Your problem is mostly going to be disk related. You can only get in there as many tuples in a second as your disk rotates per second. I suspect what you need is really expensive disk hardware (sorry to tell you that) set up as RAID 1+0 on fibre channel or something. 3000 write transactions per second is probably too much to ask for any standard hardware. But given that you are batching this once a week, and trying to avoid big expenses, are you use this is the right approach? Perhaps you should consider a redesign using COPY and such? A -- ---- Andrew Sullivan 204-4141 Yonge Street Liberty RMS Toronto, Ontario Canada M2P 2A8 +1 416 646 3304 x110