X-Original-To: pgsql-performance-postgresql.org@localhost.postgresql.org Received: from localhost (neptune.hub.org [200.46.204.2]) by svr1.postgresql.org (Postfix) with ESMTP id 83918D1B486 for ; Wed, 3 Dec 2003 21:54:56 +0000 (GMT) Received: from svr1.postgresql.org ([200.46.204.71]) by localhost (neptune.hub.org [200.46.204.2]) (amavisd-new, port 10024) with ESMTP id 12089-01 for ; Wed, 3 Dec 2003 17:54:26 -0400 (AST) Received: from swan.mail.pas.earthlink.net (swan.mail.pas.earthlink.net [207.217.120.123]) by svr1.postgresql.org (Postfix) with ESMTP id 9F683D1B432 for ; Wed, 3 Dec 2003 17:54:24 -0400 (AST) Received: from dpc6682164065.direcpc.com ([66.82.164.65] helo=earthlink.net) by swan.mail.pas.earthlink.net with esmtp (Exim 3.33 #1) id 1AReww-0006mH-00; Wed, 03 Dec 2003 13:54:25 -0800 Message-ID: <3FCE5B85.9000406@earthlink.net> Date: Wed, 03 Dec 2003 16:54:13 -0500 From: Sean Shanny User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.5) Gecko/20031007 X-Accept-Language: en-us, en MIME-Version: 1.0 To: "pgsql-performance@postgresql.org" Cc: Sean Shanny Subject: Re: Has anyone run on the new G5 yet References: <3FCE5855.5040403@earthlink.net> In-Reply-To: <3FCE5855.5040403@earthlink.net> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: by amavisd-new at postgresql.org X-Archive-Number: 200312/56 X-Sequence-Number: 4916 I should also add that we have already done a ton of tuning based on the archives of this list so we are not starting from scratch here. Thanks. --sean Sean Shanny wrote: > To all, > > We are building a data warehouse composed of essentially click stream > data. The DB is growing fairly quickly as to be expected, currently > at 90GB for one months data. The idea is to keep 6 months detailed > data on line and then start aggregating older data to summary tables. > We have 2 fact tables currently, one with about 68 million rows and > the other with about 210 million rows. Numerous dimension tables > ranging from a dozen rows to millions. > > We are currently running on a Dell 2650 with 2 Xeon 2.8 processors in > hyper-threading mode, 4GB of ram, and 5 SCSI drives in a RAID 0, > Adaptec PERC3/Di, configuration. I believe they are 10k drives. > Files system is EXT3. We are running RH9 Linux kernel 2.4.20-20.9SMP > with bigmem turned on. This box is used only for the warehouse. All > the ETL work is done on this machine as well. DB version is > postgreSQL 7.4. > > We are running into issues with IO saturation obviously. Since this > thing is only going to get bigger we are looking for some advice on > how to accommodate DB's of this size. > > First question is do we gain anything by moving the RH Enterprise > version of Linux in terms of performance, mainly in the IO realm as we > are not CPU bound at all? Second and more radical, has anyone run > postgreSQL on the new Apple G5 with an XRaid system? This seems like > a great value combination. Fast CPU, wide bus, Fibre Channel IO, > 2.5TB all for ~17k. > > I keep see references to terabyte postgreSQL installations, I was > wondering if anyone on this list is in charge of one of those and can > offer some advice on how to position ourselves hardware wise. > > Thanks. > > --sean > > > ---------------------------(end of broadcast)--------------------------- > TIP 3: if posting/reading through Usenet, please send an appropriate > subscribe-nomail command to majordomo@postgresql.org so that your > message can get through to the mailing list cleanly >