pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Sean Shanny <shannyconsulting@earthlink.net>
To: pgsql-performance@postgresql.org <pgsql-performance@postgresql.org>
Cc: Sean Shanny <shannyconsulting@earthlink.net>
Subject: Re: Has anyone run on the new G5 yet
Date: Wed, 03 Dec 2003 16:54:13 -0500
Message-ID: <3FCE5B85.9000406@earthlink.net> (raw)
In-Reply-To: <3FCE5855.5040403@earthlink.net>
References: <3FCE5855.5040403@earthlink.net>

I should also add that we have already done a ton of tuning based on the 
archives of this list so we are not starting from scratch here.

Thanks.

--sean

Sean Shanny wrote:

> To all,
>
> We are building a data warehouse composed of essentially click stream 
> data.  The DB is growing fairly quickly as to be expected, currently 
> at 90GB for one months data.  The idea is to keep 6 months detailed 
> data on line and then start aggregating older data to summary tables.  
> We have 2 fact tables currently, one with about 68 million rows and 
> the other with about 210 million rows.  Numerous dimension tables 
> ranging from a dozen rows to millions.
>
> We are currently running on a Dell 2650 with 2 Xeon 2.8 processors in 
> hyper-threading mode, 4GB of ram, and 5 SCSI drives in a RAID 0, 
> Adaptec PERC3/Di,  configuration.  I believe they are 10k drives.  
> Files system is EXT3. We are running RH9 Linux kernel 2.4.20-20.9SMP 
> with bigmem turned on.  This box is used only for the warehouse.  All 
> the ETL work is done on this machine as well.  DB version is 
> postgreSQL 7.4.
>
> We are running into issues with IO saturation obviously.  Since this 
> thing is only going to get bigger we are looking for some advice on 
> how to accommodate DB's of this size.
>
> First question is do we gain anything by moving the RH Enterprise 
> version of Linux in terms of performance, mainly in the IO realm as we 
> are not CPU bound at all?  Second and more radical, has anyone run 
> postgreSQL on the new Apple G5 with an XRaid system?  This seems like 
> a great value combination.  Fast CPU, wide bus, Fibre Channel IO, 
> 2.5TB all for ~17k.
>
> I keep see references to terabyte postgreSQL installations, I was 
> wondering if anyone on this list is in charge of one of those and can 
> offer some advice on how to position ourselves hardware wise.
>
> Thanks.
>
> --sean
>
>
> ---------------------------(end of broadcast)---------------------------
> TIP 3: if posting/reading through Usenet, please send an appropriate
>      subscribe-nomail command to majordomo@postgresql.org so that your
>      message can get through to the mailing list cleanly
>




view thread (9+ messages)  latest in thread

Message-ID: <3FCE5B85.9000406@earthlink.net>
Permalink:  ../3FCE5B85.9000406@earthlink.net/
Also on:    postgresql.org/message-id/3FCE5B85.9000406@earthlink.net

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: shannyconsulting@earthlink.net
  Subject: Re: Has anyone run on the new G5 yet
  In-Reply-To: <3FCE5B85.9000406@earthlink.net>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox