From: Jared Mauch <jared@puck.nether.net>
To: Stephane Bailliez <sbailliez@gmail.com>
Cc: Jared Mauch <jared@puck.nether.net>
Cc: pgsql-performance@postgresql.org
Subject: Re: big database performance
Date: Thu, 10 Jan 2008 09:34:40 -0500
Message-ID: <20080110143440.GB79941@puck.nether.net> (raw)
In-Reply-To: <4785FCB7.3090403@gmail.com>
References: <4784835A.8070604@careerjunction.co.za>
<47848575.8000007@commandprompt.com>
<20080109174243.GA8915@puck.nether.net>
<4785FCB7.3090403@gmail.com>
On Thu, Jan 10, 2008 at 12:08:39PM +0100, Stephane Bailliez wrote:
> Jared Mauch wrote:
>> I do large databases in Pg, like 300GB/day of new data.
>
> That's impressive. Would it be possible to have details on your hardware,
> schema and configuration and type of usage ?
>
> I'm sure there's something to learn in there for a lot of people (or at
> least for me)
http://archives.postgresql.org/pgsql-performance/2007-12/msg00372.phphttp://archives.postgresql.org/pgsql-performance/2006-05/msg00444.php
The hardware specs are kinda boring since it's not
I/O bound, so you could get the same disk performance out of
some EIDE 7200 rpm disks (which I have done for testing).
The current setup is a 4xOpteron 8218 (dual core) w/ 16G ram.
I have roughly 12TB usable disk space on the sysem connected via some
SATA <-> FC thing our systems folks got us. Problem I have is the linear
cpu speed isn't enough and there would be challenges splitting the
workload across multiple cpus. All my major reporting is done via
pg_dump and I'm pondering what would happen if I just removed Pg
from the equation for the major reporting tasks entirely. I may see
much better performance without the database [in my way]. I've not
done that as some types of data access would need to be significantly
redone and I don't want to spend the time on that...
- Jared
--
Jared Mauch | pgp key available via finger from jared@puck.nether.net
clue++; | http://puck.nether.net/~jared/ My statements are only mine.
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-performance@postgresql.org
Cc: jared@puck.nether.net, sbailliez@gmail.com
Subject: Re: big database performance
In-Reply-To: <20080110143440.GB79941@puck.nether.net>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox