pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Scott Marlowe <scott.marlowe@gmail.com>
To: Lionel <lionel@art-informatique.com>
Cc: pgsql-performance@postgresql.org
Subject: Re: Hardware HD choice...
Date: Thu, 23 Oct 2008 10:38:34 -0600
Message-ID: <dcc563d10810230938n4672582bo2ec8b989f41c5430@mail.gmail.com> (raw)
In-Reply-To: <gdq44g$f4o$1@news.hub.org>
References: <gdq44g$f4o$1@news.hub.org>

On Thu, Oct 23, 2008 at 9:10 AM, Lionel <lionel@art-informatique.com> wrote:
> Hello,
>
> I have to choose a dedicated server to host a big 8.3 database.
> The global size of the database (indexes included) will grow by 40 Go every
> year (40 millions of lines/year)
> Real data (indexes excluded) will be around 5-7 Go/year.
> I need to store 4 years of activity.
> Very few simultaneous users (~4).
> 100000 rows added every day via csv imports.
> The application will be a reporting application.
> Main statements: aggregation of 10000 to 10millions of line.
> Vast majority will hit 300000 lines (90% of the connected users), few will
> hit more than 10 millions (10% of the connected users, there may never be 2
> simultaneous users of this category).
> 20sec - 30sec for such a statement is acceptable.

In that case, throw memory at the problem first, then lots of hard
drives on a good RAID controller.

> It's quite easy to choose CPU (xeon quad core 2.66, maybe dual xeon), RAM
> (8-12Go) but I still hesitate for hard disks.

I've had better luck with opterons than Xeons, but they're both pretty
good nowadays.  I'd look at at least 16 Gigs ram, if you can afford it
get 32.

> these are options possible with the hosters I usually work with:
>
> Option 0)
> RAID1 750Go SATA2
>
> Option 1)
> RAID1 750Go SATA2 + 500Go USB disk
>
> Option 2)
> RAID1 SAS 15000rpm 147 Go hard disk + 500Go USB
>
> Option 2+)
> RAID1 SATA2 SSD intel X25-M 80Go + 500Go USB
>
> Option 3)
> RAID5 SATA2 5x750Go
>
> Option 4)
> RAID10 SAS 15000rpm 4x146 Go
>
> Option 5)
> RAID10 SATA2 4x250 Go
>
> Any other better option that I could ask for ?

Yes, more drives.  4 drives in a RAID10 is a good start.  If you could
get 8 or 12 in one that's even better.

>
> What would be the best choice in case of an external USB drive : using it
> for indexes or x_log ?

Not to use one.  Generally USB transfer speeds and external USB drives
aren't reliable or fast enough for serious server use.  I say this
with two very nice external USB drives sitting next to me.  They store
my videos, not customer data.

> And what is the best option to backup such a database ?

PITR

-- When fascism comes to America, it will be draped in a flag and
carrying a cross - Sinclair Lewis



view thread (8+ messages)  latest in thread

Message-ID: <dcc563d10810230938n4672582bo2ec8b989f41c5430@mail.gmail.com>
Permalink:  ../dcc563d10810230938n4672582bo2ec8b989f41c5430@mail.gmail.com/
Also on:    postgresql.org/message-id/dcc563d10810230938n4672582bo2ec8b989f41c5430@mail.gmail.com

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: scott.marlowe@gmail.com, lionel@art-informatique.com
  Subject: Re: Hardware HD choice...
  In-Reply-To: <dcc563d10810230938n4672582bo2ec8b989f41c5430@mail.gmail.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox