pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  

help / color / mirror / Atom feed
From: Shaun Thomas <sthomas@peak6.com>
To: Claudio Freire <klaussfreire@gmail.com>
Cc: Igor Chudov <ichudov@gmail.com>
Cc: pgsql-performance@postgresql.org
Subject: Re: Postgres for a "data warehouse", 5-10 TB
Date: Mon, 12 Sep 2011 11:09:44 -0500
Message-ID: <4E6E2EC8.8080407@peak6.com> (raw)
In-Reply-To: <CAGTBQpYyzdGKwQ12vYjv-neFmYfw1S899+KPAvSwkhoFdz-3JA@mail.gmail.com>
References: <CAMhtkAbK7saRO_Tayb1nS3YLWN=Wns=Ci47qs-3YbX0T2+hkpA@mail.gmail.com>
	<CAOR=d=0zmw-EGRJyYmwCTxR5g6osbFLS5i-3kzjG05j7S=1JaA@mail.gmail.com>
	<CAMhtkAah2c4XfSec=OtgL1V51wpD=jygbZnBVBRYCV02MscebQ@mail.gmail.com>
	<CAGTBQpYa+VUXtKZtUDLSosboSMgUEOCd_dkmCPA=4HkjHw2r2g@mail.gmail.com>
	<CAMhtkAY2GvGiTz23V10Bev-ibrPWE7GowocT3KeWKm1EoED7WA@mail.gmail.com>
	<CAGTBQpYyzdGKwQ12vYjv-neFmYfw1S899+KPAvSwkhoFdz-3JA@mail.gmail.com>

On 09/11/2011 09:44 AM, Claudio Freire wrote:

> And Andy is right, you'll have a lot less space. If raid 10 doesn't
> give you enough room, just leave two spare drives for a raid 0
> temporary partition. That will be at least twice as fast as doing
> temporary tables on the raid 6.

Alternatively, throw a lot of memory at the system and point the temp 
space at /dev/shm. We've had really good luck doing that here, to avoid 
excessive writes to our NVRAM PCIe cards. Make sure the transaction logs 
(and any archives) get written to a separate LUN (ideally on a separate 
controller) for even more win.

-- 
Shaun Thomas
OptionsHouse | 141 W. Jackson Blvd. | Suite 800 | Chicago IL, 60604
312-676-8870
sthomas@peak6.com

______________________________________________

See http://www.peak6.com/email-disclaimer/ for terms and conditions related to this email



view thread (48+ messages)  latest in thread

Message-ID: <4E6E2EC8.8080407@peak6.com>
Permalink:  ../4E6E2EC8.8080407@peak6.com/
Also on:    postgresql.org/message-id/4E6E2EC8.8080407@peak6.com

 · 

reply
Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: sthomas@peak6.com, klaussfreire@gmail.com, ichudov@gmail.com
  Subject: Re: Postgres for a "data warehouse", 5-10 TB
  In-Reply-To: <4E6E2EC8.8080407@peak6.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox