pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: J. Roeleveld <joost@antarean.org>
To: pgsql-performance@postgresql.org
Subject: Re: How to achieve sustained disk performance of 1.25 GB write for 5 mins
Date: Wed, 17 Nov 2010 16:25:02 +0100
Message-ID: <201011171625.03097.joost@antarean.org> (raw)
In-Reply-To: <ic0onf$3fi$1@news.hub.org>
References: <ic0onf$3fi$1@news.hub.org>

On Wednesday 17 November 2010 15:26:56 Eric Comeau wrote:
> This is not directly a PostgreSQL performance question but I'm hoping
> some of the chaps that build high IO PostgreSQL servers on here can help.
> 
> We build file transfer acceleration s/w (and use PostgreSQL as our
> database) but we need to build a test server that can handle a sustained
> write throughput of 1,25 GB for 5 mins.
> 
> Why this number, because we want to push a 10 Gbps network link for 5-8
> mins, 10Gbps = 1.25 GB write, and would like to drive it for 5-8 mins
> which would be 400-500 GB.
> 
> Note this is just a "test" server therefore it does not need fault
> tolerance.
> 
> Thanks in advance,
> Eric

I'm sure there are others with more experience on this, but if you don't need 
failt tolerance, a bunch of fast disks in striping-mode (so-called RAID-0) on 
seperated channels (eg. different PCI-Express channels) would be my first step.

Alternatively, if you don't care if the data is actually stored, couldn't you 
process it with a program that does a checksum over the data transmitted and 
then ignores/forgets it? (eg. forget about disk-storage and do it all in 
memory?)

--
Joost



view thread (12+ messages)  latest in thread

Message-ID: <201011171625.03097.joost@antarean.org>
Permalink:  ../201011171625.03097.joost@antarean.org/
Also on:    postgresql.org/message-id/201011171625.03097.joost@antarean.org

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: joost@antarean.org
  Subject: Re: How to achieve sustained disk performance of 1.25 GB write for 5 mins
  In-Reply-To: <201011171625.03097.joost@antarean.org>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox