Received: from maia.hub.org (maia-3.hub.org [200.46.204.243]) by mail.postgresql.org (Postfix) with ESMTP id 698F01337B61 for ; Wed, 17 Nov 2010 11:25:14 -0400 (AST) Received: from mail.postgresql.org ([200.46.204.86]) by maia.hub.org (mx1.hub.org [200.46.204.243]) (amavisd-maia, port 10024) with ESMTP id 47005-02 for ; Wed, 17 Nov 2010 15:25:07 +0000 (UTC) X-Greylist: from auto-whitelisted by SQLgrey-1.7.6 Received: from smtpq4.gn.mail.iss.as9143.net (smtpq4.gn.mail.iss.as9143.net [212.54.34.167]) by mail.postgresql.org (Postfix) with ESMTP id D5E801337B56 for ; Wed, 17 Nov 2010 11:25:06 -0400 (AST) Received: from [212.54.34.152] (helo=smtp20.gn.mail.iss.as9143.net) by smtpq4.gn.mail.iss.as9143.net with esmtp (Exim 4.69) (envelope-from ) id 1PIjsg-0002up-KQ for pgsql-performance@postgresql.org; Wed, 17 Nov 2010 16:25:06 +0100 Received: from 5ed3454e.cm-7-4b.dynamic.ziggo.nl ([94.211.69.78] helo=data.antarean.org) by smtp20.gn.mail.iss.as9143.net with esmtp (Exim 4.69) (envelope-from ) id 1PIjsf-0003OO-PT for pgsql-performance@postgresql.org; Wed, 17 Nov 2010 16:25:05 +0100 Received: from localhost (localhost [127.0.0.1]) by data.antarean.org (Postfix) with ESMTP id 27FC22884 for ; Wed, 17 Nov 2010 16:25:03 +0100 (CET) X-Virus-Scanned: amavisd-new at antarean.org Received: from data.antarean.org ([127.0.0.1]) by localhost (data.antarean.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id akXe-uCWKyty for ; Wed, 17 Nov 2010 16:25:02 +0100 (CET) Received: from eve.localnet (eve.lan.antarean.org [10.20.13.50]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by data.antarean.org (Postfix) with ESMTPS id 9A1892223 for ; Wed, 17 Nov 2010 16:25:02 +0100 (CET) From: "J. Roeleveld" To: pgsql-performance@postgresql.org Subject: Re: How to achieve sustained disk performance of 1.25 GB write for 5 mins Date: Wed, 17 Nov 2010 16:25:02 +0100 User-Agent: KMail/1.13.5 (Linux/2.6.30-gentoo-r5; KDE/4.4.5; x86_64; ; ) References: In-Reply-To: MIME-Version: 1.0 Content-Type: Text/Plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Message-Id: <201011171625.03097.joost@antarean.org> X-ZiggoSMTP-MailScanner-Information: Please contact the ISP for more information X-ZiggoSMTP-MailScanner-ID: 1PIjsf-0003OO-PT X-ZiggoSMTP-MailScanner: Found to be clean X-ZiggoSMTP-MailScanner-SpamCheck: geen spam, SpamAssassin (niet cached, score=0.001, vereist 5, autolearn=not spam, BAYES_50 0.00) X-ZiggoSMTP-MailScanner-From: joost@antarean.org X-Virus-Scanned: Maia Mailguard 1.0.1 X-Spam-Status: No, hits=-1.9 tagged_above=-10 required=5 tests=BAYES_00=-1.9, RCVD_IN_DNSWL_NONE=-0.0001 X-Spam-Level: X-Archive-Number: 201011/284 X-Sequence-Number: 41308 On Wednesday 17 November 2010 15:26:56 Eric Comeau wrote: > This is not directly a PostgreSQL performance question but I'm hoping > some of the chaps that build high IO PostgreSQL servers on here can help. > > We build file transfer acceleration s/w (and use PostgreSQL as our > database) but we need to build a test server that can handle a sustained > write throughput of 1,25 GB for 5 mins. > > Why this number, because we want to push a 10 Gbps network link for 5-8 > mins, 10Gbps = 1.25 GB write, and would like to drive it for 5-8 mins > which would be 400-500 GB. > > Note this is just a "test" server therefore it does not need fault > tolerance. > > Thanks in advance, > Eric I'm sure there are others with more experience on this, but if you don't need failt tolerance, a bunch of fast disks in striping-mode (so-called RAID-0) on seperated channels (eg. different PCI-Express channels) would be my first step. Alternatively, if you don't care if the data is actually stored, couldn't you process it with a program that does a checksum over the data transmitted and then ignores/forgets it? (eg. forget about disk-storage and do it all in memory?) -- Joost