Received: from maia.hub.org (maia-5.hub.org [200.46.204.29]) by mail.postgresql.org (Postfix) with ESMTP id CBBE063259F for ; Tue, 17 Aug 2010 05:42:52 -0300 (ADT) Received: from mail.postgresql.org ([200.46.204.86]) by maia.hub.org (mx1.hub.org [200.46.204.29]) (amavisd-maia, port 10024) with ESMTP id 32172-09 for ; Tue, 17 Aug 2010 08:42:44 +0000 (UTC) X-Greylist: from auto-whitelisted by SQLgrey-1.7.6 Received: from moutng.kundenserver.de (moutng.kundenserver.de [212.227.17.10]) by mail.postgresql.org (Postfix) with ESMTP id 9B8B063245F for ; Tue, 17 Aug 2010 05:42:43 -0300 (ADT) Received: from [192.168.1.151] (static-71-179-240-8.bltmmd.fios.verizon.net [71.179.240.8]) by mrelayeu.kundenserver.de (node=mrbap1) with ESMTP (Nemesis) id 0MP1NP-1OqWo80g5v-006J7V; Tue, 17 Aug 2010 10:42:28 +0200 Message-ID: <4C6A4B71.5040909@2ndquadrant.com> Date: Tue, 17 Aug 2010 04:42:25 -0400 From: Greg Smith User-Agent: Thunderbird 2.0.0.24 (X11/20100317) MIME-Version: 1.0 To: Bruce Momjian CC: Scott Carey , Kenneth Cox , "pgsql-performance@postgresql.org" Subject: Re: Advice configuring ServeRAID 8k for performance References: <201008170131.o7H1VPc26427@momjian.us> In-Reply-To: <201008170131.o7H1VPc26427@momjian.us> Content-Type: multipart/alternative; boundary="------------010204030706020301090807" X-Provags-ID: V02:K0:WrJ9jA1KOf2Ex+5tYJMxWO2REe37A39KmJJk8HqHTp8 pxJqQOieaENDZoBDZQPl+/JsiknmcP8wyz+K42dWZanU92xGc0 hQnijRewhQOoibC8eU5ErTmqvqxwXZrwtOZjb8SdZqd7giBFVh MjpxIHAutzzAQPB6R+/DoI2h6DFB/QxgaeKDfCqUl4swOwXgZ/ s4j2HI7A4iiXKKlEiLgo6PIgHEAUuivpDAJolUeQNA= X-Virus-Scanned: Maia Mailguard 1.0.1 X-Spam-Status: No, hits=-1.899 tagged_above=-10 required=5 tests=BAYES_00=-1.9, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001 X-Spam-Level: X-Archive-Number: 201008/171 X-Sequence-Number: 40014 This is a multi-part message in MIME format. --------------010204030706020301090807 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Bruce Momjian wrote: > Scott Carey wrote: > >> Don't ever have WAL and data on the same OS volume as ext3. >> >> ... >> One partition for WAL, one for data. If using ext3 this is essentially >> a performance requirement no matter how your array is set up underneath. >> > > Do we need to document this? > Not for 9.0. What Scott is suggesting is often the case, but not always; I can produce a counter example at will now that I know exactly which closets have the skeletons in them. The underlying situation is more complicated due to some limitations to the whole "spread checkpoint" code that is turning really sour on newer hardware with large amounts of RAM. I have about 5 pages of written notes on this specific issue so far, and that keeps growing every week. That's all leading toward a proposed 9.1 change to the specific fsync behavior. And I expect to dump a large stack of documentation to support that patch that will address this whole area. I'll put the whole thing onto the wiki as soon as my 9.0 related work settles down. -- Greg Smith 2ndQuadrant US Baltimore, MD PostgreSQL Training, Services and Support greg@2ndQuadrant.com www.2ndQuadrant.us --------------010204030706020301090807 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Bruce Momjian wrote:
Scott Carey wrote:
  
Don't ever have WAL and data on the same OS volume as ext3.

...
One partition for WAL, one for data.  If using ext3 this is essentially
a performance requirement no matter how your array is set up underneath.
    

Do we need to document this?
  

Not for 9.0.  What Scott is suggesting is often the case, but not always; I can produce a counter example at will now that I know exactly which closets have the skeletons in them.  The underlying situation is more complicated due to some limitations to the whole "spread checkpoint" code that is turning really sour on newer hardware with large amounts of RAM.  I have about 5 pages of written notes on this specific issue so far, and that keeps growing every week.  That's all leading toward a proposed 9.1 change to the specific fsync behavior.  And I expect to dump a large stack of documentation to support that patch that will address this whole area.  I'll put the whole thing onto the wiki as soon as my 9.0 related work settles down.

-- 
Greg Smith  2ndQuadrant US  Baltimore, MD
PostgreSQL Training, Services and Support
greg@2ndQuadrant.com   www.2ndQuadrant.us
--------------010204030706020301090807--