Received: from maia.hub.org (maia-3.hub.org [200.46.204.243]) by mail.postgresql.org (Postfix) with ESMTP id 354E16330F6 for ; Fri, 4 Jun 2010 15:44:29 -0300 (ADT) Received: from mail.postgresql.org ([200.46.204.86]) by maia.hub.org (mx1.hub.org [200.46.204.243]) (amavisd-maia, port 10024) with ESMTP id 30035-07 for ; Fri, 4 Jun 2010 18:44:21 +0000 (UTC) X-Greylist: from auto-whitelisted by SQLgrey-1.7.6 Received: from mtu.net (mtu.net [204.11.35.17]) by mail.postgresql.org (Postfix) with ESMTP id B918F632D31 for ; Fri, 4 Jun 2010 15:44:21 -0300 (ADT) Received: from localhost (localhost [127.0.0.1]) by mtu.net (Postfix) with ESMTP id ED8FB143E517; Fri, 4 Jun 2010 14:44:20 -0400 (EDT) X-Virus-Scanned: Debian amavisd-new at mtu.net Received: from mtu.net ([127.0.0.1]) by localhost (mtu.net [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 1KIp4W02vHBA; Fri, 4 Jun 2010 14:44:19 -0400 (EDT) Received: from min-dhcp33-251-158.bbn.com (75-149-146-105-Minnesota.hfc.comcastbusiness.net [75.149.146.105]) (Authenticated sender: jpschewe) by mtu.net (Postfix) with ESMTPSA id 116E8143E516; Fri, 4 Jun 2010 14:44:19 -0400 (EDT) Message-ID: <4C094982.4040203@mtu.net> Date: Fri, 04 Jun 2010 13:44:18 -0500 From: Jon Schewe User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.1.9) Gecko/20100317 Lightning/1.0b1 Thunderbird/3.0.4 MIME-Version: 1.0 To: Bryan Hinton CC: Andres Freund , Tom Lane , pgsql-performance@postgresql.org Subject: Re: How filesystems matter with PostgreSQL References: <4C08EEDF.7090403@mtu.net> <201006041504.03218.andres@anarazel.de> <2503.1275661530@sss.pgh.pa.us> <201006041633.23343.andres@anarazel.de> <4C094553.7040000@mtu.net> In-Reply-To: X-Enigmail-Version: 1.0.1 Content-Type: multipart/alternative; boundary="------------080004030307080802030403" X-Virus-Scanned: Maia Mailguard 1.0.1 X-Spam-Status: No, hits=-0.509 tagged_above=-10 required=5 tests=BAYES_05=-0.5, HTML_MESSAGE=0.001, T_RP_MATCHES_RCVD=-0.01 X-Spam-Level: X-Archive-Number: 201006/104 X-Sequence-Number: 38960 This is a multi-part message in MIME format. --------------080004030307080802030403 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit I just used standard mkfs for each filesystem and mounted them without options, unless otherwise specified. On 6/4/10 1:37 PM, Bryan Hinton wrote: > What types of journaling on each fs? > > > On Fri, Jun 4, 2010 at 1:26 PM, Jon Schewe > wrote: > > On 6/4/10 9:33 AM, Andres Freund wrote: > > On Friday 04 June 2010 16:25:30 Tom Lane wrote: > > > >> Andres Freund > > writes: > >> > >>> On Friday 04 June 2010 14:17:35 Jon Schewe wrote: > >>> > >>>> XFS (logbufs=8): ~4 hours to finish > >>>> ext4: ~1 hour 50 minutes to finish > >>>> ext3: 15 minutes to finish > >>>> ext3 on LVM: 15 minutes to finish > >>>> > >>> My guess is that some of the difference comes from barrier > differences. > >>> ext4 uses barriers by default, ext3 does not. > >>> > >> Or, to put it more clearly: the reason ext3 is fast is that > it's unsafe. > >> > > Jon: To verify you can enable it via the barrier=1 option during > mounting.. > > > > > > > First some details: > Linux kernel 2.6.31 > postgres version: 8.4.2 > > More test results: > reiserfs: ~1 hour 50 minutes > ext3 barrier=1: ~15 minutes > ext4 nobarrier: ~15 minutes > jfs: ~15 minutes > > -- > Jon Schewe | http://mtu.net/~jpschewe > If you see an attachment named signature.asc, this is my digital > signature. See http://www.gnupg.org for more information. > > > -- > Sent via pgsql-performance mailing list > (pgsql-performance@postgresql.org > ) > To make changes to your subscription: > http://www.postgresql.org/mailpref/pgsql-performance > > -- Jon Schewe | http://mtu.net/~jpschewe If you see an attachment named signature.asc, this is my digital signature. See http://www.gnupg.org for more information. --------------080004030307080802030403 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 7bit I just used standard mkfs for each filesystem and mounted them without options, unless otherwise specified.

On 6/4/10 1:37 PM, Bryan Hinton wrote:
What types of journaling on each fs?


On Fri, Jun 4, 2010 at 1:26 PM, Jon Schewe <jpschewe@mtu.net> wrote:
On 6/4/10 9:33 AM, Andres Freund wrote:
> On Friday 04 June 2010 16:25:30 Tom Lane wrote:
>
>> Andres Freund <andres@anarazel.de> writes:
>>
>>> On Friday 04 June 2010 14:17:35 Jon Schewe wrote:
>>>
>>>> XFS (logbufs=8): ~4 hours to finish
>>>> ext4: ~1 hour 50 minutes to finish
>>>> ext3: 15 minutes to finish
>>>> ext3 on LVM: 15 minutes to finish
>>>>
>>> My guess is that some of the difference comes from barrier differences.
>>> ext4 uses barriers by default, ext3 does not.
>>>
>> Or, to put it more clearly: the reason ext3 is fast is that it's unsafe.
>>
> Jon: To verify you can enable it via the barrier=1 option during mounting..
>
>
>
First some details:
Linux kernel 2.6.31
postgres version: 8.4.2

More test results:
reiserfs: ~1 hour 50 minutes
ext3 barrier=1: ~15 minutes
ext4 nobarrier: ~15 minutes
jfs: ~15 minutes

--
Jon Schewe | http://mtu.net/~jpschewe
If you see an attachment named signature.asc, this is my digital
signature. See http://www.gnupg.org for more information.


--
Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-performance


-- 
Jon Schewe | http://mtu.net/~jpschewe
If you see an attachment named signature.asc, this is my digital
signature. See http://www.gnupg.org for more information.
--------------080004030307080802030403--