Received: from maia.hub.org (maia-2.hub.org [200.46.204.251]) by mail.postgresql.org (Postfix) with ESMTP id C330C632C85 for ; Fri, 4 Jun 2010 15:26:37 -0300 (ADT) Received: from mail.postgresql.org ([200.46.204.86]) by maia.hub.org (mx1.hub.org [200.46.204.251]) (amavisd-maia, port 10024) with ESMTP id 63910-02 for ; Fri, 4 Jun 2010 18:26:30 +0000 (UTC) X-Greylist: from auto-whitelisted by SQLgrey-1.7.6 Received: from mtu.net (mtu.net [204.11.35.17]) by mail.postgresql.org (Postfix) with ESMTP id 96F96632978 for ; Fri, 4 Jun 2010 15:26:30 -0300 (ADT) Received: from localhost (localhost [127.0.0.1]) by mtu.net (Postfix) with ESMTP id D784E143E518; Fri, 4 Jun 2010 14:26:29 -0400 (EDT) X-Virus-Scanned: Debian amavisd-new at mtu.net Received: from mtu.net ([127.0.0.1]) by localhost (mtu.net [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id UPK0QuGXxzff; Fri, 4 Jun 2010 14:26:28 -0400 (EDT) Received: from min-dhcp33-251-158.bbn.com (75-149-146-105-Minnesota.hfc.comcastbusiness.net [75.149.146.105]) (Authenticated sender: jpschewe) by mtu.net (Postfix) with ESMTPSA id E45D6143E516; Fri, 4 Jun 2010 14:26:27 -0400 (EDT) Message-ID: <4C094553.7040000@mtu.net> Date: Fri, 04 Jun 2010 13:26:27 -0500 From: Jon Schewe User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.1.9) Gecko/20100317 Lightning/1.0b1 Thunderbird/3.0.4 MIME-Version: 1.0 To: Andres Freund CC: Tom Lane , pgsql-performance@postgresql.org Subject: Re: How filesystems matter with PostgreSQL References: <4C08EEDF.7090403@mtu.net> <201006041504.03218.andres@anarazel.de> <2503.1275661530@sss.pgh.pa.us> <201006041633.23343.andres@anarazel.de> In-Reply-To: <201006041633.23343.andres@anarazel.de> X-Enigmail-Version: 1.0.1 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Virus-Scanned: Maia Mailguard 1.0.1 X-Spam-Status: No, hits=0.79 tagged_above=-10 required=5 tests=BAYES_50=0.8, T_RP_MATCHES_RCVD=-0.01 X-Spam-Level: X-Archive-Number: 201006/102 X-Sequence-Number: 38958 On 6/4/10 9:33 AM, Andres Freund wrote: > On Friday 04 June 2010 16:25:30 Tom Lane wrote: > >> Andres Freund writes: >> >>> On Friday 04 June 2010 14:17:35 Jon Schewe wrote: >>> >>>> XFS (logbufs=8): ~4 hours to finish >>>> ext4: ~1 hour 50 minutes to finish >>>> ext3: 15 minutes to finish >>>> ext3 on LVM: 15 minutes to finish >>>> >>> My guess is that some of the difference comes from barrier differences. >>> ext4 uses barriers by default, ext3 does not. >>> >> Or, to put it more clearly: the reason ext3 is fast is that it's unsafe. >> > Jon: To verify you can enable it via the barrier=1 option during mounting.. > > > First some details: Linux kernel 2.6.31 postgres version: 8.4.2 More test results: reiserfs: ~1 hour 50 minutes ext3 barrier=1: ~15 minutes ext4 nobarrier: ~15 minutes jfs: ~15 minutes -- Jon Schewe | http://mtu.net/~jpschewe If you see an attachment named signature.asc, this is my digital signature. See http://www.gnupg.org for more information.