X-Original-To: pgsql-performance-postgresql.org@postgresql.org Received: from localhost (mx1.hub.org [200.46.208.251]) by postgresql.org (Postfix) with ESMTP id E01179FB314 for ; Fri, 4 Aug 2006 17:44:57 -0300 (ADT) Received: from postgresql.org ([200.46.204.71]) by localhost (mx1.hub.org [200.46.208.251]) (amavisd-new, port 10024) with ESMTP id 97534-01 for ; Fri, 4 Aug 2006 17:44:52 -0300 (ADT) X-Greylist: from auto-whitelisted by SQLgrey- Received: from noel.decibel.org (noel.decibel.org [67.100.216.10]) by postgresql.org (Postfix) with ESMTP id 41C6F9FB311 for ; Fri, 4 Aug 2006 17:44:52 -0300 (ADT) Received: by noel.decibel.org (Postfix, from userid 1001) id E40B056431; Fri, 4 Aug 2006 15:44:50 -0500 (CDT) Received: (hashcash-sendmail, from uid 1001); Fri, 4 Aug 2006 15:44:50 -0500 Date: Fri, 4 Aug 2006 15:44:50 -0500 From: "Jim C. Nasby" To: "J. Andrew Rogers" , Milen Kulev , "Pgsql-Performance ((E-mail))" Subject: Re: XFS filessystem for Datawarehousing Message-ID: <20060804204450.GS40481@pervasive.com> References: <012d01c6b5b4$6db33680$0a00a8c0@trivadis.com> <20060802004223.GE20401@alvh.no-ip.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20060802004223.GE20401@alvh.no-ip.org> X-Operating-System: FreeBSD 6.0-RELEASE-p4 amd64 X-Distributed: Join the Effort! http://www.distributed.net User-Agent: Mutt/1.5.11 X-Hashcash: 1:20:060804:jrogers@neopolitan.com::495ltA9zZsMTV3qs:000000000000000 0000000000000000000000002bmg X-Hashcash: 1:20:060804:makulev@gmx.net::Cbm4BoHmEP038QSW:0000Ox X-Hashcash: 1:20:060804:pgsql-performance@postgresql.org::E8AfLymFxF6b+Yao:00000 0000000000000000000000004O2F X-Virus-Scanned: Maia Mailguard 1.0.1 X-Spam-Status: No, hits=0.052 tagged_above=0 required=5 tests=AWL X-Spam-Level: X-Archive-Number: 200608/57 X-Sequence-Number: 20242 On Tue, Aug 01, 2006 at 08:42:23PM -0400, Alvaro Herrera wrote: > J. Andrew Rogers wrote: > > > > On Aug 1, 2006, at 2:49 PM, Milen Kulev wrote: > > >Is anyone using XFS for storing/retrieving relatively large amount > > >of data (~ 200GB)? > > > > > > Yes, we've been using it on Linux since v2.4 (currently v2.6) and it > > has been rock solid on our database servers (Opterons, running in > > both 32-bit and 64-bit mode). Our databases are not quite 200GB > > (maybe 75GB for a big one currently), but ballpark enough that the > > experience is probably valid. We also have a few terabyte+ non- > > database XFS file servers too. > > > > Performance has been very good even with nearly full file systems, > > and reliability has been perfect so far. Some of those file systems > > get used pretty hard for months or years non-stop. Comparatively, I > > can only tell you that XFS tends to be significantly faster than > > Ext3, but we never did any serious file system tuning either. > > Most likely ext3 was used on the default configuration, which logs data > operations as well as metadata, which is what XFS logs. I don't think > I've seen any credible comparison between XFS and ext3 with the > metadata-only journal option. > > On the other hand I don't think it makes sense to journal data on a > PostgreSQL environment. Metadata is enough, given that we log data on > WAL anyway. Actually, according to http://en.wikipedia.org/wiki/Ext3 the default journalling option for ext3 isn't to journal the data (which is actually data=journal), but to wait until the data is written before considering the metadata to be committed (data=ordered). -- Jim C. Nasby, Sr. Engineering Consultant jnasby@pervasive.com Pervasive Software http://pervasive.com work: 512-231-6117 vcard: http://jim.nasby.net/pervasive.vcf cell: 512-569-9461