X-Original-To: pgsql-performance-postgresql.org@postgresql.org Received: from localhost (mx1.hub.org [200.46.208.251]) by postgresql.org (Postfix) with ESMTP id 249AA9FB23B for ; Wed, 2 Aug 2006 18:26:58 -0300 (ADT) Received: from postgresql.org ([200.46.204.71]) by localhost (mx1.hub.org [200.46.208.251]) (amavisd-new, port 10024) with ESMTP id 89612-05 for ; Wed, 2 Aug 2006 18:26:45 -0300 (ADT) X-Greylist: domain auto-whitelisted by SQLgrey- Received: from nf-out-0910.google.com (nf-out-0910.google.com [64.233.182.187]) by postgresql.org (Postfix) with ESMTP id 7A0B79FB233 for ; Wed, 2 Aug 2006 18:26:44 -0300 (ADT) Received: by nf-out-0910.google.com with SMTP id p77so806510nfc for ; Wed, 02 Aug 2006 14:26:39 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:references; b=uOCU7tCYoMmYWkebSdZ4qDKrbhLwURwrLaZNBognpdiKgCZD0yIlHCAH1bMXDtBntop7YkwH5K7YeCMSwAE4SQ0kaNFZVZnILglHOB0X/+Ruq4GTSE1/LW23QsqUm1CxLxME1zsDHJBfhvqDHqKExGoRunujaMMWMJFwv9uNwso= Received: by 10.78.145.5 with SMTP id s5mr365108hud; Wed, 02 Aug 2006 14:26:39 -0700 (PDT) Received: by 10.78.33.3 with HTTP; Wed, 2 Aug 2006 14:26:39 -0700 (PDT) Message-ID: <721b21dc0608021426p26d2a79ap37e0f55b2328b453@mail.gmail.com> Date: Wed, 2 Aug 2006 14:26:39 -0700 From: "Steve Poe" To: "Milen Kulev" Subject: Re: XFS filessystem for Datawarehousing Cc: pgsql-performance@postgresql.org In-Reply-To: <01cb01c6b676$8ef67330$0a00a8c0@trivadis.com> MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_111974_21094075.1154553999435" References: <01cb01c6b676$8ef67330$0a00a8c0@trivadis.com> X-Virus-Scanned: Maia Mailguard 1.0.1 X-Spam-Status: No, hits=0 tagged_above=0 required=5 tests=HTML_MESSAGE, SPF_PASS X-Spam-Level: X-Archive-Number: 200608/28 X-Sequence-Number: 20213 ------=_Part_111974_21094075.1154553999435 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline Milen, For the past year, I have been running odbc-bench on a dual-opteron with 4GB of RAM using a 8GB sample data. I found the performance difference between EXT3, JFS, and XFS is +/- 5-8%. This could be written-off as "noise" just for normal server performance flux. If you plan on using the default kernel, ext3 will likely perform best (what I found). When I added my own kernel, ext3 performed fair. What I've had to consider is what does each file system offer me as far as data integrity goes. You'll find greater ROI on performance by investing your time in other areas than chasing down a few percentage point (like I have done). If you could borrow more RAM and/or more discs for your tests, Testing newer kernels and read-ahead patches may benefit you as well. Best of luck. Steve Poe On 8/2/06, Milen Kulev wrote: > > Hi Like, Mark , Alvaro and Andrew, > > Thank you very much for sharing you experience with me. > I want to compare DHW performance of PG/Bizgres on different filesystems > and difffrent > Block sizes. > > The hardware will be free for me in a week or too (at a moment another > project is running on it) and then I will test > diffrenet setups and will post the results. > > I MUST (sorry, no other choice) use SLES6 R3, 64 bit. I am not sure at all > that I will get enough budget to get > approapriate RAID controller, and that is why I intent to use software > RAID. > > I am pretty exited whether XFS will clearly outpertform ETX3 (no default > setups for both are planned !). I am not sure > whether is it worth to include JFS in comparison too ... > > > Best Regards, > Milen Kulev > > -----Original Message----- > From: Luke Lonergan [mailto:llonergan@greenplum.com] > Sent: Wednesday, August 02, 2006 4:43 AM > To: Milen Kulev; pgsql-performance@postgresql.org > Subject: Re: [PERFORM] XFS filessystem for Datawarehousing > > > Milen, > > On 8/1/06 2:49 PM, "Milen Kulev" wrote: > > > Is anyone using XFS for storing/retrieving relatively large amount of > > data (~ 200GB)? > > I concur with the previous poster's experiences with one additional > observation: > > We have had instabilities with XFS with software RAID (md) on 32-bit Xeons > running RedHat4 U3 with the Centos 4.3 > unsupported SMP kernel. XFS would occasionally kernel panic under load. > > We have had no problems with XFS running on the same OS/kernel on 64-bit > under heavy workloads for weeks of continuous > usage. Each server (of 16 > total) had four XFS filesystems, each with 250GB of table data (no > indexes) on them, total of 16 Terabytes. We tested > with the TPC-H schema and queries. > > We use the default settings for XFS. > > Also - be aware that LVM has a serious performance bottleneck at about > 600MB/s - if you are working below that > threshold, you may not notice the issue, maybe some increase in CPU > consumption as you approach it. > > - Luke > > > > ---------------------------(end of broadcast)--------------------------- > TIP 3: Have you checked our extensive FAQ? > > http://www.postgresql.org/docs/faq > ------=_Part_111974_21094075.1154553999435 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline Milen,

For the past  year, I have been running odbc-bench on a dual-opteron with 4GB of RAM using a 8GB sample data. I found the performance difference between EXT3, JFS, and XFS  is +/- 5-8%. This could be written-off as "noise" just for normal server performance flux. If you plan on using the default kernel, ext3 will likely perform best (what I found). When I added my own kernel, ext3 performed fair. What I've had to consider is what does each file system offer me as far as  data integrity goes. 

You'll find greater ROI on performance by investing your time in other areas than chasing down a few percentage point (like I have done).  If you could borrow more RAM and/or more discs for your tests,  Testing newer kernels and read-ahead patches may benefit you as well.

Best of luck.

Steve Poe



On 8/2/06, Milen Kulev <makulev@gmx.net> wrote:
Hi Like, Mark , Alvaro and Andrew,

Thank you very much for sharing you experience with me.
I want to compare DHW performance of PG/Bizgres on different filesystems and difffrent
Block sizes.

The hardware will be free for me in a week or too (at a moment another project is running on it) and then I will test
diffrenet setups and will post the results.

I MUST (sorry, no other choice) use SLES6 R3, 64 bit. I am not sure at all that I will get enough budget to get
approapriate RAID controller, and that is why I intent to use software RAID.

I am pretty exited whether XFS will clearly outpertform ETX3 (no default setups for both are planned !).  I am not sure
whether is it worth to include JFS in comparison too ...


Best  Regards,
Milen Kulev

-----Original Message-----
From: Luke Lonergan [mailto: llonergan@greenplum.com]
Sent: Wednesday, August 02, 2006 4:43 AM
To: Milen Kulev; pgsql-performance@postgresql.org
Subject: Re: [PERFORM] XFS filessystem for Datawarehousing


Milen,

On 8/1/06 2:49 PM, "Milen Kulev" <makulev@gmx.net> wrote:

> Is anyone using XFS for storing/retrieving relatively large amount of
> data  (~ 200GB)?

I concur with the previous poster's experiences with one additional
observation:

We have had instabilities with XFS with software RAID (md) on 32-bit Xeons running RedHat4 U3 with the Centos 4.3
unsupported SMP kernel.  XFS would occasionally kernel panic under load.

We have had no problems with XFS running on the same OS/kernel on 64-bit under heavy workloads for weeks of continuous
usage.  Each server (of 16
total) had four XFS filesystems, each with 250GB of table data (no indexes) on them, total of 16 Terabytes.  We tested
with the TPC-H schema and queries.

We use the default settings for XFS.

Also - be aware that LVM has a serious performance bottleneck at about 600MB/s - if you are working below that
threshold, you may not notice the issue, maybe some increase in CPU consumption as you approach it.

- Luke



---------------------------(end of broadcast)---------------------------
TIP 3: Have you checked our extensive FAQ?

               http://www.postgresql.org/docs/faq

------=_Part_111974_21094075.1154553999435--