X-Original-To: pgsql-performance-postgresql.org@localhost.postgresql.org Received: from localhost (unknown [200.46.204.144]) by svr1.postgresql.org (Postfix) with ESMTP id 2815F53461 for ; Thu, 24 Mar 2005 14:29:26 +0000 (GMT) Received: from svr1.postgresql.org ([200.46.204.71]) by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024) with ESMTP id 34000-10 for ; Thu, 24 Mar 2005 14:29:16 +0000 (GMT) Received: from planae.com.br (nat.planae.com.br [200.210.129.190]) by svr1.postgresql.org (Postfix) with SMTP id 2F7D953432 for ; Thu, 24 Mar 2005 14:29:12 +0000 (GMT) Received: (qmail 41286 invoked by uid 1004); 24 Mar 2005 14:29:17 -0000 Received: from 192.168.0.215 by mercurio.planae.com.br (envelope-from , uid 0) with qmail-scanner-1.23 (uvscan: v4.3.20/v4453. Clear:RC:1(192.168.0.215):. Processed in 1.97883 secs); 24 Mar 2005 14:29:17 -0000 X-Qmail-Scanner-Mail-From: gfnobrega@planae.com.br via mercurio.planae.com.br X-Qmail-Scanner: 1.23 (Clear:RC:1(192.168.0.215):. Processed in 1.97883 secs) Received: from unknown (HELO ?192.168.0.215?) (gfnobrega@192.168.0.215) by 192.168.0.3 with SMTP; 24 Mar 2005 14:29:15 -0000 Message-ID: <4242CE8E.7060900@planae.com.br> Date: Thu, 24 Mar 2005 11:28:30 -0300 From: =?ISO-8859-1?Q?Gustavo_Franklin_N=F3brega_-_Planae?= User-Agent: Mozilla Thunderbird 0.9 (X11/20041127) X-Accept-Language: en-us, en MIME-Version: 1.0 To: Patrick Vedrines Cc: performance pgsql Subject: Re: CPU 0.1% IOWAIT 99% for decisonnal queries References: <002601c52f0a$2312a4d0$280baf96@PCPATRICK> <424063BC.3050206@planae.com.br> <004d01c53054$965583e0$1e0baf96@pcpatrickxp> <4242A9EF.7070005@planae.com.br> <013501c5307a$58bea680$1e0baf96@pcpatrickxp> In-Reply-To: <013501c5307a$58bea680$1e0baf96@pcpatrickxp> Content-Type: multipart/alternative; boundary="------------040004090102080601060001" X-Virus-Scanned: by amavisd-new at hub.org X-Spam-Status: No, hits=0.117 tagged_above=0 required=5 tests=AWL, HTML_50_60, HTML_MESSAGE, HTML_TITLE_EMPTY, RCVD_BY_IP X-Spam-Level: X-Archive-Number: 200503/510 X-Sequence-Number: 11215 This is a multi-part message in MIME format. --------------040004090102080601060001 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit Hi! I have a Dell PowerEdge 2600 with a Perc 4/DI and 4 scsi disks 35GB. I have made a array raid 0+1 with 4 disks, because is mission critical application. But, for your, you can configure a raid0, thats is faster than raid5 for 4 disks. Ask to your system enginner what is distribution of Linux is used, kernel version and if he does a kernel tuning for your hardware and application. Best regards. Atenciosamente, Gustavo Franklin Nóbrega Infraestrutura e Banco de Dados Planae Tecnologia da Informação (+55) 14 3106-3514 http://www.planae.com.br Patrick Vedrines wrote: > Great ! > > I'm not an expert but as far as I know, my 15 databases are spread > over 4 SCSI RAID disks 73 GB 10K RPM mounted under ext3 mode. > I remember that they where provided by DELL under RAID5 and I asked my > system engineer for switching them to standard SCSI because I don't > care about security but only about speed and capacity ( maybe this > switch was not set properly at this time...). > > Thank you for these interesting links: I 've sent them to my system > engineer with my two hands ! > > Amicalement > > Patrick > > ----- Original Message ----- > *From:* Gustavo Franklin Nóbrega - Planae > > *To:* Patrick Vedrines > *Cc:* performance pgsql > *Sent:* Thursday, March 24, 2005 12:52 PM > *Subject:* Re: [PERFORM] CPU 0.1% IOWAIT 99% for decisonnal queries > > Good day Patrick! > > I can help you to design you disk layout for better perform > and security. Please, tell me how many disks (and some specs, like > capacity and RPM). > > If you want to know more, there is a very interesting article > abou benckmark filesystem ( > http://linuxgazette.net/102/piszcz.html ). In this article, > ReiserFS 3.6, JFS and XFS are in the same level at top depending > your application, and ext3 is more slow than others. I believe > that version 4 of the ReiserFS is better that version 3.6, but I > could not still test it. > > Raid0 (striping, more at > http://www.pcguide.com/ref/hdd/perf/raid/levels/singleLevel0-c.html) > or Raid 0+1 (stripping + mirror, more at > http://www.pcguide.com/ref/hdd/perf/raid/levels/multLevel01-c.html) > is very insteresting to postgresql. Raid0 provides only > performance, and Raid 0+1 provides performance and security. Take > a look at this articles and think about to use Raid > (http://www.pcguide.com/ref/hdd/perf/raid/). > > I'm glad to help. Best regards! > >Atenciosamente, > >Gustavo Franklin Nóbrega >Infraestrutura e Banco de Dados >Planae Tecnologia da Informação >(+55) 14 3106-3514 >http://www.planae.com.br > > > > > > Patrick Vedrines wrote: > >> Hello Gustavo, >> >> Your question seems to say that you suspect a disk issue, and a >> few hours later, Simon told me "Sounds like your >> disks/layout/something is pretty sick". >> To be clear in my own mind about it, I've just copyed (time cp) >> the "aggregate" table files (4 Gb) from one disk to an another >> one: it takes 22 mn !(3 Mb/s). >> That seems to demonstrate that Postgres is not the cause of this >> issue. >> I've just untrusted to my system engineer the analysis of my disks... >> >> In case I would have to change my disks, do you have any >> performance figures related to the types you mentionned (reiserfs >> vs ext3) ? >> I don't use RAID since the security is not a concern. >> >> Thank a lot for your help ! >> >> Patrick >> >> >> Hi Patrick, >> >> How is configured your disk array? Do you have a Perc 4? >> >> Tip: Use reiserfs instead ext3, raid 0+1 and deadline I/O >> scheduler in kernel linux 2.6 >> >> >> --------------040004090102080601060001 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Hi!

    I have a Dell PowerEdge 2600 with a Perc 4/DI and 4 scsi disks 35GB. I have made a array raid 0+1 with 4 disks, because is mission critical application. But, for your,  you can configure a raid0, thats is faster than raid5 for 4 disks.

    Ask to your system enginner what is distribution of Linux is used, kernel version and if he does a kernel tuning for your hardware and application.

Best regards.
Atenciosamente,

Gustavo Franklin Nóbrega
Infraestrutura e Banco de Dados
Planae Tecnologia da Informação
(+55) 14 3106-3514
http://www.planae.com.br



Patrick Vedrines wrote:
Great !
 
I'm not an expert but as far as I know, my 15 databases are spread over 4 SCSI RAID disks 73 GB 10K RPM mounted under ext3 mode. 
I remember that they where provided by DELL under RAID5 and I asked my system engineer for switching them to standard SCSI because I don't care about security but only about speed and capacity ( maybe this switch was not set properly at this time...).
 
Thank you for these interesting links: I 've sent them to my system engineer with my two hands !
 
Amicalement
 
Patrick
----- Original Message -----
Sent: Thursday, March 24, 2005 12:52 PM
Subject: Re: [PERFORM] CPU 0.1% IOWAIT 99% for decisonnal queries

Good day Patrick!
   
    I can help you to design you disk layout for better perform and security. Please, tell me how many disks (and some specs, like capacity and RPM).

    If you want to know more, there is a very interesting article abou benckmark filesystem ( http://linuxgazette.net/102/piszcz.html ). In this article, ReiserFS 3.6, JFS and XFS are in the same level at top depending your application, and ext3 is more slow than others. I believe that version 4 of the ReiserFS is better that version 3.6, but I could not still test it.

    Raid0 (striping, more at http://www.pcguide.com/ref/hdd/perf/raid/levels/singleLevel0-c.html) or Raid 0+1 (stripping + mirror, more at http://www.pcguide.com/ref/hdd/perf/raid/levels/multLevel01-c.html) is very insteresting to postgresql. Raid0 provides only performance, and Raid 0+1 provides performance and security. Take a look at this articles and think about to use Raid (http://www.pcguide.com/ref/hdd/perf/raid/).

    I'm glad to help. Best regards!
Atenciosamente,

Gustavo Franklin Nóbrega
Infraestrutura e Banco de Dados
Planae Tecnologia da Informação
(+55) 14 3106-3514
http://www.planae.com.br

    


Patrick Vedrines wrote:
Hello Gustavo,
 
Your question seems to say that you suspect a disk issue, and a few hours later, Simon told me "Sounds like your disks/layout/something is pretty sick".
To be clear in my own mind about it, I've just copyed (time cp) the "aggregate" table files (4 Gb) from one disk to an another one: it takes 22 mn !(3 Mb/s).
That seems to demonstrate that Postgres is not the cause of this issue.
I've just untrusted to my system engineer the analysis of my disks...
 
In case I would have to change my disks, do you have any performance figures related to the types you mentionned (reiserfs vs ext3) ?
I don't use RAID since the security is not a concern.
 
Thank a lot for your help !
 
Patrick
 
Hi Patrick,

    How is configured your disk array? Do you have a Perc 4?

Tip: Use reiserfs instead ext3, raid 0+1 and deadline I/O scheduler in kernel linux 2.6
 
--------------040004090102080601060001--