X-Original-To: pgsql-performance-postgresql.org@localhost.postgresql.org Received: from localhost (unknown [200.46.204.144]) by svr1.postgresql.org (Postfix) with ESMTP id 2C3F3535C1 for ; Thu, 24 Mar 2005 14:05:24 +0000 (GMT) Received: from svr1.postgresql.org ([200.46.204.71]) by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024) with ESMTP id 25882-08 for ; Thu, 24 Mar 2005 14:05:18 +0000 (GMT) Received: from felix.adpcl.com (felix.adpcl.com [194.98.137.100]) by svr1.postgresql.org (Postfix) with ESMTP id 953AD535A3 for ; Thu, 24 Mar 2005 14:05:16 +0000 (GMT) Received: from pcpatrickxp (unknown [150.175.11.30]) by felix.adpcl.com (Postfix) with SMTP id 31DB17812; Thu, 24 Mar 2005 15:08:22 +0100 (NFT) Message-ID: <013501c5307a$58bea680$1e0baf96@pcpatrickxp> From: "Patrick Vedrines" To: =?iso-8859-1?Q?Gustavo_Franklin_N=F3brega_-_Planae?= Cc: "performance pgsql" References: <002601c52f0a$2312a4d0$280baf96@PCPATRICK> <424063BC.3050206@planae.com.br> <004d01c53054$965583e0$1e0baf96@pcpatrickxp> <4242A9EF.7070005@planae.com.br> Subject: Re: CPU 0.1% IOWAIT 99% for decisonnal queries Date: Thu, 24 Mar 2005 15:04:08 +0100 MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_NextPart_000_0132_01C53082.BA68F6D0" X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2800.1437 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1441 X-Virus-Scanned: by amavisd-new at hub.org X-Spam-Status: No, hits=0.23 tagged_above=0 required=5 tests=AWL, HTML_50_60, HTML_MESSAGE, HTML_TITLE_EMPTY X-Spam-Level: X-Archive-Number: 200503/508 X-Sequence-Number: 11213 This is a multi-part message in MIME format. ------=_NextPart_000_0132_01C53082.BA68F6D0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Great ! I'm not an expert but as far as I know, my 15 databases are spread over = 4 SCSI RAID disks 73 GB 10K RPM mounted under ext3 mode.=20 I remember that they where provided by DELL under RAID5 and I asked my = system engineer for switching them to standard SCSI because I don't care = about security but only about speed and capacity ( maybe this switch was = not set properly at this time...). Thank you for these interesting links: I 've sent them to my system = engineer with my two hands ! Amicalement Patrick ----- Original Message -----=20 From: Gustavo Franklin N=F3brega - Planae=20 To: Patrick Vedrines=20 Cc: performance pgsql=20 Sent: Thursday, March 24, 2005 12:52 PM Subject: Re: [PERFORM] CPU 0.1% IOWAIT 99% for decisonnal queries Good day Patrick! =20 I can help you to design you disk layout for better perform and = security. Please, tell me how many disks (and some specs, like capacity = and RPM). If you want to know more, there is a very interesting article abou = benckmark filesystem ( http://linuxgazette.net/102/piszcz.html ). In = this article, ReiserFS 3.6, JFS and XFS are in the same level at top = depending your application, and ext3 is more slow than others. I believe = that version 4 of the ReiserFS is better that version 3.6, but I could = not still test it. Raid0 (striping, more at = http://www.pcguide.com/ref/hdd/perf/raid/levels/singleLevel0-c.html) or = Raid 0+1 (stripping + mirror, more at = http://www.pcguide.com/ref/hdd/perf/raid/levels/multLevel01-c.html) is = very insteresting to postgresql. Raid0 provides only performance, and = Raid 0+1 provides performance and security. Take a look at this articles = and think about to use Raid (http://www.pcguide.com/ref/hdd/perf/raid/). I'm glad to help. Best regards! Atenciosamente, Gustavo Franklin N=F3brega Infraestrutura e Banco de Dados Planae Tecnologia da Informa=E7=E3o (+55) 14 3106-3514 http://www.planae.com.br Patrick Vedrines wrote:=20 Hello Gustavo, Your question seems to say that you suspect a disk issue, and a few = hours later, Simon told me "Sounds like your disks/layout/something is = pretty sick". To be clear in my own mind about it, I've just copyed (time cp) the = "aggregate" table files (4 Gb) from one disk to an another one: it takes = 22 mn !(3 Mb/s). That seems to demonstrate that Postgres is not the cause of this = issue.=20 I've just untrusted to my system engineer the analysis of my = disks... In case I would have to change my disks, do you have any performance = figures related to the types you mentionned (reiserfs vs ext3) ? I don't use RAID since the security is not a concern. Thank a lot for your help ! Patrick Hi Patrick, How is configured your disk array? Do you have a Perc 4? Tip: Use reiserfs instead ext3, raid 0+1 and deadline I/O = scheduler in kernel linux 2.6 ------=_NextPart_000_0132_01C53082.BA68F6D0 Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable
Great !
 
I'm not an expert but as far as I know, = my 15=20 databases are spread over 4 SCSI RAID disks 73 GB 10K RPM mounted under = ext3=20 mode. 
I remember that they where provided by = DELL under=20 RAID5 and I asked my system engineer for switching them to standard = SCSI=20 because I don't care about security but only about speed and capacity ( = maybe=20 this switch was not set properly at this time...).
 
Thank you for these interesting links: = I 've sent=20 them to my system engineer with my two hands !
 
Amicalement
 
Patrick
----- Original Message -----
From:=20 Gustavo=20 Franklin N=F3brega - Planae
Cc: performance pgsql =
Sent: Thursday, March 24, 2005 = 12:52=20 PM
Subject: Re: [PERFORM] CPU 0.1% = IOWAIT=20 99% for decisonnal queries

Good day Patrick!
    =
   =20 I can help you to design you disk layout for better perform and = security.=20 Please, tell me how many disks (and some specs, like capacity and=20 RPM).

    If you want to know more, there is a = very=20 interesting article abou benckmark filesystem ( http://linuxgazette.net/= 102/piszcz.html=20 ). In this article, ReiserFS 3.6, JFS and XFS are in the same level at = top=20 depending your application, and ext3 is more slow than others. I = believe that=20 version 4 of the ReiserFS is better that version 3.6, but I could not = still=20 test it.

    Raid0 (striping, more at http://www.pcguide.com/ref/hdd/perf/raid/levels/singleLevel0-c.html)=20 or Raid 0+1 (stripping + mirror, more at http://www.pcguide.com/ref/hdd/perf/raid/levels/multLevel01-c.html= )=20 is very insteresting to postgresql. Raid0 provides only performance, = and Raid=20 0+1 provides performance and security. Take a look at this articles = and think=20 about to use Raid (http://www.pcguide.com= /ref/hdd/perf/raid/).

   =20 I'm glad to help. Best regards!
Atenciosamente,

Gustavo Franklin N=F3brega
Infraestrutura e Banco de Dados
Planae Tecnologia da Informa=E7=E3o
(+55) 14 3106-3514
http://www.planae.com.br



Patrick Vedrines wrote:=20
Hello Gustavo,
 
Your question seems to say that you = suspect a=20 disk issue, and a few hours later, Simon told me "Sounds like your=20 disks/layout/something is pretty sick".
To be clear in my own mind about = it, I've just=20 copyed (time cp) the "aggregate" table files (4 Gb) from one disk to = an=20 another one: it takes 22 mn !(3 Mb/s).
That seems to demonstrate that = Postgres is not=20 the cause of this issue.
I've just untrusted to my system=20 engineer the analysis of my disks...
 
In case I would have to change my = disks, do you=20 have any performance figures related to the types you = mentionned=20 (reiserfs vs ext3) ?
I don't use RAID since the security = is not a=20 concern.
 
Thank a lot for your help = !
 
Patrick
 Hi=20 Patrick,

    How is configured your disk = array? Do=20 you have a Perc 4?

Tip: Use reiserfs instead ext3, raid 0+1 = and=20 deadline I/O scheduler in kernel linux 2.6
 
------=_NextPart_000_0132_01C53082.BA68F6D0--