Received: from localhost (maia-2.hub.org [200.46.204.187]) by postgresql.org (Postfix) with ESMTP id E21289FB36D for ; Thu, 8 Feb 2007 13:24:39 -0400 (AST) Received: from postgresql.org ([200.46.204.71]) by localhost (mx1.hub.org [200.46.204.187]) (amavisd-new, port 10024) with ESMTP id 77533-03-6 for ; Thu, 8 Feb 2007 13:24:24 -0400 (AST) X-Greylist: from auto-whitelisted by SQLgrey-1.7.4 Received: from server.linux27.com (server.linux27.com [72.232.77.42]) by postgresql.org (Postfix) with ESMTP id 287F79FB378 for ; Thu, 8 Feb 2007 13:19:34 -0400 (AST) Received: from [201.67.231.144] (helo=PC1) by server.linux27.com with esmtpa (Exim 4.63) (envelope-from ) id 1HFCvh-0006M4-4C for pgsql-performance@postgresql.org; Thu, 08 Feb 2007 15:19:32 -0200 Reply-To: From: "Carlos H. Reimer" To: Subject: Disk saturation Date: Thu, 8 Feb 2007 15:19:32 -0200 Message-ID: MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_NextPart_000_0014_01C74B94.888D67C0" X-Priority: 3 (Normal) X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook IMO, Build 9.0.2416 (9.0.2910.0) X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.3028 Importance: Normal X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - server.linux27.com X-AntiAbuse: Original Domain - postgresql.org X-AntiAbuse: Originator/Caller UID/GID - [0 0] / [47 12] X-AntiAbuse: Sender Address Domain - opendb.com.br X-Source: X-Source-Args: X-Source-Dir: X-Virus-Scanned: Maia Mailguard 1.0.1 X-Archive-Number: 200702/88 X-Sequence-Number: 23142 This is a multi-part message in MIME format. ------=_NextPart_000_0014_01C74B94.888D67C0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 8bit Hi, One of our database server is getting some very high response times and I´m wondering what can be responsible for this issue. A strange behaviour in this server is the saturation number iostat is giving, an average of 20% for only 140 wkB/s or can I consider them normal numbers? It is a Fedora Core release 4 (Stentz) box with 4 GB RAM and 2 GenuineIntel XEON CPU 3.20 GHz Cache: 1024 KB. In the disk subsystem we have two SCSI drives in hardware RAID1. Some typical iostat -x data: cpu-moy: %user %nice %sys %iowait %idle 11,96 0,00 7,04 1,31 79,70 Device: rrqm/s wrqm/s r/s w/s rsec/s wsec/s rkB/s wkB/s avgrq-sz avgqu-sz await svctm %util sda 0,00 30,44 0,81 3,43 14,52 270,97 7,26 135,48 67,43 0,19 46,05 7,29 3,08 cpu-moy: %user %nice %sys %iowait %idle 12,26 0,00 7,34 6,63 73,77 Device: rrqm/s wrqm/s r/s w/s rsec/s wsec/s rkB/s wkB/s avgrq-sz avgqu-sz await svctm %util sda 0,00 32,26 0,00 4,41 0,00 293,39 0,00 146,69 66,55 1,51 342,32 25,14 11,08 cpu-moy: %user %nice %sys %iowait %idle 13,67 0,00 6,83 7,74 71,76 Device: rrqm/s wrqm/s r/s w/s rsec/s wsec/s rkB/s wkB/s avgrq-sz avgqu-sz await svctm %util sda 0,00 31,99 0,00 3,82 0,00 286,52 0,00 143,26 74,95 2,93 767,58 55,84 21,35 cpu-moy: %user %nice %sys %iowait %idle 13,27 0,00 6,83 14,37 65,53 Device: rrqm/s wrqm/s r/s w/s rsec/s wsec/s rkB/s wkB/s avgrq-sz avgqu-sz await svctm %util sda 0,00 31,73 0,00 4,02 0,00 285,94 0,00 142,97 71,20 2,73 680,40 49,25 19,78 cpu-moy: %user %nice %sys %iowait %idle 12,86 0,00 6,33 9,45 71,36 Device: rrqm/s wrqm/s r/s w/s rsec/s wsec/s rkB/s wkB/s avgrq-sz avgqu-sz await svctm %util sda 0,00 30,92 0,00 3,41 0,00 274,70 0,00 137,35 80,47 2,33 681,35 57,53 19,64 cpu-moy: %user %nice %sys %iowait %idle 12,45 0,00 6,02 1,91 79,62 Device: rrqm/s wrqm/s r/s w/s rsec/s wsec/s rkB/s wkB/s avgrq-sz avgqu-sz await svctm %util sda 0,00 33,00 0,60 4,23 6,44 297,79 3,22 148,89 63,00 0,41 85,29 20,00 9,66 dmesg data: .... .... SCSI subsystem initialized Fusion MPT base driver 3.01.20 Copyright (c) 1999-2004 LSI Logic Corporation ACPI: PCI Interrupt 0000:02:04.0[A] -> GSI 42 (level, low) -> IRQ 185 mptbase: Initiating ioc0 bringup ioc0: 53C1030: Capabilities={Initiator,Target} Fusion MPT SCSI Host driver 3.01.20 scsi0 : ioc0: LSI53C1030, FwRev=01032300h, Ports=1, MaxQ=255, IRQ=185 input: AT Translated Set 2 keyboard on isa0060/serio0 input: AT Translated Set 2 keyboard on isa0060/serio0 megaraid cmm: 2.20.2.5 (Release Date: Fri Jan 21 00:01:03 EST 2005) megaraid: 2.20.4.5 (Release Date: Thu Feb 03 12:27:22 EST 2005) megaraid: probe new device 0x1000:0x1960:0x1028:0x0520: bus 2:slot 5:func 0 ACPI: PCI Interrupt 0000:02:05.0[A] -> GSI 37 (level, low) -> IRQ 193 megaraid: fw version:[351S] bios version:[1.10] scsi1 : LSI Logic MegaRAID driver scsi[1]: scanning scsi channel 0 [Phy 0] for non-raid devices Vendor: SDR Model: GEM318P Rev: 1 Type: Processor ANSI SCSI revision: 02 scsi[1]: scanning scsi channel 1 [virtual] for logical drives Vendor: MegaRAID Model: LD 0 RAID1 69G Rev: 351S Type: Direct-Access ANSI SCSI revision: 02 SCSI device sda: 143114240 512-byte hdwr sectors (73274 MB) sda: asking for cache data failed sda: assuming drive cache: write through SCSI device sda: 143114240 512-byte hdwr sectors (73274 MB) sda: asking for cache data failed sda: assuming drive cache: write through sda: sda1 sda2 sda3 sda4 < sda5 > Attached scsi disk sda at scsi1, channel 1, id 0, lun 0 libata version 1.10 loaded. ata_piix version 1.03 ACPI: PCI Interrupt 0000:00:1f.2[A] -> GSI 18 (level, low) -> IRQ 177 PCI: Setting latency timer of device 0000:00:1f.2 to 64 ata1: SATA max UDMA/133 cmd 0xBC98 ctl 0xBC92 bmdma 0xBC60 irq 177 ata2: SATA max UDMA/133 cmd 0xBC80 ctl 0xBC7A bmdma 0xBC68 irq 177 ata1: SATA port has no device. scsi2 : ata_piix ata2: SATA port has no device. scsi3 : ata_piix isa bounce pool size: 16 pages kjournald starting. Commit interval 5 seconds EXT3-fs: mounted filesystem with ordered data mode. SELinux: Disabled at runtime. SELinux: Unregistering netfilter hooks cfq: depth 4 reached, tagging now on Attached scsi generic sg0 at scsi1, channel 0, id 6, lun 0, type 3 Attached scsi generic sg1 at scsi1, channel 1, id 0, lun 0, type 0 Floppy drive(s): fd0 is 1.44M ... ... ... Thank you in advance! Reimer Reimer carlos.reimer@opendb.com.br OpenDB Serviços e Treinamentos PostgreSQL e DB2 Fone: 47 3327-0878 Cel: 47 9183-0547 www.opendb.com.br ------=_NextPart_000_0014_01C74B94.888D67C0 Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable
Hi,
 
One of=20 our database server is getting some very high response times and = I=B4m wondering what can be responsible for this=20 issue.
 
A = strange=20 behaviour in this server is the saturation number iostat is giving, an = average=20 of 20% for only 140 wkB/s or can I consider them normal=20 numbers?
 
It is a Fedora Core release 4 = (Stentz) box=20 with 4 GB RAM and 2 GenuineIntel XEON CPU 3.20 GHz Cache: 1024 = KB. In the disk=20 subsystem we have two SCSI drives in hardware = RAID1.
 
Some typical iostat -x = data:
cpu-moy:  %user  =20 %nice    %sys %iowait  =20 %idle
         =20 11,96    0,00    7,04   =20 1,31   79,70
 
Device:    rrqm/s=20 wrqm/s   r/s   w/s  rsec/s =20 wsec/s    rkB/s    wkB/s avgrq-sz=20 avgqu-sz   await  svctm =20 %util
sda          = 0,00 =20 30,44  0,81  3,43   14,52 =20 270,97     7,26   135,48    = 67,43     0,19   46,05  =20 7,29   3,08
 
cpu-moy:  %user  =20 %nice    %sys %iowait  =20 %idle
         =20 12,26    0,00    7,34   =20 6,63   73,77
 
Device:    rrqm/s=20 wrqm/s   r/s   w/s  rsec/s =20 wsec/s    rkB/s    wkB/s avgrq-sz=20 avgqu-sz   await  svctm =20 %util
sda          = 0,00 =20 32,26  0,00  4,41    0,00 =20 293,39     0,00   146,69    = 66,55     1,51  342,32  25,14 =20 11,08
 
cpu-moy:  %user  =20 %nice    %sys %iowait  =20 %idle
         =20 13,67    0,00    6,83   =20 7,74   71,76
 
Device:    rrqm/s=20 wrqm/s   r/s   w/s  rsec/s =20 wsec/s    rkB/s    wkB/s avgrq-sz=20 avgqu-sz   await  svctm =20 %util
sda          = 0,00 =20 31,99  0,00  3,82    0,00 =20 286,52     0,00   143,26    = 74,95     2,93  767,58  55,84 =20 21,35
 
cpu-moy:  %user  =20 %nice    %sys %iowait  =20 %idle
         =20 13,27    0,00    6,83  =20 14,37   65,53
 
Device:    rrqm/s=20 wrqm/s   r/s   w/s  rsec/s =20 wsec/s    rkB/s    wkB/s avgrq-sz=20 avgqu-sz   await  svctm =20 %util
sda          = 0,00 =20 31,73  0,00  4,02    0,00 =20 285,94     0,00   142,97    = 71,20     2,73  680,40  49,25 =20 19,78
 
cpu-moy:  %user  =20 %nice    %sys %iowait  =20 %idle
         =20 12,86    0,00    6,33   =20 9,45   71,36
 
Device:    rrqm/s=20 wrqm/s   r/s   w/s  rsec/s =20 wsec/s    rkB/s    wkB/s avgrq-sz=20 avgqu-sz   await  svctm =20 %util
sda          = 0,00 =20 30,92  0,00  3,41    0,00 =20 274,70     0,00   137,35    = 80,47     2,33  681,35  57,53 =20 19,64
 
cpu-moy:  %user  =20 %nice    %sys %iowait  =20 %idle
         =20 12,45    0,00    6,02   =20 1,91   79,62
 
Device:    rrqm/s=20 wrqm/s   r/s   w/s  rsec/s =20 wsec/s    rkB/s    wkB/s avgrq-sz=20 avgqu-sz   await  svctm =20 %util
sda          = 0,00 =20 33,00  0,60  4,23    6,44 =20 297,79     3,22   148,89    = 63,00     0,41   85,29  = 20,00  =20 9,66
 
dmesg data:
....
....
SCSI subsystem=20 initialized
Fusion MPT base driver 3.01.20
Copyright (c) 1999-2004 = LSI=20 Logic Corporation
ACPI: PCI Interrupt 0000:02:04.0[A] -> GSI 42 = (level,=20 low) -> IRQ 185
mptbase: Initiating ioc0 bringup
ioc0: 53C1030: = Capabilities=3D{Initiator,Target}
Fusion MPT SCSI Host driver = 3.01.20
scsi0=20 : ioc0: LSI53C1030, FwRev=3D01032300h, Ports=3D1, MaxQ=3D255, = IRQ=3D185
input: AT=20 Translated Set 2 keyboard on isa0060/serio0
input: AT Translated Set = 2=20 keyboard on isa0060/serio0
megaraid cmm: 2.20.2.5 (Release Date: Fri = Jan 21=20 00:01:03 EST 2005)
megaraid: 2.20.4.5 (Release Date: Thu Feb 03 = 12:27:22 EST=20 2005)
megaraid: probe new device 0x1000:0x1960:0x1028:0x0520: bus = 2:slot=20 5:func 0
ACPI: PCI Interrupt 0000:02:05.0[A] -> GSI 37 (level, = low) ->=20 IRQ 193
megaraid: fw version:[351S] bios version:[1.10]
scsi1 : = LSI Logic=20 MegaRAID driver
scsi[1]: scanning scsi channel 0 [Phy 0] for non-raid = devices
  Vendor: SDR       Model: = GEM318P           Rev: = 1
  Type:  =20 Processor          &nbs= p;            = ;  =20 ANSI SCSI revision: 02
scsi[1]: scanning scsi channel 1 [virtual] for = logical=20 drives
  Vendor: MegaRAID  Model: LD 0 RAID1   = 69G =20 Rev: 351S
  Type:  =20 Direct-Access          =            =20 ANSI SCSI revision: 02
SCSI device sda: 143114240 512-byte hdwr = sectors=20 (73274 MB)
sda: asking for cache data failed
sda: assuming drive = cache:=20 write through
SCSI device sda: 143114240 512-byte hdwr sectors (73274 = MB)
sda: asking for cache data failed
sda: assuming drive cache: = write=20 through
 sda: sda1 sda2 sda3 sda4 < sda5 >
Attached = scsi disk=20 sda at scsi1, channel 1, id 0, lun 0
libata version 1.10 = loaded.
ata_piix=20 version 1.03
ACPI: PCI Interrupt 0000:00:1f.2[A] -> GSI 18 (level, = low)=20 -> IRQ 177
PCI: Setting latency timer of device 0000:00:1f.2 to=20 64
ata1: SATA max UDMA/133 cmd 0xBC98 ctl 0xBC92 bmdma 0xBC60 irq=20 177
ata2: SATA max UDMA/133 cmd 0xBC80 ctl 0xBC7A bmdma 0xBC68 irq=20 177
ata1: SATA port has no device.
scsi2 : ata_piix
ata2: SATA = port has=20 no device.
scsi3 : ata_piix
isa bounce pool size: 16 = pages
kjournald=20 starting.  Commit interval 5 seconds
EXT3-fs: mounted filesystem = with=20 ordered data mode.
SELinux:  Disabled at = runtime.
SELinux: =20 Unregistering netfilter hooks
cfq: depth 4 reached, tagging now=20 on
Attached scsi generic sg0 at scsi1, channel 0, id 6, lun 0,  = type=20 3
Attached scsi generic sg1 at scsi1, channel 1, id 0, lun 0,  = type=20 0
Floppy drive(s): fd0 is 1.44M
...
...
...
 
Thank you in advance!
 
Reimer

Reimer
carlos.reimer@opendb.com.br
OpenDB=20 Servi=E7os e Treinamentos PostgreSQL e DB2
Fone: 47 3327-0878 Cel: 47 = 9183-0547
www.opendb.com.br

 
------=_NextPart_000_0014_01C74B94.888D67C0--