Received: from localhost (unknown [200.46.204.183]) by mail.postgresql.org (Postfix) with ESMTP id 9988565047E for ; Tue, 9 Dec 2008 12:11:50 -0400 (AST) Received: from mail.postgresql.org ([200.46.204.86]) by localhost (mx1.hub.org [200.46.204.183]) (amavisd-maia, port 10024) with ESMTP id 16779-06 for ; Tue, 9 Dec 2008 12:11:43 -0400 (AST) X-Greylist: delayed 00:07:47.491339 by SQLgrey-1.7.6 Received: from mail.l39a.com (gsrv2.l39a.com [92.243.10.117]) by mail.postgresql.org (Postfix) with ESMTP id 6901F64FE17 for ; Tue, 9 Dec 2008 12:11:42 -0400 (AST) Received: from falcon.casa.intranet (adsl-ull-101-151.47-151.net24.it [151.47.151.101]) (Authenticated sender: gturchi@l39a.com) by mail.l39a.com (Postfix) with ESMTPSA id C7EE9E97C; Tue, 9 Dec 2008 17:03:48 +0100 (CET) Message-ID: <493E96E4.4010505@l39a.com> Date: Tue, 09 Dec 2008 17:03:48 +0100 From: Gabriele Turchi User-Agent: Thunderbird 2.0.0.18 (X11/20081119) MIME-Version: 1.0 To: Scott Marlowe CC: Mario Weilguni , Alan Hodgson , pgsql-performance@postgresql.org Subject: Re: Experience with HP Smart Array P400 and SATA drives? References: <4934FE60.30702@sime.com> <49395B57.EE98.0025.0@wicourts.gov> <200812051530.01258@hal.medialogik.com> <493E61E1.1020303@sime.com> In-Reply-To: Content-Type: multipart/signed; protocol="application/x-pkcs7-signature"; micalg=sha1; boundary="------------ms040209030905000204060405" X-Virus-Scanned: ClamAV 0.94/8735/Tue Dec 9 09:53:21 2008 on gsrv2 X-Virus-Status: Clean X-Virus-Scanned: Maia Mailguard 1.0.1 X-Spam-Status: No, hits=0 tagged_above=0 required=5 tests=none X-Spam-Level: X-Archive-Number: 200812/73 X-Sequence-Number: 32109 This is a cryptographically signed message in MIME format. --------------ms040209030905000204060405 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit We reached a fairly good performance on a P400 controller (8 SATA 146GB 2,5" 10k rpm) with raid5 or raid6 Linux software raid: the writing bandwidth reached about 140 MB/s sustained throughput (the hardware raid5 gave a sustained 20 MB/s...). With a second, equal controller (16 disks) we reached (raid6 spanning all 16 disks) about 200 MB/s sustained. The CPU load is negligible. Reading performance is about 20% better. Best regards and my apologies for my bad English. GT P.S.: on a P800, 12 SATA 750GB 3,5" 7200 rpm, the hardware raid5 writing performance was about 30 MB/s, software raid5 is between 60 and 80 MB/s. Scott Marlowe ha scritto: > On Tue, Dec 9, 2008 at 5:17 AM, Mario Weilguni wrote: >> Alan Hodgson schrieb: >>>>>>> Mario Weilguni wrote: >>>>>>> >>>>> strange values. An individual drive is capable of delivering 91 >>>>> MB/sec >>>>> sequential read performance, and we get values ~102MB/sec out of a >>>>> 8-drive RAID5, seems to be ridiculous slow. >>> >>> What command are you using to test the reads? >>> >>> Some recommendations to try: >>> >>> 1) /sbin/blockdev --setra 2048 device (where device is the partition or >>> LVM volume) >>> >>> 2) Use XFS, and make sure your stripe settings match the RAID. >>> >>> Having said that, 102MB/sec sounds really low for any modern controller >>> with 8 drives, regardless of tuning or filesystem choice. >>> >>> >> First, thanks alot for this and all the other answers. >> >> I measured the raw device performance: >> dd if=/dev/cciss/c0d0 bs=64k count=100000 of=/dev/null >> >> I get poor performance when all 8 drives are configured as one, large >> RAID-5, and slightly poorer performance when configured as JBOD. In >> production, we use XFS as FS, but I doubt this has anything to do with FS >> tuning. > > Yeah, having just trawled the pgsql-performance archives, there are > plenty of instances of people having terrible performance from HP > smart array controllers before the P800. Is it possible for you to > trade up to a better RAID controller? Whichever salesman sold you the > P400 should take one for the team and make this right for you. > --------------ms040209030905000204060405 Content-Type: application/x-pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIITwDCC BhswggQDoAMCAQICAQ8wDQYJKoZIhvcNAQEFBQAwgaExCzAJBgNVBAYTAklUMQ8wDQYDVQQI EwZNaWxhbm8xDzANBgNVBAcTBk1pbGFubzEUMBIGA1UEChMLTDM5QSBTLnIubC4xGTAXBgNV BAsTEE5ldHdvcmsgU2VydmljZXMxIzAhBgNVBAMTGkwzOUEgQ0EgLSBOZXR3b3JrIFNlcnZp Y2VzMRowGAYJKoZIhvcNAQkBFgtjYUBsMzlhLmNvbTAeFw0wODExMjYyMDUwMDNaFw0xMDAy MTkyMDUwMDNaMIGIMQswCQYDVQQGEwJJVDEPMA0GA1UECBMGTWlsYW5vMQ8wDQYDVQQHEwZN aWxhbm8xFDASBgNVBAoTC0wzOUEgUy5yLmwuMRgwFgYDVQQDEw9HYWJyaWVsZSBUdXJjaGkx JzAlBgkqhkiG9w0BCQEWGGdhYnJpZWxlLnR1cmNoaUBsMzlhLmNvbTCCASIwDQYJKoZIhvcN AQEBBQADggEPADCCAQoCggEBALxyBPhEN4pw/mC4rmStsbJRu94X7u4Me/D5Mw7mRbo7Q/d6 HI8+NjPnr+SHf0Q6PSD1qnd8z3QpTBuT6OYgHxw5AoUHtF2HQTL+lVxfPzDWfG/KQPLdkRz8 RGeRWC4rwnjV4qVqWwzXpfiTFqDly/0MoE/YyZkYmz9aHyao6SX+2fWm5nA7xA8c1dHtAoeB zZAkxzusV1M7xJzRqh7QMLUmLxXfKOrTGwfgLkgifuPGlQ3DHtYAWh5wm8hk8APuJBL6E+TX Nwko6cFTYO1gJJLeXkBCFtAJ5PehDUvx2DLb7JRFpLrMkI0bNVUCAP8A328DtG/2bZNa1sTC v/Z0KocCAwEAAaOCAXMwggFvMAkGA1UdEwQCMAAwEQYJYIZIAYb4QgEBBAQDAgSwMCsGCWCG SAGG+EIBDQQeFhxUaW55Q0EgR2VuZXJhdGVkIENlcnRpZmljYXRlMB0GA1UdDgQWBBTi7lQV 2CuA9AlbEF+Ey0r7v/6kIDCBtQYDVR0jBIGtMIGqgBS0j92r9jZFDtjQ2BbiW+oNAWS2faGB jqSBizCBiDELMAkGA1UEBhMCSVQxDzANBgNVBAgTBk1pbGFubzEPMA0GA1UEBxMGTWlsYW5v MRQwEgYDVQQKEwtMMzlBIFMuci5sLjElMCMGA1UEAxMcTDM5QSBDZXJ0aWZpY2F0aW9uIEF1 dGhvcml0eTEaMBgGCSqGSIb3DQEJARYLY2FAbDM5YS5jb22CAQEwFgYDVR0SBA8wDYELY2FA bDM5YS5jb20wIwYDVR0RBBwwGoEYZ2FicmllbGUudHVyY2hpQGwzOWEuY29tMA4GA1UdDwEB /wQEAwIFoDANBgkqhkiG9w0BAQUFAAOCAgEAYLV0onQcxuikyriRJWk8G6lIdLxUqj0Mankv FvLHQPyFLKsffLvngYYY3wXtMtdurCsZfOanu3KFCNw5MMTKJ5/TCcsLK0nXJGDSbc9psqxC DvwLjhB17ebLuzmhgnleoTp8ivvNzxJe0zc6+xBhMvwmf4uqhf/u6Sg2LeS4ufcf9q4rMVsj FgKY5ABy/u08PynwUAbGu3UtPGZdvmcxAbLYEN8Papt0Bm+cU9yGgLObIrhn5LV4hYkyHtWa OS1x9wq5XZ98aT1XtkKncWD6dVgw4yPfrN1MCh9CJW08yKinSzdAPv7ngqCtiGHsCEZe2T5u vQbuReKVPZUXw0Z6B0dG7H5CdVdu6qtlP8xe9TB5gtV3PGcQ/hEIye0weJW1FI2BN+wu2RWd eYqPIoQogYsUsiu0s9J+RTlcLbvCKAZkWZ4kbHNSZDtSNFBF/lpjr31hcebAEzTke6vRwBSy wf91paLA/lLh8MRby1c+j+4NJnAv9bbOk/m712rpwwPTonjzw66IblRoF29HJJ6EguzomY8Q Bheg5viPVfXKZ5DLolryZSyutVMrdHQMoQtWowN19o3AGJT1ttq4Fp82gaYfqNKTWPT1VfhU Eh2rHNpBloDYp1UjfvjCaZhrzit7ARqXKXvgHl9R8vT1P3FME6fR/5V81qI2SQ7vtzzTT8Qw ggYbMIIEA6ADAgECAgEPMA0GCSqGSIb3DQEBBQUAMIGhMQswCQYDVQQGEwJJVDEPMA0GA1UE CBMGTWlsYW5vMQ8wDQYDVQQHEwZNaWxhbm8xFDASBgNVBAoTC0wzOUEgUy5yLmwuMRkwFwYD VQQLExBOZXR3b3JrIFNlcnZpY2VzMSMwIQYDVQQDExpMMzlBIENBIC0gTmV0d29yayBTZXJ2 aWNlczEaMBgGCSqGSIb3DQEJARYLY2FAbDM5YS5jb20wHhcNMDgxMTI2MjA1MDAzWhcNMTAw MjE5MjA1MDAzWjCBiDELMAkGA1UEBhMCSVQxDzANBgNVBAgTBk1pbGFubzEPMA0GA1UEBxMG TWlsYW5vMRQwEgYDVQQKEwtMMzlBIFMuci5sLjEYMBYGA1UEAxMPR2FicmllbGUgVHVyY2hp MScwJQYJKoZIhvcNAQkBFhhnYWJyaWVsZS50dXJjaGlAbDM5YS5jb20wggEiMA0GCSqGSIb3 DQEBAQUAA4IBDwAwggEKAoIBAQC8cgT4RDeKcP5guK5krbGyUbveF+7uDHvw+TMO5kW6O0P3 ehyPPjYz56/kh39EOj0g9ap3fM90KUwbk+jmIB8cOQKFB7Rdh0Ey/pVcXz8w1nxvykDy3ZEc /ERnkVguK8J41eKlalsM16X4kxag5cv9DKBP2MmZGJs/Wh8mqOkl/tn1puZwO8QPHNXR7QKH gc2QJMc7rFdTO8Sc0aoe0DC1Ji8V3yjq0xsH4C5IIn7jxpUNwx7WAFoecJvIZPAD7iQS+hPk 1zcJKOnBU2DtYCSS3l5AQhbQCeT3oQ1L8dgy2+yURaS6zJCNGzVVAgD/AN9vA7Rv9m2TWtbE wr/2dCqHAgMBAAGjggFzMIIBbzAJBgNVHRMEAjAAMBEGCWCGSAGG+EIBAQQEAwIEsDArBglg hkgBhvhCAQ0EHhYcVGlueUNBIEdlbmVyYXRlZCBDZXJ0aWZpY2F0ZTAdBgNVHQ4EFgQU4u5U FdgrgPQJWxBfhMtK+7/+pCAwgbUGA1UdIwSBrTCBqoAUtI/dq/Y2RQ7Y0NgW4lvqDQFktn2h gY6kgYswgYgxCzAJBgNVBAYTAklUMQ8wDQYDVQQIEwZNaWxhbm8xDzANBgNVBAcTBk1pbGFu bzEUMBIGA1UEChMLTDM5QSBTLnIubC4xJTAjBgNVBAMTHEwzOUEgQ2VydGlmaWNhdGlvbiBB dXRob3JpdHkxGjAYBgkqhkiG9w0BCQEWC2NhQGwzOWEuY29tggEBMBYGA1UdEgQPMA2BC2Nh QGwzOWEuY29tMCMGA1UdEQQcMBqBGGdhYnJpZWxlLnR1cmNoaUBsMzlhLmNvbTAOBgNVHQ8B Af8EBAMCBaAwDQYJKoZIhvcNAQEFBQADggIBAGC1dKJ0HMbopMq4kSVpPBupSHS8VKo9DGp5 Lxbyx0D8hSyrH3y754GGGN8F7TLXbqwrGXzmp7tyhQjcOTDEyief0wnLCytJ1yRg0m3PabKs Qg78C44Qde3my7s5oYJ5XqE6fIr7zc8SXtM3OvsQYTL8Jn+LqoX/7ukoNi3kuLn3H/auKzFb IxYCmOQAcv7tPD8p8FAGxrt1LTxmXb5nMQGy2BDfD2qbdAZvnFPchoCzmyK4Z+S1eIWJMh7V mjktcfcKuV2ffGk9V7ZCp3Fg+nVYMOMj36zdTAofQiVtPMiop0s3QD7+54KgrYhh7AhGXtk+ br0G7kXilT2VF8NGegdHRux+QnVXbuqrZT/MXvUweYLVdzxnEP4RCMntMHiVtRSNgTfsLtkV nXmKjyKEKIGLFLIrtLPSfkU5XC27wigGZFmeJGxzUmQ7UjRQRf5aY699YXHmwBM05Hur0cAU ssH/daWiwP5S4fDEW8tXPo/uDSZwL/W2zpP5u9dq6cMD06J488OuiG5UaBdvRySehILs6JmP EAYXoOb4j1X1ymeQy6Ja8mUsrrVTK3R0DKELVqMDdfaNwBiU9bbauBafNoGmH6jSk1j09VX4 VBIdqxzaQZaA2KdVI374wmmYa84rewEalyl74B5fUfL09T9xTBOn0f+VfNaiNkkO77c800/E MIIHfjCCBWagAwIBAgIBATANBgkqhkiG9w0BAQUFADCBiDELMAkGA1UEBhMCSVQxDzANBgNV BAgTBk1pbGFubzEPMA0GA1UEBxMGTWlsYW5vMRQwEgYDVQQKEwtMMzlBIFMuci5sLjElMCMG A1UEAxMcTDM5QSBDZXJ0aWZpY2F0aW9uIEF1dGhvcml0eTEaMBgGCSqGSIb3DQEJARYLY2FA bDM5YS5jb20wHhcNMDYwNjE2MTk1NzQ5WhcNMTYwNjEzMTk1NzQ5WjCBoTELMAkGA1UEBhMC SVQxDzANBgNVBAgTBk1pbGFubzEPMA0GA1UEBxMGTWlsYW5vMRQwEgYDVQQKEwtMMzlBIFMu ci5sLjEZMBcGA1UECxMQTmV0d29yayBTZXJ2aWNlczEjMCEGA1UEAxMaTDM5QSBDQSAtIE5l dHdvcmsgU2VydmljZXMxGjAYBgkqhkiG9w0BCQEWC2NhQGwzOWEuY29tMIICIjANBgkqhkiG 9w0BAQEFAAOCAg8AMIICCgKCAgEAqw0RxtTAyBcyp7+wJXAaQUrQLVnplfSkeZCNp/o9noMO kVwiZC+heihKEMGwGeHL/5fEB0LlKu0H1tEwYiD0Q8DxfCRnRM4eqN2JMN+j2U+beP5Jo7HL KknXWzQxJdST9N55+YNTA4DuPZ8xPyEsz9VLz9g39aOXRKQnSN6ErY+XCzP0guR8Yg9MsrmI F6OqsZ9/FtariqpsnZwdYNhHvgImWOFcahbS2TJmq0S1KEGEqXHLgqekg21eIdBT05DPbCBs MF8Qnf1hOZJU2gkaTlQmuAsO7FBGgwGulb3HgVcoY4OhPVQNQ9ZVWmMIggAsW5w6qXnMe2NE bNFFnFRsUIc/XDekN/oE8yBsaDMgadm8QyQ22jYJ6pZmML+oAI3UrD813XbPLO51Sx1VQ0Tw FVK7yByHqRHT9Cf20LYKdZmYwqipdiHRS/WNuMrS1p4b2r+gJ3Afq/1podLH46cYUoEyfADl mge5Ivv8KBlMnblNFtDnQg392aqwJfH61z6vo8HKw0uuXp3GYI6PscIClGeKuFQvo+bmeX4f +d4+nsojkTJmyyBKeykY4GwY2Kd+o3qHL/7sLfGhRShh7640PhhbbLfOJwJQP5emr+AkRU7E KZlvy17u1rxT3+IZ1dw5zbBNRlzSJT3AyoXV0NMJourN6CB1X6TgEYKBjZ/5CHcCAwEAAaOC AdYwggHSMB0GA1UdDgQWBBS0j92r9jZFDtjQ2BbiW+oNAWS2fTCBvQYDVR0jBIG1MIGygBRo 7L5byARXiSJ6ymK8nDPhVmqbaKGBjqSBizCBiDELMAkGA1UEBhMCSVQxDzANBgNVBAgTBk1p bGFubzEPMA0GA1UEBxMGTWlsYW5vMRQwEgYDVQQKEwtMMzlBIFMuci5sLjElMCMGA1UEAxMc TDM5QSBDZXJ0aWZpY2F0aW9uIEF1dGhvcml0eTEaMBgGCSqGSIb3DQEJARYLY2FAbDM5YS5j b22CCQCaZuS1ORKmYTAPBgNVHRMBAf8EBTADAQH/MBEGCWCGSAGG+EIBAQQEAwIBBjAWBgNV HRIEDzANgQtjYUBsMzlhLmNvbTArBglghkgBhvhCAQ0EHhYcVGlueUNBIEdlbmVyYXRlZCBD ZXJ0aWZpY2F0ZTAtBglghkgBhvhCAQQEIBYeaHR0cDovL3d3dy5sMzlhLmNvbS9jYS1jcmwu cGVtMDEGCWCGSAGG+EIBCAQkFiJodHRwOi8vd3d3LmwzOWEuY29tL2NhLXBvbGljeS5odG1s MBYGA1UdEQQPMA2BC2NhQGwzOWEuY29tMA4GA1UdDwEB/wQEAwIBBjANBgkqhkiG9w0BAQUF AAOCAgEAa5lu8evYsYln13Xul8DMrv4EQqr5V0Cy2yPjSGjiqkrn7VaPScgc/SU1jumsLoQ7 gzpMYmg2QkzQACQIIKKlPvYn0AnsuKoFg7bBpq2K/z8PJ+13/pJSFcoUaD12viPgQW0baX75 1HixhNaZLcfvkQDfe+8pKpS/IpI8UjhqU24zBTakVMcLtL84C9ZRiixLtU5CoKb6/irV+s3k Dd45AZ/z+ut/n7bNaBpBuqQTly+m2AILH9ghj6d0sC0tduIIFU7hK2Cg8tJ8LtkYP4M2a7a0 WcClz0H5ZMLCSyrymae1atKc7wu77+DH7xv2EGKmUhXHjCyHHGCK12uTLQnBc/poz+iTOpMt 2+xKFbhAHoWYoYDPZc9zVycJq3zT8qTVO+zxac9lpTCcChjV3fsWMiZT7yNjxZlXDRA+/0Ek sL4nSsNzJxbb80Q5EEV3y0NmOQj1hMF94e+NOc/9LjIf5nbhCA9nXVA8tf3kUC8o5ENhslCS E8pmeJh87gRzenP46ymKTkRURfpiFx07WHCoLGr4nYF/H/oUvfoCUsUSY7q7biqPukIcQAif 7PxaqvBJaCIiIFhcnnCHb7kvlA8KtolINmyFwWWfKx0dafZeybcfftDfoYumIO+U3++JB2S+ bzMbJ+9n/2MPVPIcCLnBftWuHVoCK+JQ5Uan0KKA3b4xggQJMIIEBQIBATCBpzCBoTELMAkG A1UEBhMCSVQxDzANBgNVBAgTBk1pbGFubzEPMA0GA1UEBxMGTWlsYW5vMRQwEgYDVQQKEwtM MzlBIFMuci5sLjEZMBcGA1UECxMQTmV0d29yayBTZXJ2aWNlczEjMCEGA1UEAxMaTDM5QSBD QSAtIE5ldHdvcmsgU2VydmljZXMxGjAYBgkqhkiG9w0BCQEWC2NhQGwzOWEuY29tAgEPMAkG BSsOAwIaBQCgggI2MBgGCSqGSIb3DQEJAzELBgkqhkiG9w0BBwEwHAYJKoZIhvcNAQkFMQ8X DTA4MTIwOTE2MDM0OFowIwYJKoZIhvcNAQkEMRYEFEMdtYQDd61B5X5+9AEfsNCqPWibMF8G CSqGSIb3DQEJDzFSMFAwCwYJYIZIAWUDBAECMAoGCCqGSIb3DQMHMA4GCCqGSIb3DQMCAgIA gDANBggqhkiG9w0DAgIBQDAHBgUrDgMCBzANBggqhkiG9w0DAgIBKDCBuAYJKwYBBAGCNxAE MYGqMIGnMIGhMQswCQYDVQQGEwJJVDEPMA0GA1UECBMGTWlsYW5vMQ8wDQYDVQQHEwZNaWxh bm8xFDASBgNVBAoTC0wzOUEgUy5yLmwuMRkwFwYDVQQLExBOZXR3b3JrIFNlcnZpY2VzMSMw IQYDVQQDExpMMzlBIENBIC0gTmV0d29yayBTZXJ2aWNlczEaMBgGCSqGSIb3DQEJARYLY2FA bDM5YS5jb20CAQ8wgboGCyqGSIb3DQEJEAILMYGqoIGnMIGhMQswCQYDVQQGEwJJVDEPMA0G A1UECBMGTWlsYW5vMQ8wDQYDVQQHEwZNaWxhbm8xFDASBgNVBAoTC0wzOUEgUy5yLmwuMRkw FwYDVQQLExBOZXR3b3JrIFNlcnZpY2VzMSMwIQYDVQQDExpMMzlBIENBIC0gTmV0d29yayBT ZXJ2aWNlczEaMBgGCSqGSIb3DQEJARYLY2FAbDM5YS5jb20CAQ8wDQYJKoZIhvcNAQEBBQAE ggEANUj36fC3Ups7n73zh9sOMEWWtXoO2qOi8yxoLSXoqxr3vSBwzqAu9gJFI+gRdcLoIfsa 1/pf3cO0mGgcSP/SC8gADgyBA/8C3QWLu3RThz/QBG0Gm33/K0Q23jVIzjy/7+2hL8BGieQs E30tnjQkVP/tEDbEExN34NhzbhbRHX23Z1dID1540tbxz0G0TOnG1V6HjMgH5QHTeXGNDig1 MZD/hUzfG9f5paV1OCy1x5g3hcnjk7KwWD0+9jnCG6nkiA2NmaBFEbWfbeanb6Pp+2LDGjY5 1jhJ08DrRkIWicoVsCD2CmBN/H0dSrbTQgjZaaiaNnMz+2HHGHtM+n/vYgAAAAAAAA== --------------ms040209030905000204060405--