X-Original-To: pgsql-performance-postgresql.org@localhost.postgresql.org Received: from localhost (unknown [200.46.204.144]) by svr1.postgresql.org (Postfix) with ESMTP id B880755F20 for ; Mon, 14 Mar 2005 07:44:56 +0000 (GMT) Received: from svr1.postgresql.org ([200.46.204.71]) by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024) with ESMTP id 11844-09 for ; Mon, 14 Mar 2005 07:44:55 +0000 (GMT) Received: from mail.ukfsn.org (s2.ukfsn.org [217.158.120.143]) by svr1.postgresql.org (Postfix) with ESMTP id 2292252A8E for ; Mon, 14 Mar 2005 07:44:54 +0000 (GMT) Received: from localhost (lucy.ukfsn.org [127.0.0.1]) by mail.ukfsn.org (Postfix) with ESMTP id 0443DE6D67; Mon, 14 Mar 2005 07:39:56 +0000 (GMT) Received: from mail.ukfsn.org ([127.0.0.1]) by localhost (lucy.ukfsn.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 19198-14; Mon, 14 Mar 2005 07:39:55 +0000 (GMT) Received: from oak.dgreaves.com (modem-2470.leopard.dialup.pol.co.uk [217.135.153.166]) by mail.ukfsn.org (Postfix) with ESMTP id 31094E6D65; Mon, 14 Mar 2005 07:39:55 +0000 (GMT) Received: from ash.dgreaves.com ([10.0.0.90]) by oak.dgreaves.com with esmtp (Exim 4.20) id 1DAkFv-000855-O0; Mon, 14 Mar 2005 07:44:51 +0000 Message-ID: <423540F5.8090609@dgreaves.com> Date: Mon, 14 Mar 2005 07:44:53 +0000 From: David Greaves User-Agent: Debian Thunderbird 1.0 (X11/20050116) X-Accept-Language: en-us, en MIME-Version: 1.0 To: Greg Stark Cc: Arshavir Grigorian , linux-raid@vger.kernel.org, pgsql-performance@postgresql.org Subject: Re: Postgres on RAID5 (possible sync blocking read type References: <4231F5F2.6000509@m-cam.com> <87hdje7sjm.fsf@stark.xeocode.com> In-Reply-To: <87hdje7sjm.fsf@stark.xeocode.com> X-Enigmail-Version: 0.90.0.0 X-Enigmail-Supports: pgp-inline, pgp-mime Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: by amavisd-new at hub.org X-Spam-Status: No, hits=0.05 tagged_above=0 required=5 tests=FORGED_RCVD_HELO X-Spam-Level: X-Archive-Number: 200503/411 X-Sequence-Number: 11116 Greg Stark wrote: >Arshavir Grigorian writes: > > > >>Hi, >> >>I have a RAID5 array (mdadm) with 14 disks + 1 spare. This partition has an >>Ext3 filesystem which is used by Postgres. >> >> > >People are going to suggest moving to RAID1+0. I'm unconvinced that RAID5 >across 14 drivers shouldn't be able to keep up with RAID1 across 7 drives >though. It would be interesting to see empirical data. > >One thing that does scare me is the Postgres transaction log and the ext3 >journal both sharing these disks with the data. Ideally both of these things >should get (mirrored) disks of their own separate from the data files. > >But 2-3s pauses seem disturbing. I wonder whether ext3 is issuing a cache >flush on every fsync to get the journal pushed out. This is a new linux >feature that's necessary with ide but shouldn't be necessary with scsi. > >It would be interesting to know whether postgres performs differently with >fsync=off. This would even be a reasonable mode to run under for initial >database loads. It shouldn't make much of a difference with hardware like this >though. And you should be aware that running under this mode in production >would put your data at risk. > Hi I'm coming in from the raid list so I didn't get the full story. May I ask what kernel? I only ask because I upgraded to 2.6.11.2 and happened to be watching xosview on my (probably) completely different setup (1Tb xfs/lvm2/raid5 served by nfs to a remote sustained read/write app), when I saw all read activity cease for 2/3 seconds whilst the disk wrote, then disk read resumed. This occured repeatedly during a read/edit/write of a 3Gb file. Performance not critical here so on the "hmm, that's odd" todo list :) David