X-Original-To: pgsql-performance-postgresql.org@localhost.postgresql.org Received: from localhost (unknown [200.46.204.144]) by svr1.postgresql.org (Postfix) with ESMTP id 9A8C5529D1 for ; Thu, 11 Aug 2005 11:09:49 -0300 (ADT) Received: from svr1.postgresql.org ([200.46.204.71]) by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024) with ESMTP id 29124-08 for ; Thu, 11 Aug 2005 14:09:46 +0000 (GMT) Received: from vms042pub.verizon.net (vms042pub.verizon.net [206.46.252.42]) by svr1.postgresql.org (Postfix) with ESMTP id AD59652C12 for ; Thu, 11 Aug 2005 11:09:41 -0300 (ADT) Received: from osgiliath.mathom.us ([70.108.53.154]) by vms042.mailsrvcs.net (Sun Java System Messaging Server 6.2 HotFix 0.04 (built Dec 24 2004)) with ESMTPA id <0IL200HM59VT7C57@vms042.mailsrvcs.net> for pgsql-performance@postgresql.org; Thu, 11 Aug 2005 09:07:06 -0500 (CDT) Received: from localhost (localhost [127.0.0.1]) by osgiliath.mathom.us (Postfix) with ESMTP id 2087D70882D for ; Thu, 11 Aug 2005 10:07:05 -0400 (EDT) Received: from osgiliath.mathom.us ([127.0.0.1]) by localhost (osgiliath [127.0.0.1]) (amavisd-new, port 10024) with LMTP id 01836-01 for ; Thu, 11 Aug 2005 10:07:04 -0400 (EDT) Received: by osgiliath.mathom.us (Postfix, from userid 1000) id E470B702202; Thu, 11 Aug 2005 10:07:04 -0400 (EDT) Date: Thu, 11 Aug 2005 10:07:04 -0400 From: Michael Stone Subject: Re: PG8 Tuning In-reply-to: <1536.217.45.209.171.1123763001.squirrel@www.gradwell.com> To: pgsql-performance@postgresql.org Mail-Followup-To: pgsql-performance@postgresql.org Message-id: <20050811140704.GL19080@mathom.us> MIME-version: 1.0 Content-type: text/plain; charset=us-ascii; format=flowed Content-disposition: inline X-Pgp-Fingerprint: 53 FF 38 00 E7 DD 0A 9C 84 52 84 C5 EE DF 7C 88 X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at mathom.us References: <1536.217.45.209.171.1123763001.squirrel@www.gradwell.com> User-Agent: Mutt/1.5.9i X-Virus-Scanned: by amavisd-new at hub.org X-Spam-Status: No, hits=0.007 tagged_above=0 required=5 tests=[AWL=0.007] X-Spam-Level: X-Archive-Number: 200508/123 X-Sequence-Number: 13870 On Thu, Aug 11, 2005 at 01:23:21PM +0100, Paul Johnson wrote: >I'm guessing that this is because pg_xlog has gone from a 9 spindle LUN to >a single spindle disk? > >In cases such as this, where an external storage array with a hardware >RAID controller is used, the normal advice to separate the data from the >pg_xlog seems to come unstuck Yes. That's the downside to dogma. If you're writing pg_xlog to a battery-backed ram buffer you'll see faster commits than you will with a write to a disk, even if you've got a dedicated spindle, unless you've got constant write activity. (Because once the buffer fills you're limited to disk speed as you wait for buffer flushes.) If you've got a lot of system RAM, a battery-backed disk buffer, an OS/filesystem than effectively delays writes, and bursty transactional writes it's quite possible you'll get better performance putting everything on one array rather than breaking it up to follow the "rules". You might get a performance boost by putting the transaction log on a seperate partition or lun on the external array, depending on how the fs implements syncs or whether you can optimize the filsystem choice for each partition. The correct approach is to run comparative benchmarks of each configuration. :-) Mike Stone