X-Original-To: pgsql-performance-postgresql.org@localhost.postgresql.org Received: from localhost (unknown [200.46.204.144]) by svr1.postgresql.org (Postfix) with ESMTP id F0D3552814 for ; Mon, 6 Jun 2005 14:27:57 -0300 (ADT) Received: from svr1.postgresql.org ([200.46.204.71]) by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024) with ESMTP id 45137-10 for ; Mon, 6 Jun 2005 17:27:49 +0000 (GMT) Received: from vms042pub.verizon.net (vms042pub.verizon.net [206.46.252.42]) by svr1.postgresql.org (Postfix) with ESMTP id EC18952806 for ; Mon, 6 Jun 2005 14:27:43 -0300 (ADT) Received: from osgiliath.mathom.us ([70.108.94.185]) by vms042.mailsrvcs.net (Sun Java System Messaging Server 6.2 HotFix 0.04 (built Dec 24 2004)) with ESMTPA id <0IHO007DFB65GH92@vms042.mailsrvcs.net> for pgsql-performance@postgresql.org; Mon, 06 Jun 2005 12:27:41 -0500 (CDT) Received: from localhost (localhost [127.0.0.1]) by osgiliath.mathom.us (Postfix) with ESMTP id 01FC56000AB for ; Mon, 06 Jun 2005 13:27:41 -0400 (EDT) Received: from osgiliath.mathom.us ([127.0.0.1]) by localhost (osgiliath [127.0.0.1]) (amavisd-new, port 10024) with LMTP id 27113-01 for ; Mon, 06 Jun 2005 13:27:40 -0400 (EDT) Received: by osgiliath.mathom.us (Postfix, from userid 1000) id CCC2D6000A8; Mon, 06 Jun 2005 13:27:40 -0400 (EDT) Date: Mon, 06 Jun 2005 13:27:40 -0400 From: Michael Stone Subject: Re: Performance nightmare with dspam (urgent) (resolved) In-reply-to: <42A47129.30309@arbash-meinel.com> To: Postgresql Performance Mail-Followup-To: Postgresql Performance Message-id: <20050606172740.GC19670@mathom.us> MIME-version: 1.0 Content-type: text/plain; charset=us-ascii; format=flowed Content-disposition: inline X-Pgp-Fingerprint: 53 FF 38 00 E7 DD 0A 9C 84 52 84 C5 EE DF 7C 88 X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at mathom.us References: <200506012019.13218.cshobe@seattleserver.com> <200506061454.48018.lists@seattleserver.com> <42A466E7.4080808@arbash-meinel.com> <20050606151911.GB19670@mathom.us> <42A47129.30309@arbash-meinel.com> User-Agent: Mutt/1.5.9i X-Virus-Scanned: by amavisd-new at hub.org X-Spam-Status: No, hits=0.038 tagged_above=0 required=5 tests=AWL, FORGED_RCVD_HELO X-Spam-Level: X-Archive-Number: 200506/125 X-Sequence-Number: 12762 On Mon, Jun 06, 2005 at 10:52:09AM -0500, John A Meinel wrote: >pg_xlog benefits from being super fast. Because it has to be fully >synced before the rest of the data can be committed. Yes they are small, >but if you can make it fast, you eliminate that overhead. It also >benefits from having it's own spindle, because you eliminate the seek >time. (Since it is always appending) Eliminating the seeks is definately a win. >Anyway, my point is that pg_xlog isn't necessarily tiny. Many people >seem to set it as high as 100-200, and each one is 16MB. It's not the size of the xlog, it's the size of the write. Unless you're writing out a stripe size of data at once you're only effectively writing to one disk pair at a time anyway. (Things change if you have a big NVRAM cache to aggregate the writes, but you'd need a *lot* of transaction activity to exceed the 50MB/s or so you could get from the single raid1 pair in that scenario.) Mike Stone