X-Original-To: pgsql-performance-postgresql.org@localhost.postgresql.org Received: from localhost (av.hub.org [200.46.204.144]) by svr1.postgresql.org (Postfix) with ESMTP id 616F5DBA6C for ; Thu, 24 Nov 2005 05:26:48 -0400 (AST) Received: from svr1.postgresql.org ([200.46.204.71]) by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024) with ESMTP id 81013-07 for ; Thu, 24 Nov 2005 09:26:49 +0000 (GMT) X-Greylist: from auto-whitelisted by SQLgrey- Received: from linda-1.paradise.net.nz (bm-1a.paradise.net.nz [203.96.152.180]) by svr1.postgresql.org (Postfix) with ESMTP id BEBBDDBA04 for ; Thu, 24 Nov 2005 05:26:45 -0400 (AST) Received: from smtp-1.paradise.net.nz (tclsnelbe2-src-nat-1 [203.96.152.177]) by linda-1.paradise.net.nz (Paradise.net.nz) with ESMTP id <0IQG00FLYCWNWO@linda-1.paradise.net.nz> for pgsql-performance@postgresql.org; Thu, 24 Nov 2005 22:26:47 +1300 (NZDT) Received: from [192.168.1.11] (218-101-28-4.dsl.clear.net.nz [218.101.28.4]) by smtp-1.paradise.net.nz (Postfix) with ESMTP id B7661BB9147; Thu, 24 Nov 2005 22:26:46 +1300 (NZDT) Date: Thu, 24 Nov 2005 22:26:44 +1300 From: Mark Kirkwood Subject: Re: Hardware/OS recommendations for large databases ( In-reply-to: To: Luke Lonergan Cc: stange@rentec.com, Greg Stark , Dave Cramer , Joshua Marsh , pgsql-performance@postgresql.org Message-id: <43858754.4020300@paradise.net.nz> MIME-version: 1.0 Content-type: text/plain; format=flowed; charset=ISO-8859-1 Content-transfer-encoding: 7bit X-Accept-Language: en-us, en User-Agent: Mozilla Thunderbird 1.0.6 (X11/20051106) References: X-Virus-Scanned: by amavisd-new at hub.org X-Spam-Status: No, score=0.193 required=5 tests=[AWL=0.193] X-Spam-Score: 0.193 X-Spam-Level: X-Archive-Number: 200511/487 X-Sequence-Number: 15744 Luke Lonergan wrote: > Mark, > > >>>Time: 197870.105 ms >> >>So 198 seconds is the uncached read time with count (Just for clarity, >>did you clear the Pg and filesystem caches or unmount / remount the >>filesystem?) > > > Nope - the longer time is due to the "second write" known issue with > Postgres - it writes the data to the table, but all of the pages are marked > dirty? So, always on the first scan after loading they are written again. > This is clear as you watch vmstat - the pattern on the first seq scan is > half read / half write. > Ah - indeed - first access after a COPY no? I should have thought of that, sorry!