Received: from maia.hub.org (maia-2.hub.org [200.46.204.251]) by mail.postgresql.org (Postfix) with ESMTP id 2298063243E for ; Wed, 18 Aug 2010 17:23:16 -0300 (ADT) Received: from mail.postgresql.org ([200.46.204.86]) by maia.hub.org (mx1.hub.org [200.46.204.251]) (amavisd-maia, port 10024) with ESMTP id 28021-06 for ; Wed, 18 Aug 2010 20:23:08 +0000 (UTC) X-Greylist: domain auto-whitelisted by SQLgrey-1.7.6 Received: from mail-ey0-f174.google.com (mail-ey0-f174.google.com [209.85.215.174]) by mail.postgresql.org (Postfix) with ESMTP id B40AA63242D for ; Wed, 18 Aug 2010 17:23:08 -0300 (ADT) Received: by eyg5 with SMTP id 5so706742eyg.19 for ; Wed, 18 Aug 2010 13:23:07 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from :user-agent:mime-version:to:cc:subject:references:in-reply-to :content-type:content-transfer-encoding; bh=6ixfjCv83Wy6B/RkCtHpGb5e7DsJ+eqG3eWXPxNSkAI=; b=wp0K03bKjH66qgcoYJr3iEbASumDeeBmQ4H/C9aM0CaXQQAw16eMUBwQ8UWyP5wwK9 93zI4mh+I1rrMpgmXzQ4kbMjl7REopRD8393h62l+5fiILIxsmRzklJSxv/4tAOABJ3p K1Gf+WB77y/aSouw9Ps9rB4/If3MUGIvzygEA= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:content-type:content-transfer-encoding; b=G5xCNUCBc6SaFQgApoiLhAuc75Ei+dk5AmAkkbCsrLVc+iqix59GUVfP0vCTIykjlM ThWCsadLpQ5IJK+/sSLqYkMSZJSnWV4Jo/DFb+5VwCN6XG+5Y6EFwgPOj8smZ66kC1Lp NEYX+zHo6tscotWsImXypNWtNo/9oLEerVIac= Received: by 10.213.3.73 with SMTP id 9mr2600930ebm.6.1282162987209; Wed, 18 Aug 2010 13:23:07 -0700 (PDT) Received: from [0.0.0.0] (5357DA75.cable.casema.nl [83.87.218.117]) by mx.google.com with ESMTPS id v8sm1154309eeh.8.2010.08.18.13.23.05 (version=TLSv1/SSLv3 cipher=RC4-MD5); Wed, 18 Aug 2010 13:23:06 -0700 (PDT) Message-ID: <4C6C41B7.4060709@gmail.com> Date: Wed, 18 Aug 2010 22:25:27 +0200 From: Yeb Havinga User-Agent: Thunderbird 2.0.0.24 (Windows/20100228) MIME-Version: 1.0 To: Samuel Gendler CC: pgsql-performance@postgresql.org Subject: Re: write barrier question References: In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: Maia Mailguard 1.0.1 X-Spam-Status: No, hits=-1.9 tagged_above=-10 required=5 tests=BAYES_00=-1.9 X-Spam-Level: X-Archive-Number: 201008/206 X-Sequence-Number: 40049 Samuel Gendler wrote: > When running pgbench on a db which fits easily into RAM (10% of RAM = > -s 380), I see transaction counts a little less than 5K. When I go to > 90% of RAM (-s 3420), transaction rate dropped to around 1000 ( at a > fairly wide range of concurrencies). At that point, I decided to > investigate the performance impact of write barriers. At 90% of RAM you're probable reading data as well, not only writing. Watching iostat -xk 1 or vmstat 1 during a test should confirm this. To find the maximum database size that fits comfortably in RAM you could try out http://github.com/gregs1104/pgbench-tools - my experience with it is that it takes less than 10 minutes to setup and run and after some time you get rewarded with nice pictures! :-) regards, Yeb Havinga