X-Original-To: pgsql-performance-postgresql.org@localhost.postgresql.org Received: from localhost (unknown [64.117.224.130]) by svr1.postgresql.org (Postfix) with ESMTP id 9BC2CD1B55E for ; Wed, 10 Sep 2003 22:38:12 +0000 (GMT) Received: from svr1.postgresql.org ([64.117.224.193]) by localhost (neptune.hub.org [64.117.224.130]) (amavisd-new, port 10024) with ESMTP id 82442-06 for ; Wed, 10 Sep 2003 19:38:03 -0300 (ADT) Received: from news.hub.org (unknown [64.117.224.194]) by svr1.postgresql.org (Postfix) with ESMTP id 9E2C7D1B563 for ; Wed, 10 Sep 2003 19:38:00 -0300 (ADT) Received: from news.hub.org (host-64-117-224-194.altec1.com [64.117.224.194] (may be forged)) by news.hub.org (8.12.9/8.12.9) with ESMTP id h8AMbxsl070634 for ; Wed, 10 Sep 2003 22:37:59 GMT (envelope-from news@news.hub.org) Received: (from news@localhost) by news.hub.org (8.12.9/8.12.9/Submit) id h8AM8iKo064676 for pgsql-performance@postgresql.org; Wed, 10 Sep 2003 22:08:44 GMT From: William Yu X-Newsgroups: comp.databases.postgresql.performance Subject: Re: Reading data in bulk - help? Date: Wed, 10 Sep 2003 15:08:48 -0700 Organization: Hub.Org Networking Services Lines: 20 Message-ID: References: <51478.129.178.88.66.1063194442.squirrel@mail2.fbab.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit X-Complaints-To: usenet@news.hub.org User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.4) Gecko/20030624 X-Accept-Language: en-us, en In-Reply-To: To: pgsql-performance@postgresql.org X-Virus-Scanned: by amavisd-new at postgresql.org X-Archive-Number: 200309/179 X-Sequence-Number: 3545 > 1) Memory - clumsily adjusted shared_buffer - tried three values: 64, > 128, 256 with no discernible change in performance. Also adjusted, > clumsily, effective_cache_size to 1000, 2000, 4000 - with no discernible > change in performance. I looked at the Admin manual and googled around > for how to set these values and I confess I'm clueless here. I have no > idea how many kernel disk page buffers are used nor do I understand what > the "shared memory buffers" are used for (although the postgresql.conf > file hints that it's for communication between multiple connections). > Any advice or pointers to articles/docs is appreciated. The standard procedure is 1/4 of your memory for shared_buffers. Easiest way to calculate would be ###MB / 32 * 1000. E.g. if you have 256MB of memory, your shared_buffers should be 256 / 32 * 1000 = 8000. The remaining memory you have leftover should be "marked" as OS cache via the effective_cache_size setting. I usually just multiply the shared_buffers value by 3 on systems with a lot of memory. With less memory, OS/Postgres/etc takes up a larger percentage of memory so values of 2 or 2.5 would be more accurate.