Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.84_2) (envelope-from ) id 1c0Cu4-0000W2-0H for pgsql-performance@arkaria.postgresql.org; Fri, 28 Oct 2016 19:33:24 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.84_2) (envelope-from ) id 1c0Cu3-0004ME-0h for pgsql-performance@arkaria.postgresql.org; Fri, 28 Oct 2016 19:33:23 +0000 Received: from makus.postgresql.org ([2001:4800:1501:1::229]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1c0Cu2-0004Lf-0h for pgsql-performance@postgresql.org; Fri, 28 Oct 2016 19:33:22 +0000 Received: from lists.commandprompt.com ([2604:da00:2:2:5054:ff:fe07:7618]) by makus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1c0Ctt-0008Jo-Ol for pgsql-performance@postgresql.org; Fri, 28 Oct 2016 19:33:20 +0000 Received: from [192.168.1.60] (spinlock.commandprompt.com [69.168.55.30]) by lists.commandprompt.com (Postfix) with ESMTPA id BB430541; Fri, 28 Oct 2016 12:33:10 -0700 (PDT) Received: from c-73-225-27-179.hsd1.wa.comcast.net ([73.225.27.179] helo=[192.168.1.60]) by assp.commandprompt.com with SMTPSA(TLSv1_2 ECDHE-RSA-AES128-GCM-SHA256) (2.5.1); 28 Oct 2016 12:33:10 -0700 Subject: Re: Big Memory Boxes and pgtune To: "Warner, Gary, Jr" , postgres performance list References: <0cfccbc24b9e480a9452bf9ca79e96e4@UABEX4.ad.uab.edu> From: "Joshua D. Drake" Organization: Command Prompt, Inc. Message-ID: <44137c5c-2117-f497-7355-12ae06c1b299@commandprompt.com> Date: Fri, 28 Oct 2016 12:33:10 -0700 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.3.0 MIME-Version: 1.0 In-Reply-To: <0cfccbc24b9e480a9452bf9ca79e96e4@UABEX4.ad.uab.edu> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Assp-Version: 2.5.1(16177) on assp.commandprompt.com X-Assp-ID: assp.commandprompt.com m1-83190-02059 X-Assp-Session: 7FE6C9295238 (mail 1) X-Assp-Original-Subject: Re: [PERFORM] Big Memory Boxes and pgtune X-Assp-Client-SSL: yes X-Pg-Spam-Score: -3.3 (---) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-performance Precedence: bulk Sender: pgsql-performance-owner@postgresql.org On 10/28/2016 08:44 AM, Warner, Gary, Jr wrote: > I've recently been blessed to move one of my databases onto a huge IBM P8 computer. Its a power PC architecture with 20 8-way cores (so postgres SHOULD believe there are 160 cores available) and 1 TB of RAM. > > I've always done my postgres tuning with a copy of "pgtune" which says in the output: > > # WARNING > # this tool not being optimal > # for very high memory systems > > So . . . what would I want to do differently based on the fact that I have a "very high memory system"? The most obvious is that you are going to want to have (depending on PostgreSQL version): * A very high shared_buffers (in newer releases, it is not uncommon to have many, many GB of) * Use that work_mem baby. You have 1TB available? Take your average data set return, and make work_mem at least that. * IIRC (and this may be old advice), maintenance_work_mem up to 4GB. As I recall it won't effectively use more than that but I could be wrong. Lastly but most importantly, test test test. JD -- Command Prompt, Inc. http://the.postgres.company/ +1-503-667-4564 PostgreSQL Centered full stack support, consulting and development. Everyone appreciates your honesty, until you are honest with them. Unless otherwise stated, opinions are my own. -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance