Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.84_2) (envelope-from ) id 1c09KO-0005hl-8x for pgsql-performance@arkaria.postgresql.org; Fri, 28 Oct 2016 15:44:20 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.84_2) (envelope-from ) id 1c09KN-000831-NR for pgsql-performance@arkaria.postgresql.org; Fri, 28 Oct 2016 15:44:19 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1c09KN-00082s-5S for pgsql-performance@postgresql.org; Fri, 28 Oct 2016 15:44:19 +0000 Received: from uabexch2.ad.uab.edu ([138.26.5.131]) by magus.postgresql.org with esmtps (TLS1.0:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.84_2) (envelope-from ) id 1c09KK-0005YS-Ee for pgsql-performance@postgresql.org; Fri, 28 Oct 2016 15:44:18 +0000 Received: from UABEX1.ad.uab.edu (138.26.5.142) by uabexch2.ad.uab.edu (138.26.5.131) with Microsoft SMTP Server (TLS) id 14.3.235.1; Fri, 28 Oct 2016 10:44:14 -0500 Received: from UABEX4.ad.uab.edu (138.26.5.145) by UABEX1.ad.uab.edu (138.26.5.142) with Microsoft SMTP Server (TLS) id 15.0.1210.3; Fri, 28 Oct 2016 10:44:14 -0500 Received: from UABEX4.ad.uab.edu ([138.26.5.145]) by UABEX4.ad.uab.edu ([138.26.5.145]) with mapi id 15.00.1210.000; Fri, 28 Oct 2016 10:44:14 -0500 From: "Warner, Gary, Jr" To: postgres performance list Subject: Big Memory Boxes and pgtune Thread-Topic: Big Memory Boxes and pgtune Thread-Index: AQHSMTIiezg8uYvCuEaMEHgAkS4lPw== Date: Fri, 28 Oct 2016 15:44:13 +0000 Message-ID: <0cfccbc24b9e480a9452bf9ca79e96e4@UABEX4.ad.uab.edu> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [67.78.239.92] Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Pg-Spam-Score: -4.0 (----) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-performance Precedence: bulk Sender: pgsql-performance-owner@postgresql.org I've recently been blessed to move one of my databases onto a huge IBM P8 c= omputer. Its a power PC architecture with 20 8-way cores (so postgres SHO= ULD believe there are 160 cores available) and 1 TB of RAM. I've always done my postgres tuning with a copy of "pgtune" which says in t= he output: # WARNING # this tool not being optimal # for very high memory systems So . . . what would I want to do differently based on the fact that I have = a "very high memory system"? Suggestions welcome! (There are several different databases, mostly related to our work in socia= l media and malware analytics. The databases are smaller than available R= AM. Around 80 million social media profiles with 700M or so links, growin= g by 10% a week or so. The malware database has extracted statistics and d= ata about 17 million malware samples, growing by about 5% per week. The S= ocial Media side has just shy of 100 'fetchers' that insert/update (but don= 't delete.) A few human analysts interact with the data, hitting some pre= tty heavy queries as they do link analysis and natural language processing,= but mostly the database use is the "fetchers") ---------------------------------------------------------------------------= --- Gary Warner, Director CETIFS gar@uab.edu Center for Emerging Technology Investigations Forensics & Security The University of Alabama at Birmingham (UAB) 205.422.2113 ---------------------------------------------------------------------------= --- --=20 Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance