From: Warner, Gary, Jr <gar@uab.edu>
To: postgres performance list <pgsql-performance@postgresql.org>
Subject: Big Memory Boxes and pgtune
Date: Fri, 28 Oct 2016 15:44:13 +0000
Message-ID: <0cfccbc24b9e480a9452bf9ca79e96e4@UABEX4.ad.uab.edu> (raw)
List-Unsubscribe: <mailto:majordomo@postgresql.org?body=unsub%20pgsql-performance>
I've recently been blessed to move one of my databases onto a huge IBM P8 computer. Its a power PC architecture with 20 8-way cores (so postgres SHOULD believe there are 160 cores available) and 1 TB of RAM.
I've always done my postgres tuning with a copy of "pgtune" which says in the output:
# WARNING
# this tool not being optimal
# for very high memory systems
So . . . what would I want to do differently based on the fact that I have a "very high memory system"?
Suggestions welcome!
(There are several different databases, mostly related to our work in social media and malware analytics. The databases are smaller than available RAM. Around 80 million social media profiles with 700M or so links, growing by 10% a week or so. The malware database has extracted statistics and data about 17 million malware samples, growing by about 5% per week. The Social Media side has just shy of 100 'fetchers' that insert/update (but don't delete.) A few human analysts interact with the data, hitting some pretty heavy queries as they do link analysis and natural language processing, but mostly the database use is the "fetchers")
------------------------------------------------------------------------------
Gary Warner, Director CETIFS gar@uab.edu
Center for Emerging Technology Investigations Forensics & Security
The University of Alabama at Birmingham (UAB)
205.422.2113
------------------------------------------------------------------------------
--
Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-performance
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-performance@postgresql.org
Cc: gar@uab.edu
Subject: Re: Big Memory Boxes and pgtune
In-Reply-To: <0cfccbc24b9e480a9452bf9ca79e96e4@UABEX4.ad.uab.edu>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox