pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Ryan Hansen <ryan.hansen@brightbuilders.com>
To: pgsql-performance@postgresql.org
Subject: Memory Allocation
Date: Wed, 26 Nov 2008 15:09:55 -0700
Message-ID: <011101c95013$b6fca0a0$24f5e1e0$@hansen@brightbuilders.com> (raw)

Hey all,

 

This may be more of a Linux question than a PG question, but I'm wondering
if any of you have successfully allocated more than 8 GB of memory to PG
before.

 

I have a fairly robust server running Ubuntu Hardy Heron, 24 GB of memory,
and I've tried to commit half the memory to PG's shared buffer, but it seems
to fail.  I'm setting the kernel shared memory accordingly using sysctl,
which seems to work fine, but when I set the shared buffer in PG and restart
the service, it fails if it's above about 8 GB.  I actually have it
currently set at 6 GB.

 

I don't have the exact failure message handy, but I can certainly get it if
that helps.  Mostly I'm just looking to know if there's any general reason
why it would fail, some inherent kernel or db limitation that I'm unaware
of.  

 

If it matters, this DB is going to be hosting and processing hundreds of GB
and eventually TB of data, it's a heavy read-write system, not transactional
processing, just a lot of data file parsing (python/bash) and bulk loading.
Obviously the disks get hit pretty hard already, so I want to make the most
of the large amount of available memory wherever possible.  So I'm trying to
tune in that direction.

 

Any info is appreciated.

 

Thanks!

view thread (13+ messages)  latest in thread

Message-ID: <011101c95013$b6fca0a0$24f5e1e0$@hansen@brightbuilders.com>
Permalink:  ../011101c95013$b6fca0a0$24f5e1e0$@hansen@brightbuilders.com/
Also on:    postgresql.org/message-id/011101c95013$b6fca0a0$24f5e1e0$@hansen@brightbuilders.com

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: ryan.hansen@brightbuilders.com
  Subject: Re: Memory Allocation
  In-Reply-To: <011101c95013$b6fca0a0$24f5e1e0$@hansen@brightbuilders.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox