pg.ddx.io  pgsql-admin@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Joshua D. Drake <jd@commandprompt.com>
To: Darren Reed <darrenr+postgres@fastmail.net>
Cc: pgsql-admin@postgresql.org
Subject: Re: Is my database now too big?
Date: Sat, 06 Oct 2007 23:05:23 -0700
Message-ID: <47087723.7040403@commandprompt.com> (raw)
In-Reply-To: <1191730382.18880.1214536197@webmail.messagingengine.com>
References: <1191730382.18880.1214536197@webmail.messagingengine.com>

Darren Reed wrote:
> I'm starting to wonder if my database has finally grown too big for my
> computer.
> 
> But, rather than peform badly, I see a number of "bad things" happen:
> 
> * pg_dump fails to run, causing an "out of memory" error (I don't
> understand
>   why this happens, but it does);
> 
> * restarting postgres across a reboot results in tables disappearing
>   without any error messages being given out (this is *really
>   disturbing*.)

Are you vacuuming?

> 
> postgres itself, however, starts up fine.
> 
> "wc -l" of the output from the last successuful dump_all is around
> 8million
> lines, spread across half a dozen or so tables.
> 
> I'm afraid that if I restructure the db to have smaller tables, I'd just
> be
> putting off "hitting" the ceiling.
> 
> What can I safely do to get postgres running normally?
> 
> I'm currently using 8.1.3, will I fare any better with a more recent
> version?
> 
> My end goal is to have maybe 50 million records.  Will postgresql handle
> this
> (with only 1.5GB of RAM) or do I need to look elsewhere for a db of this
> size?
> 
> Thoughts?
> 
> Cheers,
> Darren
> 
> ---------------------------(end of broadcast)---------------------------
> TIP 5: don't forget to increase your free space map settings
> 




view thread (27+ messages)  latest in thread

Message-ID: <47087723.7040403@commandprompt.com>
Permalink:  ../47087723.7040403@commandprompt.com/
Also on:    postgresql.org/message-id/47087723.7040403@commandprompt.com

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-admin@postgresql.org
  Cc: jd@commandprompt.com, darrenr+postgres@fastmail.net
  Subject: Re: Is my database now too big?
  In-Reply-To: <47087723.7040403@commandprompt.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox