Received: from localhost (unknown [200.46.204.184]) by postgresql.org (Postfix) with ESMTP id 629119F9669 for ; Sun, 7 Oct 2007 01:13:05 -0300 (ADT) Received: from postgresql.org ([200.46.204.71]) by localhost (mx1.hub.org [200.46.204.184]) (amavisd-maia, port 10024) with ESMTP id 50079-09 for ; Sun, 7 Oct 2007 01:13:01 -0300 (ADT) X-Greylist: from auto-whitelisted by SQLgrey-1.7.5 Received: from out1.smtp.messagingengine.com (out1.smtp.messagingengine.com [66.111.4.25]) by postgresql.org (Postfix) with ESMTP id AA2099F962F for ; Sun, 7 Oct 2007 01:13:02 -0300 (ADT) Received: from compute2.internal (compute2.internal [10.202.2.42]) by out1.messagingengine.com (Postfix) with ESMTP id 2D80E2EF24 for ; Sun, 7 Oct 2007 00:13:02 -0400 (EDT) Received: from web7.messagingengine.com ([10.202.2.216]) by compute2.internal (MEProxy); Sun, 07 Oct 2007 00:13:02 -0400 Received: by web7.messagingengine.com (Postfix, from userid 99) id 16C71B14D; Sun, 7 Oct 2007 00:13:02 -0400 (EDT) Message-Id: <1191730382.18880.1214536197@webmail.messagingengine.com> X-Sasl-Enc: HrDRZXE05AX0TpRZXqeqViIsfF2VSvMnOcVJnt+1Kd5c 1191730382 From: "Darren Reed" To: pgsql-admin@postgresql.org Content-Disposition: inline Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="ISO-8859-1" MIME-Version: 1.0 X-Mailer: MessagingEngine.com Webmail Interface Subject: Is my database now too big? Date: Sun, 07 Oct 2007 06:13:02 +0200 X-Virus-Scanned: Maia Mailguard 1.0.1 X-Archive-Number: 200710/31 X-Sequence-Number: 26945 I'm starting to wonder if my database has finally grown too big for my computer. But, rather than peform badly, I see a number of "bad things" happen: * pg_dump fails to run, causing an "out of memory" error (I don't understand why this happens, but it does); * restarting postgres across a reboot results in tables disappearing without any error messages being given out (this is *really disturbing*.) postgres itself, however, starts up fine. "wc -l" of the output from the last successuful dump_all is around 8million lines, spread across half a dozen or so tables. I'm afraid that if I restructure the db to have smaller tables, I'd just be putting off "hitting" the ceiling. What can I safely do to get postgres running normally? I'm currently using 8.1.3, will I fare any better with a more recent version? My end goal is to have maybe 50 million records. Will postgresql handle this (with only 1.5GB of RAM) or do I need to look elsewhere for a db of this size? Thoughts? Cheers, Darren