X-Original-To: pgsql-benchmarks-postgresql.org@localhost.postgresql.org Received: from localhost (unknown [200.46.204.144]) by svr1.postgresql.org (Postfix) with ESMTP id D5B7B329E8C for ; Tue, 14 Sep 2004 21:46:12 +0100 (BST) Received: from svr1.postgresql.org ([200.46.204.71]) by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024) with ESMTP id 30423-01 for ; Tue, 14 Sep 2004 20:46:07 +0000 (GMT) Received: from tht.net (vista.tht.net [216.126.88.2]) by svr1.postgresql.org (Postfix) with ESMTP id F3EE8329CFB for ; Tue, 14 Sep 2004 21:46:07 +0100 (BST) Received: from [134.22.70.99] (dyn-70-99.tor.dsl.tht.net [134.22.70.99]) by tht.net (Postfix) with ESMTP id 6E0B576C3E; Tue, 14 Sep 2004 16:46:11 -0400 (EDT) Subject: Re: Largest DATABASE From: Rod Taylor To: Jamil Cc: "'pgsql-benchmarks@postgresql.org'" In-Reply-To: References: Content-Type: text/plain; charset=iso-8859-1 Message-Id: <1095194766.98565.102.camel@jester> Mime-Version: 1.0 X-Mailer: Ximian Evolution 1.4.6 Date: Tue, 14 Sep 2004 16:46:06 -0400 Content-Transfer-Encoding: 8bit X-Virus-Scanned: by amavisd-new at hub.org X-Spam-Status: No, hits=0.0 tagged_above=0.0 required=5.0 tests= X-Spam-Level: X-Archive-Number: 200409/2 X-Sequence-Number: 17 > I would like to know witch was the largest database that you ever > had to administrate. My database is about to 160GB and I´ve got some > problems to backup it using the pg_dump command and I too have some problems > to run vaccum. Tell me about it. We started to do more fine grained scheduling of vacuum a little while back we we past the 120GB mark. You can try out the vacuum daemon, but it really didn't help me (little tables were ignored too much, big tables done too often). Check VACUUM VERBOSE output to see if you need to vacuum all of the structures at the current rate. We're still doing the dump, but running pg_dump on a different machine. Most of the CPU time it eats up is in formatting the data for the dump. Another option (which can take some effort) is to take the database offline, fsync, take a filesystem snapshot, restart the database, tar up the snapshot, remove the snapshot. Database downtime can be short enough that if clients reattempt a failed connection for some time (a couple of minutes), they'll simply see a hicup and not a failure. Looking forward to PITR making backups much friendlier.