Received: from maia.hub.org (unknown [200.46.208.211]) by mail.postgresql.org (Postfix) with ESMTP id 26C916326CE for ; Fri, 12 Mar 2010 13:12:00 -0400 (AST) Received: from mail.postgresql.org ([200.46.204.86]) by maia.hub.org (mx1.hub.org [200.46.208.211]) (amavisd-maia, port 10024) with ESMTP id 94708-04 for ; Fri, 12 Mar 2010 17:11:48 +0000 (UTC) X-Greylist: from auto-whitelisted by SQLgrey-1.7.6 Received: from momjian.us (momjian.us [70.90.9.53]) by mail.postgresql.org (Postfix) with ESMTP id 8F6CF633829 for ; Fri, 12 Mar 2010 13:11:40 -0400 (AST) Received: (from bruce@localhost) by momjian.us (8.11.6/8.11.6) id o2CHBHf27975; Fri, 12 Mar 2010 12:11:17 -0500 (EST) From: Bruce Momjian Message-Id: <201003121711.o2CHBHf27975@momjian.us> Subject: Re: Off-site storage for PITR logs In-Reply-To: <4B9A6E8B.4050303@magneta.com.cy> To: Nicos Panayides Date: Fri, 12 Mar 2010 12:11:17 -0500 (EST) CC: pgsql-admin@postgresql.org, koichi.szk@gmail.com X-Mailer: ELM [version 2.4ME+ PL124 (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="US-ASCII" X-Virus-Scanned: Maia Mailguard 1.0.1 X-Spam-Status: No, hits=-2.371 tagged_above=-10 required=5 tests=AWL=0.228, BAYES_00=-2.599 X-Spam-Level: X-Archive-Number: 201003/80 X-Sequence-Number: 33879 Nicos Panayides wrote: > Hi, > I am planning an off-site backup solution for a fairly busy > (mostly-write) 8.3 database. The database is currently about 200GB in > size. I though about using log shipping and cold standby since it's easy > in terms of administration and also offers point in time recovery. > > The database generates about 3 PITR log files per minute. If my > calculations are correct the sites need to be connected with a 7MBit > connection and the logs will need about 68GB of storage per day! > > Does anyone have any suggestions on how to significantly reduce the > volume of log files or recommend another off-site backup solution that > would require less bandwidth and storage? I would use pg_lesslog to reduce the size of the WAL files: http://pgfoundry.org/projects/pglesslog/ However, there is a bug in pg_lesslog so I wouldn't use it until that is fixed: http://archives.postgresql.org/pgsql-announce/2010-02/msg00005.php Koichi, do you have any update on this? I don't see that a new version has been uploaded, and I also see no mention on the pgfoundry site about the bug. -- Bruce Momjian http://momjian.us EnterpriseDB http://enterprisedb.com PG East: http://www.enterprisedb.com/community/nav-pg-east-2010.do