Received: from maia.hub.org (maia-2.hub.org [200.46.204.251]) by mail.postgresql.org (Postfix) with ESMTP id 00431B5D803 for ; Thu, 29 Sep 2011 12:55:09 -0300 (ADT) Received: from mail.postgresql.org ([200.46.204.86]) by maia.hub.org (mx1.hub.org [200.46.204.251]) (amavisd-maia, port 10024) with ESMTP id 10255-04 for ; Thu, 29 Sep 2011 15:55:03 +0000 (UTC) X-Greylist: delayed 00:10:00.795521 by SQLgrey-1.8.0-rc2 Received: from EXHUB003-3.exch003intermedia.net (exhub003-3.exch003intermedia.net [207.5.74.110]) by mail.postgresql.org (Postfix) with ESMTP id A83E1B5D801 for ; Thu, 29 Sep 2011 12:55:03 -0300 (ADT) Received: from EXVMBX003-1.exch003intermedia.net ([207.5.74.41]) by EXHUB003-3.exch003intermedia.net ([207.5.74.110]) with mapi; Thu, 29 Sep 2011 08:45:01 -0700 From: Linas Virbalas To: Florian Pflug , Robert Haas CC: Heikki Linnakangas , Aidan Van Dyk , Euler Taveira de Oliveira , "pgsql-hackers@postgresql.org" Date: Thu, 29 Sep 2011 08:44:59 -0700 Subject: Re: Hot Backup with rsync fails at pg_clog if under load Thread-Topic: [HACKERS] Hot Backup with rsync fails at pg_clog if under load Thread-Index: Acx9aEDnelDTL50hQdyD9ymMvECJiABVn19q Message-ID: In-Reply-To: Accept-Language: en-US Content-Language: en X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Virus-Scanned: Maia Mailguard 1.0.1 X-Spam-Status: No, hits=-1.9 tagged_above=-5 required=5 tests=BAYES_00=-1.9, RCVD_IN_DNSWL_NONE=-0.0001 X-Spam-Level: X-Archive-Number: 201109/1580 X-Sequence-Number: 195769 > Linas, could you capture the output of pg_controldata *and* increase the > log level to DEBUG1 on the standby? We should then see nextXid value of > the checkpoint the recovery is starting from. I'll try to do that whenever I'm in that territory again... Incidentally, recently there was a lot of unrelated-to-this-post work to polish things up for a talk being given at PGWest 2011 Today :) > I also checked what rsync does when a file vanishes after rsync computed = the > file list, but before it is sent. rsync 3.0.7 on OSX, at least, complains > loudly, and doesn't sync the file. It BTW also exits non-zero, with a spe= cial > exit code for precisely that failure case. To be precise, my script has logic to accept the exit code 24, just as stated in PG manual: Docs> For example, some versions of rsync return a separate exit code for Docs> "vanished source files", and you can write a driver script to accept Docs> this exit code as a non-error case. -- Sincerely, Linas Virbalas http://flyingclusters.blogspot.com/