Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1WzVpC-00072N-FJ for pgsql-admin@arkaria.postgresql.org; Tue, 24 Jun 2014 18:52:10 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.80) (envelope-from ) id 1WzVpB-0002U5-UP for pgsql-admin@arkaria.postgresql.org; Tue, 24 Jun 2014 18:52:09 +0000 Received: from makus.postgresql.org ([2001:4800:1501:1::229]) by malur.postgresql.org with esmtps (TLS1.2:DHE_RSA_AES_256_CBC_SHA256:256) (Exim 4.80) (envelope-from ) id 1WzVp9-0002Qx-Tb for pgsql-admin@postgresql.org; Tue, 24 Jun 2014 18:52:08 +0000 Received: from smtp2.zyquest.net ([72.44.255.254]) by makus.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1WzVp6-0000cW-Lz for pgsql-admin@postgresql.org; Tue, 24 Jun 2014 18:52:06 +0000 X-Warning: RFC compliance checks disabled due to whitelist X-Warning: Reverse-Path DNS check skipped due to whitelist X-Warning: Maximum message size check skipped due to whitelist X-Warning: Realtime Block Lists skipped due to whitelist X-Warning: System filters skipped due to whitelist X-Warning: Domain filters skipped due to whitelist X-Warning: User filters skipped due to whitelist X-Warning: Anti-Spam check skipped due to whitelist X-Whitelist: 2147483645 X-Envelope-From: andrew.krause@breakthroughfuel.com X-Envelope-To: jayknowsunix@gmail.com Received: From Zy72-44-242-134.zyquest.net (72.44.242.134) by smtp2.zyquest.net (MAILFOUNDRY) id oZnTqPvQEeOgDgAl; Tue, 24 Jun 2014 18:52:03 -0000 (GMT) Received: from BTFPHXPMAIL01.breakthroughfuel.com ([10.20.0.87]) by BTFPHXPMAIL01 ([10.20.0.87]) with mapi id 14.03.0174.001; Tue, 24 Jun 2014 13:52:03 -0500 From: Andrew Krause To: John Scalia CC: "pgsql-admin@postgresql.org" Subject: Re: Wal archive way behind in streaming replication Thread-Topic: [ADMIN] Wal archive way behind in streaming replication Thread-Index: AQHPj91jY83Sv4VgpU+CELm9Snp4MA== Date: Tue, 24 Jun 2014 18:52:03 +0000 Message-ID: <3709F6AF-032E-4095-B0CB-DC1CE36F6B4B@breakthroughfuel.com> References: <53A9B567.5070301@gmail.com> <53A9C139.2040704@gmail.com> In-Reply-To: <53A9C139.2040704@gmail.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [67.53.157.2] Content-Type: text/plain; charset="Windows-1252" Content-ID: <1C97CCF7CADE4E449EA43D2CDCB16EB4@breakthroughfuel.com> Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Pg-Spam-Score: -1.9 (-) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-admin Precedence: bulk Sender: pgsql-admin-owner@postgresql.org You shouldn=92t have to touch the files as long as they aren=92t compressed= . You may have to restart the standby instance to get the recovery to begi= n though. I=92d suggest tailing your instance log and restarting the stand= by instance. It should show that the logs from the gap are applying right = away at startup.=20 Andrew Krause On Jun 24, 2014, at 1:19 PM, John Scalia wrote: >=20 > Ok, I did the copy from pg_xlog directory into the restore.conf specified= directory. The standby servers seem fine with that, however, just copying d= oes not inform the primary that > the copy has happened. The archive_status directory under pg_xlog on the = primary still thinks the last WAL sent was *B7 and yet it's now writing *C9= . When I did the copy it was > only up to *C7 and nothing else has shown in the standby's directory. >=20 > Now, the *.done files in archive_status are just zero length, but I'm a b= it hesitant to just do a touch for the ones I manually copied as I don't kn= ow if this is from an in-memory > queue or if it Postgresql reads the contents of this regularly in order t= o decide what to copy. >=20 > Is that safe to do? >=20 > On 6/24/2014 9:56 AM, Andrew Krause wrote: >> You can copy all of the WAL logs from your gap to the standby. If you p= lace them in the correct location (directory designated for restore) theins= tance will automatically apply them all. >>=20 >>=20 >> Andrew Krause >>=20 >>=20 >>=20 >> On Jun 23, 2014, at 9:24 AM, John Scalia wrote: >>=20 >>> Came in this morning to numerous complaints from pgpool about the stand= by servers being behind from the primary. Looking into it, no WAL files had= been transferred since late Friday. All I did was restart the primaryand t= he WAL archving resumed, however, looking at the WAL files on the standby s= ervers, this is never going to catch up. Now, I've got the archive_timeout = on the primary =3D 600 or 10 minutes and I see WAL files in pg_xlog every 1= 0 minutes. As they show up on the standby servers, they're also 10 minutes = apart, but the primary is writing *21 and the standby's areonly up to *10. = Now, like I said prior, with there being 10 minutes (600seconds) between tr= ansfers (the same pace as the WALs are generated) it will never catch up. I= s this really the intended behavior? How would I get the additional WAL fil= es over to the standbys without waiting 10 minutes to copy them one at a ti= me? >>> -- >>> Jay >>>=20 >>>=20 >>> -- >>> Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) >>> To make changes to your subscription: >>> http://www.postgresql.org/mailpref/pgsql-admin >>=20 >=20 >=20 >=20 >=20 >=20 >=20 > --=20 > Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) > To make changes to your subscription: > http://www.postgresql.org/mailpref/pgsql-admin --=20 Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin