From: scott ribe <scott_ribe@elevated-dev.com>
To: Nagy László Zsolt <gandalf@shopzeus.com>
Cc: pgsql-admin@lists.postgresql.org
Subject: Re: Reliable WAL file shipping over unreliable network
Date: Wed, 28 Feb 2018 09:38:57 -0700
Message-ID: <BA4A1866-95B0-49C6-8CD1-3D1B60A7837E@elevated-dev.com> (raw)
In-Reply-To: <debd4205-e27a-cd9d-9169-6748e65083a2@shopzeus.com>
References: <dd116172-3ddf-ee56-57f3-6e18d49abf8e@shopzeus.com>
<400AC9CD-1E43-422C-A689-70BDBAFF231E@elevated-dev.com>
<ee3ae4be-ab24-8443-82c1-95bcd4f86a63@shopzeus.com>
<debd4205-e27a-cd9d-9169-6748e65083a2@shopzeus.com>
On Feb 28, 2018, at 8:46 AM, Nagy László Zsolt <gandalf@shopzeus.com> wrote:
>
> Another problem with rsync might be that it does not know if a WAL file
> on the source side is growing (e.g. being written) and it might start
> copy that before it is fully flushed to disk. I see this as a big
> problem, but I don't have experience.
You use rsync in the archive command, not by itself. Postgres does not try to copy the file until it is ready.
> E.g. move the file into the archive dir only after it has been fully
> copied to the destination volume. But then we still have the problem of
> partially written files on the slave side.
No, you do not have that problem at all.
Given an unreliable network, you probably do want to use --partial
--
Scott Ribe
https://www.linkedin.com/in/scottribe/
(303) 722-0567
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-admin@postgresql.org
Cc: scott_ribe@elevated-dev.com, gandalf@shopzeus.com, pgsql-admin@lists.postgresql.org
Subject: Re: Reliable WAL file shipping over unreliable network
In-Reply-To: <BA4A1866-95B0-49C6-8CD1-3D1B60A7837E@elevated-dev.com>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox