Date: Tue, 6 Mar 2018 20:39:33 +0100
From: Johannes Truschnigg <johannes@truschnigg.info>
To: David Steele <david@pgmasters.net>
Cc: pgsql-admin@lists.postgresql.org
Subject: Re: Reliable WAL file shipping over unreliable network
Message-ID: <20180306193933.sug6dai4zzekchnj@vault.lan>
References: <20180302180911.GO2416@tamriel.snowman.net>
 <BB8E0E71-D65F-409F-B9AD-DDF2237CDF99@icloud.com>
 <20180304150640.GR2416@tamriel.snowman.net>
 <3D9CC2FB-57E1-45B2-B5FC-1B214F5DB068@icloud.com>
 <20180305111521.GV2416@tamriel.snowman.net>
 <ABC9F093-7249-498E-901B-6ADB7BBA3B22@icloud.com>
 <20180305150218.GY2416@tamriel.snowman.net>
 <15F9D550-9909-40B3-A384-417AFCD745DF@icloud.com>
 <20180306190004.GQ2416@tamriel.snowman.net>
 <68099b52-3909-07e3-04ea-b5ba600b1767@pgmasters.net>
MIME-Version: 1.0
Content-Type: multipart/signed; micalg=pgp-sha512;
	protocol="application/pgp-signature"; boundary="ez7blyozt3pmakvy"
Content-Disposition: inline
In-Reply-To: <68099b52-3909-07e3-04ea-b5ba600b1767@pgmasters.net>
User-Agent: NeoMutt/20170113 (1.7.2)
Precedence: bulk


--ez7blyozt3pmakvy
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable

On Tue, Mar 06, 2018 at 02:31:55PM -0500, David Steele wrote:
> On 3/6/18 2:00 PM, Stephen Frost wrote:
> > [...]
> >=20
> > I'd encourage you to consider submitting this to a commitfest to get
> > feedback on it, as a proper patch to add such a utlity to PG and which
> > we could use in our documentation instead of saying "cp", which is
> > pretty terrible.
>=20
> +1.  I believe there's been talk of a pgcopy utility before but it never
> went anywhere.  I think it would be worth it just to have a decent
> example in the docs.

I wrote a (rather trivial, but it has proven useful) utility for a
minimalistic "archive_command" a while ago - it is available at
https://johannes.truschnigg.info/code/pg_archive_wal_segment-2.0.0/
because I was unhappy with the suboptimal approach that the shell one-liner
cited in the docs took.

I'm not sure if it will survive a thousand eyeballs' close look, but it has
served us well for more than three years now with anywhere between 10000 and
80000 WAL segments archived each day (to a destination filesystem that is t=
hen
exported as an NFS share).


--=20
with best regards:
- Johannes Truschnigg ( johannes@truschnigg.info )

www:   https://johannes.truschnigg.info/
phone: +43 650 2 133337
xmpp:  johannes@truschnigg.info

Please do not bother me with HTML-email or attachments. Thank you.

--ez7blyozt3pmakvy
Content-Type: application/pgp-signature; name="signature.asc"

-----BEGIN PGP SIGNATURE-----

iQIzBAABCgAdFiEEGu9IhkI+7/aKLUWF95W3jMsYfLUFAlqe7nEACgkQ95W3jMsY
fLW5dA//fR6GBJTDpwoL2NsAXzl0fhaZiy2sIfSK+eTxRjfh68ojZrAjM8s+xacn
6efMyhnm3znl9vL5KLy3U8Bt2XWB6F608Rw9qCbxIwk4BAPl5SPF/yx41FaNQWJp
fn6uuDGYCvjgUR5sn1Fkt26DCTaGOy9vAB6vLVmxJsb7hD5EFlAmLfKsj2+njXOu
MScCNFuCLldHRf7Yg8R8x7jcSq1bIrSDJK5UEyZ57OzRoUNNXpDhOhbvOq8Kw8Jh
XXWH9/Syp51Ktw31xiS2K1kdqbijSMiiW1Fl5xnnUcKtVp9UjkqPI5jcUSKF42pr
oysAVB7IrQtMaW4xGSo5902NqsMXJdvNzIGpYDNOGh5gdOzip32F1p1L7jYbIhym
o1Cdj75YRAK6o4niYevCm4yi0A2t3KtsWaTAHiyaXmfgqE6rSpM3Q0n7Iaq3HihC
k4btBTXbQzBP5loB02HVV8qJ4Dp5hlqt6k+LtXvYgs+5u2W/e+OV0Ow4tnK36Sv9
ChXN3Qd7zQGU0aToJv71gQo9ZMKOrZPPKEEUrwP3AmyO4Q/hnQ1oa0+cknwICxx9
TTevmFE3ovTFYqytfehKoYWyvz3OHlsNLLAlfLg03cditzV+NPOWfBDioZCT4w1O
/XjKjc4EtLoJtM3A06asp38hcoaqKz8q33QmnVjRxEBPjsuU/fs=
=S5Ql
-----END PGP SIGNATURE-----

--ez7blyozt3pmakvy--