pg.ddx.io  pgsql-admin@postgresql.org mailing list archive  

help / color / mirror / Atom feed
From: Johannes Truschnigg <johannes@truschnigg.info>
To: David Steele <david@pgmasters.net>
Cc: pgsql-admin@lists.postgresql.org
Subject: Re: Reliable WAL file shipping over unreliable network
Date: Tue, 6 Mar 2018 20:39:33 +0100
Message-ID: <20180306193933.sug6dai4zzekchnj@vault.lan> (raw)
In-Reply-To: <68099b52-3909-07e3-04ea-b5ba600b1767@pgmasters.net>
References: <20180302180911.GO2416@tamriel.snowman.net>
	<BB8E0E71-D65F-409F-B9AD-DDF2237CDF99@icloud.com>
	<20180304150640.GR2416@tamriel.snowman.net>
	<3D9CC2FB-57E1-45B2-B5FC-1B214F5DB068@icloud.com>
	<20180305111521.GV2416@tamriel.snowman.net>
	<ABC9F093-7249-498E-901B-6ADB7BBA3B22@icloud.com>
	<20180305150218.GY2416@tamriel.snowman.net>
	<15F9D550-9909-40B3-A384-417AFCD745DF@icloud.com>
	<20180306190004.GQ2416@tamriel.snowman.net>
	<68099b52-3909-07e3-04ea-b5ba600b1767@pgmasters.net>

On Tue, Mar 06, 2018 at 02:31:55PM -0500, David Steele wrote:
> On 3/6/18 2:00 PM, Stephen Frost wrote:
> > [...]
> > 
> > I'd encourage you to consider submitting this to a commitfest to get
> > feedback on it, as a proper patch to add such a utlity to PG and which
> > we could use in our documentation instead of saying "cp", which is
> > pretty terrible.
> 
> +1.  I believe there's been talk of a pgcopy utility before but it never
> went anywhere.  I think it would be worth it just to have a decent
> example in the docs.

I wrote a (rather trivial, but it has proven useful) utility for a
minimalistic "archive_command" a while ago - it is available at
https://johannes.truschnigg.info/code/pg_archive_wal_segment-2.0.0/
because I was unhappy with the suboptimal approach that the shell one-liner
cited in the docs took.

I'm not sure if it will survive a thousand eyeballs' close look, but it has
served us well for more than three years now with anywhere between 10000 and
80000 WAL segments archived each day (to a destination filesystem that is then
exported as an NFS share).


-- 
with best regards:
- Johannes Truschnigg ( johannes@truschnigg.info )

www:   https://johannes.truschnigg.info/
phone: +43 650 2 133337
xmpp:  johannes@truschnigg.info

Please do not bother me with HTML-email or attachments. Thank you.

Attachments:

  signature.asc (application/pgp-signature, 832B) download

view thread (59+ messages)  latest in thread

Message-ID: <20180306193933.sug6dai4zzekchnj@vault.lan>
Permalink:  ../20180306193933.sug6dai4zzekchnj@vault.lan/
Also on:    postgresql.org/message-id/20180306193933.sug6dai4zzekchnj@vault.lan

 · 

reply
Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-admin@postgresql.org
  Cc: johannes@truschnigg.info, david@pgmasters.net, pgsql-admin@lists.postgresql.org
  Subject: Re: Reliable WAL file shipping over unreliable network
  In-Reply-To: <20180306193933.sug6dai4zzekchnj@vault.lan>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox