From: Bruce Momjian <bruce@momjian.us>
To: Stephen Frost <sfrost@snowman.net>
Cc: Jerry Sievers <gsievers19@comcast.net>
Cc: pgsql-admin@postgresql.org
Subject: Re: Pg-Upgrade standbys via rsync... and avoid sending UNlogged data?
Date: Thu, 4 Aug 2016 18:55:36 -0400
Message-ID: <20160804225536.GA22579@momjian.us> (raw)
In-Reply-To: <20160726231129.GH4028@tamriel.snowman.net>
References: <86d1m5b6bi.fsf@jerry.enova.com>
<20160725163700.GZ4028@tamriel.snowman.net>
<20160725164329.GA4028@tamriel.snowman.net>
<86eg6hr58q.fsf@jerry.enova.com>
<20160726161946.GA3511@momjian.us>
<20160726231129.GH4028@tamriel.snowman.net>
List-Unsubscribe: <mailto:majordomo@postgresql.org?body=unsub%20pgsql-admin>
On Tue, Jul 26, 2016 at 07:11:29PM -0400, Stephen Frost wrote:
> * Bruce Momjian (bruce@momjian.us) wrote:
> > On Mon, Jul 25, 2016 at 12:34:45PM -0500, Jerry Sievers wrote:
> > > Stephen Frost <sfrost@snowman.net> writes:
> > >
> > > > * Stephen Frost (sfrost@snowman.net) wrote:
> > > >
> > > >> > I have among others, a 5TB system w/about 40G of unlogged data.
> > > >>
> > > >> Honestly, sending an extra 40G out of 5TB (we're talking less than 1%
> > > >> here...) might be worth it to keep the process simple.
> > > >
> > > > Of course, I realize right after sending this that you aren't sending
> > > > the 5TB. :)
> > >
> > > Roger that! Really, the hard link pg-upgrade option and rsync method
> > > for standbys is pure beauty :-)
> > >
> > > We have only the post-analyze and this unlogged data problem to deal
> > > with.
> > >
> > > The warehouse is our only system with any substantial amount of unlogged
> > > data.
> > >
> > > Reducing post-analyze delay was solved by me here with our groovy
> > > threaded AnalyzMaTron. I can get a >5TB system done in about 45 minutes
> > > w/20 threads.
> >
> > The only thing I can suggest is to document this limitation, if people
> > think it is worth it.
>
> It'd probably be good to document what happens with unlogged tables.
Attached patch applied to head.
--
Bruce Momjian <bruce@momjian.us> http://momjian.us
EnterpriseDB http://enterprisedb.com
+ As you are, so once was I. As I am, so you will be. +
+ Ancient Roman grave inscription +
--
Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-adminAttachments:rsync.diff (text/x-diff, 676B) downloaddiff --git a/doc/src/sgml/ref/pgupgrade.sgml b/doc/src/sgml/ref/pgupgrade.sgmlnew file mode 100644index fcc94ee..7f1c52a
*** a/doc/src/sgml/ref/pgupgrade.sgml
--- b/doc/src/sgml/ref/pgupgrade.sgml
*************** rsync --archive --delete --hard-links --
*** 504,509 ****
--- 504,511 ----
</para>
<para>
+ Unfortunately, <application>rsync</> also needlessly copies the+ files associated with temporary and unlogged tables.
If you have tablespaces, you will need to run a similar
<application>rsync</> command for each tablespace directory. If you
have relocated <filename>pg_xlog</> outside the data directories,
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-admin@postgresql.org
Cc: bruce@momjian.us, sfrost@snowman.net, gsievers19@comcast.net
Subject: Re: Pg-Upgrade standbys via rsync... and avoid sending UNlogged data?
In-Reply-To: <20160804225536.GA22579@momjian.us>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox