Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.84_2) (envelope-from ) id 1bSBXJ-0002O6-8Y for pgsql-admin@arkaria.postgresql.org; Tue, 26 Jul 2016 23:13:17 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.84_2) (envelope-from ) id 1bSBXI-0001it-MS for pgsql-admin@arkaria.postgresql.org; Tue, 26 Jul 2016 23:13:16 +0000 Received: from makus.postgresql.org ([2001:4800:1501:1::229]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1bSBVd-0008I2-Jv for pgsql-admin@postgresql.org; Tue, 26 Jul 2016 23:11:33 +0000 Received: from tamriel.snowman.net ([2001:4830:167b::11]) by makus.postgresql.org with esmtp (Exim 4.84_2) (envelope-from ) id 1bSBVb-0004QA-8H for pgsql-admin@postgresql.org; Tue, 26 Jul 2016 23:11:32 +0000 Received: by tamriel.snowman.net (Postfix, from userid 1000) id EF7EC5F7B9; Tue, 26 Jul 2016 19:11:29 -0400 (EDT) Date: Tue, 26 Jul 2016 19:11:29 -0400 From: Stephen Frost To: Bruce Momjian Cc: Jerry Sievers , pgsql-admin@postgresql.org Subject: Re: Pg-Upgrade standbys via rsync... and avoid sending UNlogged data? Message-ID: <20160726231129.GH4028@tamriel.snowman.net> References: <86d1m5b6bi.fsf@jerry.enova.com> <20160725163700.GZ4028@tamriel.snowman.net> <20160725164329.GA4028@tamriel.snowman.net> <86eg6hr58q.fsf@jerry.enova.com> <20160726161946.GA3511@momjian.us> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="c4ATLI8HJzklxeaH" Content-Disposition: inline In-Reply-To: <20160726161946.GA3511@momjian.us> X-Editor: Vim http://www.vim.org/ X-Info: http://www.snowman.net X-Operating-System: Linux/3.13.0-91-generic (x86_64) X-Uptime: 19:11:15 up 18 days, 35 min, 7 users, load average: 0.26, 0.17, 0.10 User-Agent: Mutt/1.5.21 (2010-09-15) X-Pg-Spam-Score: -3.2 (---) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-admin Precedence: bulk Sender: pgsql-admin-owner@postgresql.org --c4ATLI8HJzklxeaH Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable * Bruce Momjian (bruce@momjian.us) wrote: > On Mon, Jul 25, 2016 at 12:34:45PM -0500, Jerry Sievers wrote: > > Stephen Frost writes: > >=20 > > > * Stephen Frost (sfrost@snowman.net) wrote: > > > > > >> > I have among others, a 5TB system w/about 40G of unlogged data. > > >>=20 > > >> Honestly, sending an extra 40G out of 5TB (we're talking less than 1% > > >> here...) might be worth it to keep the process simple. > > > > > > Of course, I realize right after sending this that you aren't sending > > > the 5TB. :) > >=20 > > Roger that! Really, the hard link pg-upgrade option and rsync method > > for standbys is pure beauty :-) > >=20 > > We have only the post-analyze and this unlogged data problem to deal > > with.=20 > >=20 > > The warehouse is our only system with any substantial amount of unlogged > > data. > >=20 > > Reducing post-analyze delay was solved by me here with our groovy > > threaded AnalyzMaTron. I can get a >5TB system done in about 45 minutes > > w/20 threads. >=20 > The only thing I can suggest is to document this limitation, if people > think it is worth it. It'd probably be good to document what happens with unlogged tables. Thanks! Stephen --c4ATLI8HJzklxeaH Content-Type: application/pgp-signature; name="signature.asc" Content-Description: Digital signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQIcBAEBCgAGBQJXl+4hAAoJEO1sijiDR2RVAx4P/2edKR+Fll3+86Fy9Cytnrjn 4iP7uxe7nm4nC6oBdN0fdN5mWu5NHULu4+w/jnZeFueYJtqRTjCZjUHpKlESQbD2 +LwQpBQfNY+A7bj5M+X1NG5YUoS3mNWmYxV7C6g1dyDLXFPvIyNUCq3d+Af5h9n/ oRybescMlKUgSMQ0QNvX8EYQVkSn8TgLBq1c2Y1Lbo3iD5ReVKuVY2xSM7pgBYdF DEoDHdmfgD/I/srMJX+CuITHNmbvOcHBtnf035LA+6AHNmYIuTAPrVPOrJmgkjPk ptNmPoQWohoTwC9quV8y7sv7sgYltzWX10BiHlhemlCPpRpkc7XYQIkRx52Er59K OHnXsC92vH+QkcvKw7ksqa2/dQGPP9wG6aZh2/xewkxmE34F0ByFzgxuPqkUt9d8 90PqOvJxVgJUw6x0FQ4Uc0V3IC9mLuRn9pwugv2SoGdNf/ZQQMnvdHWmKC33pjnw wbb/0udvwajqz9cGhS3EhZbkcqis7whs4qFoqWhDGUUFOZ1N3VFFSHrC2wqs/RrM OEPJZ3mEYV/78Y/GBZIM8oTUeRKE8/yffn75n7yMmV2lhuCL36I2OqDtY0z5N2o7 oBPK0ezAX1YSiACjzUGnWuQwOvL10KTAQgnBCwEtfyCo3y2MwuRPoeAU948p+570 +RftYbKy1vmsdNj8oFyr =pp4a -----END PGP SIGNATURE----- --c4ATLI8HJzklxeaH--