Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.84_2) (envelope-from ) id 1bRjme-0003UW-29 for pgsql-admin@arkaria.postgresql.org; Mon, 25 Jul 2016 17:35:16 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.84_2) (envelope-from ) id 1bRjmc-0006fZ-QL for pgsql-admin@arkaria.postgresql.org; Mon, 25 Jul 2016 17:35:14 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1bRjmc-0006e5-6L for pgsql-admin@postgresql.org; Mon, 25 Jul 2016 17:35:14 +0000 Received: from resqmta-po-10v.sys.comcast.net ([2001:558:fe16:19:96:114:154:169]) by magus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1bRjmS-0003EI-PB for pgsql-admin@postgresql.org; Mon, 25 Jul 2016 17:35:13 +0000 Received: from resomta-po-15v.sys.comcast.net ([96.114.154.239]) by resqmta-po-10v.sys.comcast.net with SMTP id RjlMb9VpWHqolRjmMbLdxN; Mon, 25 Jul 2016 17:34:58 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=comcast.net; s=q20140121; t=1469468098; bh=Vz+ovq3padzfKWY9yB2hBGzkE2f3a8vhOMOU64sJDbA=; h=Received:Received:Received:From:To:Subject:Date:Message-ID: MIME-Version:Content-Type; b=bbS04EvZ4RF3WA49c5YoRNNENLoAQA0PX+VI01AA1/579dzQAPyQecyV837brAqL+ 94y42oryRiBII3QqpS3NvHGjIT66pAtUaf0iogc3FHLIwdgcZnElVdhkl5psTIu1rM gHKPKXBODbTky09pafdZ8EPt6EjnYOteCuQwwF6CgYZgfrPcgFv4TFTc3r/5K5G/WP i2U1Hq8C5+rKnqIEpqFuDYZrY8dcH1Hul0yWvWMGdx3Zt/uMs/DhALUsKFshBT1KZn R2VjSZq0YBgbX6cdTAyyS5XIIwgykVDpXISXM4NssQhi6OblpGVRF1xJomc8QlCK2v Dd0lT8HqPj9Jg== Received: from jerry.enova.com ([12.187.116.132]) by comcast with SMTP id Rjm9bYdJFO4ovRjmBbLMqw; Mon, 25 Jul 2016 17:34:56 +0000 Received: by jerry.enova.com (Postfix, from userid 1001) id 46486740212; Mon, 25 Jul 2016 12:34:45 -0500 (CDT) From: Jerry Sievers To: Stephen Frost Cc: Jerry Sievers , pgsql-admin@postgresql.org Subject: Re: Pg-Upgrade standbys via rsync... and avoid sending UNlogged data? References: <86d1m5b6bi.fsf@jerry.enova.com> <20160725163700.GZ4028@tamriel.snowman.net> <20160725164329.GA4028@tamriel.snowman.net> Date: Mon, 25 Jul 2016 12:34:45 -0500 In-Reply-To: <20160725164329.GA4028@tamriel.snowman.net> (Stephen Frost's message of "Mon, 25 Jul 2016 12:43:29 -0400") Message-ID: <86eg6hr58q.fsf@jerry.enova.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/23.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-CMAE-Envelope: MS4wfDQTmDf7Poneevk6D5PXOCySCcBiB0hRVA8gWcr4pxk1PvmeVGMbPK8fpMvWguvkLE/hWfwsZn+KM4Dv1oCEcqfY1hd2OAGD3GzgyZoknbXgxYMkJnLj y7bPwI7/aWD97QRQgQsWKROipbBMETC14hm1XiRhJ0BfipxzMN+opPSIwE3Bp7JA4/i9q2+NCReSTPIIjFylnQqtpSJYwF9FNl6/r2BpAZ9+G7Y6rar1QbLO IvgqlfQ2c2HmJoggqlZZvg== X-Pg-Spam-Score: -3.0 (---) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-admin Precedence: bulk Sender: pgsql-admin-owner@postgresql.org Stephen Frost writes: > * Stephen Frost (sfrost@snowman.net) wrote: > >> > I have among others, a 5TB system w/about 40G of unlogged data. >> >> Honestly, sending an extra 40G out of 5TB (we're talking less than 1% >> here...) might be worth it to keep the process simple. > > Of course, I realize right after sending this that you aren't sending > the 5TB. :) Roger that! Really, the hard link pg-upgrade option and rsync method for standbys is pure beauty :-) We have only the post-analyze and this unlogged data problem to deal with. The warehouse is our only system with any substantial amount of unlogged data. Reducing post-analyze delay was solved by me here with our groovy threaded AnalyzMaTron. I can get a >5TB system done in about 45 minutes w/20 threads. Thanks! > Depends on your network speed if the 40G would be an issue or not then. > In some cases, it might only add a bit of time but keep the process > simple, other cases, it might take longer. I'm not really thrilled with > the idea of complicating the rsync in that way, but I can understand why > you're considering it. > > Thanks! > > Stephen -- Jerry Sievers e: jerry.sievers@comcast.net p: 312.241.7800 -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin