Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1nKIbe-0005Is-Cu for pgsql-admin@arkaria.postgresql.org; Wed, 16 Feb 2022 11:36:22 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1nKIbd-0001cA-4s for pgsql-admin@arkaria.postgresql.org; Wed, 16 Feb 2022 11:36:21 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1nKIbc-0001c0-Pj for pgsql-admin@lists.postgresql.org; Wed, 16 Feb 2022 11:36:20 +0000 Received: from evariste01.clarocloud.co.za ([196.13.181.165] helo=evaristesys.com) by magus.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1nKIbV-0006uK-Tg for pgsql-admin@lists.postgresql.org; Wed, 16 Feb 2022 11:36:20 +0000 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=evaristesys.com; s=defaultdkim; h=Sender:To:References:Message-Id: Content-Transfer-Encoding:Cc:Date:In-Reply-To:From:Subject:Mime-Version: Content-Type:Reply-To:Content-ID:Content-Description:Resent-Date:Resent-From: Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Id:List-Help: List-Unsubscribe:List-Subscribe:List-Post:List-Owner:List-Archive; bh=Rl+mc0Sy7IemXN1sdbwjjHYh/qx7kvzDHo7GolsMf6I=; b=hw8rqecytEoIMG1bbEoR8gX6nJ 67KG8EPsl4+kwpozVLFoxBwRkBQS3TBcsqJ75KjSg6joudnxJEOXRlKXZOPg+eE7wCzddOFRmEyCK fSTWVkzo37M6+mQXQiCVyuoJc2qLi2O+ROWSne8o9YvMgdIXnSubEGsgPbAsc9WaKz0g=; Received: from 071-090-217-141.res.spectrum.com ([71.90.217.141] helo=smtpclient.apple) by evaristesys.com with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1nKIbR-0001fR-Im; Wed, 16 Feb 2022 13:36:09 +0200 Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 15.0 \(3693.40.0.1.81\)) Subject: Re: Differential backup in database migration From: Alex Balashov In-Reply-To: <9AD73617-C013-4AF6-80C9-B7F1ECCE02A6@sqlexec.com> Date: Wed, 16 Feb 2022 06:36:05 -0500 Cc: pgsql-admin@lists.postgresql.org Content-Transfer-Encoding: quoted-printable Message-Id: <6AC5B740-2A61-4B95-A56E-AA1EB32CF5C4@evaristesys.com> References: <9AD73617-C013-4AF6-80C9-B7F1ECCE02A6@sqlexec.com> To: "Michaeldba@sqlexec.com" X-Mailer: Apple Mail (2.3693.40.0.1.81) Sender: sasha@evaristesys.com List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk Ah, interesting. I did not realise there is any replication scheme, = whether logical or physical, which would be binary-compatible across = such a large release gap. > On Feb 16, 2022, at 6:29 AM, Michaeldba@sqlexec.com wrote: >=20 > Consider pglogical with hardly any downtime and no need to catch any = changes during the cutover. >=20 > Sent from my iPad >=20 >> On Feb 16, 2022, at 6:24 AM, Alex Balashov = wrote: >>=20 >> =EF=BB=BFHi, >>=20 >> I sincerely apologise if this is a stupid question, in that it has = been answered enough times to enter an FAQ canon: >>=20 >> I=E2=80=99m faced with the daunting prospect of upgrading a PG 9.6 = installation to 14, in the process migrating a ~400 GB database. Due to = the large jump in major versions, the on-disk block storage of course = will not be in the slightest bit binary-compatible, so I will have to = dump out the DB & import it into the target DB, live via a network pipe. >>=20 >> This process is time-consuming, and can=E2=80=99t afford the downtime = on the old 9.6 DB. The issue, of course, is that the 9.6 DB will change = during the time this snapshot is being dumped out and imported. = Ultimately, the target database will need to be brought into consistency = with the incumbent database (more or less) at the point of a cut-over. >>=20 >> I suppose the most intuitive solution to me would be to import the = snapshot to the target DB, then take another, smaller differential = backup of some kind, and in turn import that. But perhaps there=E2=80=99s = another solution altogether, i.e. a much faster backup & restore? I see = that pgBackRest makes this argument to the prospective user. >>=20 >> I have no experience with pgBackRest or any such tool, so would = appreciate any advice on how to best go about this!=20 >>=20 >> Thank you in advance, and apologies again if the question is asked = routinely. >>=20 >> =E2=80=94 Alex >>=20 >> --=20 >> Alex Balashov | Principal | Evariste Systems LLC >>=20 >> Tel: +1-706-510-6800 / +1-800-250-5920 (toll-free) >> Web: http://www.evaristesys.com/, http://www.csrpswitch.com/ >>=20 >>=20 >>=20 >=20 >=20 >=20 --=20 Alex Balashov | Principal | Evariste Systems LLC Tel: +1-706-510-6800 / +1-800-250-5920 (toll-free) Web: http://www.evaristesys.com/, http://www.csrpswitch.com/