Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1sG097-008FSB-PN for pgsql-general@arkaria.postgresql.org; Sat, 08 Jun 2024 17:46:30 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1sG096-000WpO-Av for pgsql-general@arkaria.postgresql.org; Sat, 08 Jun 2024 17:46:29 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1sG094-000WpF-Rr for pgsql-general@lists.postgresql.org; Sat, 08 Jun 2024 17:46:28 +0000 Received: from wfhigh6-smtp.messagingengine.com ([64.147.123.157]) by makus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1sG092-000LtB-6k for pgsql-general@lists.postgresql.org; Sat, 08 Jun 2024 17:46:26 +0000 Received: from compute1.internal (compute1.nyi.internal [10.202.2.41]) by mailfhigh.west.internal (Postfix) with ESMTP id D576B1800098; Sat, 8 Jun 2024 13:46:20 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute1.internal (MEProxy); Sat, 08 Jun 2024 13:46:21 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=aklaver.com; h= cc:cc:content-transfer-encoding:content-type:content-type:date :date:from:from:in-reply-to:in-reply-to:message-id:mime-version :references:reply-to:subject:subject:to:to; s=fm3; t=1717868780; x=1717955180; bh=+A5XtXQcv+SjakLZXmkBN/5QyjoRnJ2n3yYWBzScsNI=; b= UoYBxRApQjIH+RKQAp089TS7y5l/A32Fk6vI2ur8Va9Afxtfi4ji30V3RBOx03Hx C/kz0pKhuY20dGwzDne+1X8hG4od9tLYpM691KdM5vGadh4QXK6gxD8KAeizI1OJ 083cwjbsS8CnNXSyNgvSCA2kM1Xlqd4OufBdjsJqu6vwxSH3cjL8+r8JCsXCiYs+ ooxeDhCPC7Sx3Do6uHq52Q3cobkIhDDgxJBSudIpw/DkKv2LtH7ga3Lsz88oAHrn 02D9N+XCUf2ehxIPIhRArqFI4GJLFLMCcX8GR3pqY028NN6CUwwzY2Fe/DLEcDCJ pebyiGOoMe8ssgD0P9uGUw== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:cc:content-transfer-encoding :content-type:content-type:date:date:feedback-id:feedback-id :from:from:in-reply-to:in-reply-to:message-id:mime-version :references:reply-to:subject:subject:to:to:x-me-proxy:x-me-proxy :x-me-sender:x-me-sender:x-sasl-enc; s=fm1; t=1717868780; x= 1717955180; bh=+A5XtXQcv+SjakLZXmkBN/5QyjoRnJ2n3yYWBzScsNI=; b=M aHTxBMBMZmqcrHexVCKVKGqLnx8sKyFrAj5qgYxUv4Tjo+lRWkGg/Nor1RkFiSB+ jhuMusF3NiXZ2px9NV0TlXj0gzFuAC93uJT9HsaZv82ZmN3xg7zB0/QQSmDs9918 fl+196HOZQaCcnlgL2syhQfcXQulgAl/yCNwQ5bbNy9xpPvYnCE6Jocdn4s3dGc0 2Uj1IpkmY3Xl8Gnn2nflzVhWSTc2y8lxguGybD11VT6K1LfBl3T0id+YK+Cy/qy6 oDmPHSG6vMg0f4FrMPsQbqPMn9YMS8azHKhzViZLsqbXWWLnUuJA8Xk5jTltEjVL xAdGYOENq2SewdZscsrOg== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvledrfedtgedgheduucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne cujfgurhepkfffgggfuffvvehfhfgjtgfgsehtjeertddtvdejnecuhfhrohhmpeetughr ihgrnhcumfhlrghvvghruceorggurhhirghnrdhklhgrvhgvrhesrghklhgrvhgvrhdrtg homheqnecuggftrfgrthhtvghrnhepuedufeejjefggfdttdeghefgkeeuveekkeeiteet tdekffehiedvtefhveffgeeunecuffhomhgrihhnpehpohhsthhgrhgvshhqlhdrohhrgh enucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhmpegrughr ihgrnhdrkhhlrghvvghrsegrkhhlrghvvghrrdgtohhm X-ME-Proxy: Feedback-ID: i76984098:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA; Sat, 8 Jun 2024 13:46:19 -0400 (EDT) Message-ID: Date: Sat, 8 Jun 2024 10:46:19 -0700 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: Questions on logical replication To: Koen De Groote Cc: PostgreSQL General References: <1628637f-419f-4f6a-9cb6-07af90cd0bc4@aklaver.com> <1c0273f5-a90a-48f6-b51f-fe15c16fa1c6@aklaver.com> <490e8a5c-f1f5-40fe-8243-f1c8c18d03f2@aklaver.com> Content-Language: en-US From: Adrian Klaver In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk On 6/8/24 10:40, Koen De Groote wrote: > What I'm trying to do is upgrade a PG11 database to PG16, using logical > replication. Have you looked at pg_upgrade?: https://www.postgresql.org/docs/current/pgupgrade.html > > The PG11 has an active and a standby, there are a handful of databases. > On particular one has a few tables just over 100GB, then a few 100 > tables near 1GB. 1 GB each? > > What I'd do is start a publication with no tables and add them 1 at a > time, refreshing subscription each time. > > This might take a long time, so my main questions relate to potential > network issues or various situations where the instance receiving the > logical replication, suddenly stop being able to receive. > > Resyncing, and the effects of WAL buildup, are my main concern. > > Accidentally sent a mail to only your email, sorry for that. > > Regards, > Koen De Groote -- Adrian Klaver adrian.klaver@aklaver.com