Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1r1ED7-00A6PX-LX for pgsql-hackers@arkaria.postgresql.org; Thu, 09 Nov 2023 23:13:18 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1r1ED6-00HSiX-3X for pgsql-hackers@arkaria.postgresql.org; Thu, 09 Nov 2023 23:13:16 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1r1ED5-00HShr-8h for pgsql-hackers@lists.postgresql.org; Thu, 09 Nov 2023 23:13:15 +0000 Received: from wout3-smtp.messagingengine.com ([64.147.123.19]) by makus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1r1ED2-004oNk-FD for pgsql-hackers@lists.postgresql.org; Thu, 09 Nov 2023 23:13:14 +0000 Received: from compute5.internal (compute5.nyi.internal [10.202.2.45]) by mailout.west.internal (Postfix) with ESMTP id AEAD43200ABA; Thu, 9 Nov 2023 18:13:09 -0500 (EST) Received: from mailfrontend2 ([10.202.2.163]) by compute5.internal (MEProxy); Thu, 09 Nov 2023 18:13:10 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=paquier.xyz; h= cc:cc:content-type:content-type:date:date:from:from:in-reply-to :in-reply-to:message-id:mime-version:references:reply-to:sender :subject:subject:to:to; s=fm3; t=1699571589; x=1699657989; bh=st EpzcfkRAE8lKAMeB254QAV6DeXwUsMUkXO7q6zDn8=; b=bu/yvzAeh1vTrA86Px 3iVaCodAwoLk0fOeuDbGr9O+0oEJZdEPFgpFBLcubq6yQoSKf7D6wcqD6rfgphSs J0a8c0DJ88L8lS/q9LCp3xSYpx3/89MfBNIPy3q+CCmLvmYY8MmVLniI6zSSqtpQ ubkqijC75davELgMnk0Xbld6bLptjHoejpnj7K4NQtuJ5DJV3QJE1R9zXPbAL7Ma mX7EWB5GhGkZ2ImEe/JkgJcVKGd+izcHW4LqaxRzA4QvflP92aZ09pSwhcUOcfGL H1eM8zvKMxzLiT33Nb1srje0/Yzu2lFN3DccA/0f5pvqxzpW0RMH2388ablVS7oh vvSA== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:sender:subject :subject:to:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm3; t=1699571589; x=1699657989; bh=stEpzcfkRAE8l KAMeB254QAV6DeXwUsMUkXO7q6zDn8=; b=stR4GGkEVlbdbtZSZyWyAn+o6Z+Cu OFI/7Msh48h2PLMY+qd98y9D98f0l107FxEEwNlxeAQROBnZ2CDR++7YwK9Kahwb PvS/fAEeglDUp9LOY6vXpjsSlFTrzZKpWNemEWcGRKsJNiMMQgiduF6UdWb0PjOM TuWHoqqztv+q4hs/p8CQdJgq+z+N6EMBMZ9qET1XEKic4HTqYu9NG/sg0DQJ9U1G UzL4V0CV4dmE459NIRfI8jp5mlgsKPn2MgtByisQK+6fZIQzD7BhWr+CMLpm6ypG ult+zWXE8VyB/QxKjM/9kWnsblwCjZue0delb5PgqDMXbS8o0527yq0zQ== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvkedruddvvddgtdeiucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne gfrhhlucfvnfffucdljedtmdenucfjughrpeffhffvvefukfhfgggtuggjsehgtderredt tddvnecuhfhrohhmpefoihgthhgrvghlucfrrghquhhivghruceomhhitghhrggvlhesph grqhhuihgvrhdrgiihiieqnecuggftrfgrthhtvghrnhepteelieefudffhffhtdetleeg geegfffhkeeuveetiefgudduvedutefggeeivdejnecuvehluhhsthgvrhfuihiivgeptd enucfrrghrrghmpehmrghilhhfrhhomhepmhhitghhrggvlhesphgrqhhuihgvrhdrgiih ii X-ME-Proxy: Feedback-ID: i0fe9450f:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA; Thu, 9 Nov 2023 18:12:46 -0500 (EST) Date: Fri, 10 Nov 2023 08:12:07 +0900 From: Michael Paquier To: Peter Eisentraut Cc: Euler Taveira , pgsql-hackers@lists.postgresql.org, Amit Kapila , Andres Freund Subject: Re: speed up a logical replica setup Message-ID: References: <5ac50071-f2ed-4ace-a8fd-b892cffd33eb@www.fastmail.com> <4710d895-689a-4ae6-b8e3-344286dbf970@app.fastmail.com> <96e3b739-d63d-4d35-90a3-7869465b7167@eisentraut.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="yJ+Ta6cLeCrBxJ6Z" Content-Disposition: inline In-Reply-To: <96e3b739-d63d-4d35-90a3-7869465b7167@eisentraut.org> List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk --yJ+Ta6cLeCrBxJ6Z Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Nov 09, 2023 at 03:41:53PM +0100, Peter Eisentraut wrote: > On 08.11.23 00:12, Michael Paquier wrote: >> - Should the subdirectory pg_basebackup be renamed into something more >> generic at this point? All these things are frontend tools that deal >> in some way with the replication protocol to do their work. Say >> a replication_tools? >=20 > Seems like unnecessary churn. Nobody has complained about any of the oth= er > tools in there. Not sure. We rename things across releases in the tree from time to time, and here that's straight-forward. >> - And if it would be better to refactor some of the code generic to >> all these streaming tools to fe_utils. What makes streamutil.h a bit >> less pluggable are all its extern variables to control the connection, >> but perhaps that can be an advantage, as well, in some cases. >=20 > Does anyone outside of pg_basebackup + existing friends + new friend need > that? Seems like extra complications. Actually, yes, I've used these utility routines in some past work, and having the wrapper routines able to run the replication commands in fe_utils would have been nicer than having to link to a source tree. -- Michael --yJ+Ta6cLeCrBxJ6Z Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCgAdFiEEG72nH6vTowiyblFKnvQgOdbyQH0FAmVNZ0cACgkQnvQgOdby QH2iDg/+NCsrtGzzib+lYGYk60PkK/IxfF3lmC7I3cLxyN2f5OhlWvihDzCJG9r5 Tn/yymN5jKbIbChoFN53+5Nd0gtd1doJCNERe272X22qFVpITR8s3wt+JUFrs+8y TyP1tVe5X5edrb+XjA6U/luksY4kv2qDTS4rJISZOxXvqf+Nib4Xf1mOrnguEF99 y5evYDadwfC/56L1CcaYXi+oz7dkdYp2xcIVs26M+s5TMHTq3i2bXdYm1AFOtL5T Dicq7npoTUCkInKjLSYfeeujm2u+Jj3zOPUIrSQQ/+QYgElhkYuuiztlpLw5rZlO pT+cesAtuRir0vOdPdd45dqkUFuOJRrMJ7mqsD6VnDN8yldO/BXZamowlXux1PVe i4yAlvny4Q3YFUAC94l2EN2tDHuMBL7rv/BIGYjWDe2dPKT8Uoxv4lzGG3ZV1z+4 nrSKHwx52FagJ0MKMLiHmUnjicv1d/Ik/OcweVNSKXvAl5iXrvsczi8Lh5LmGoNa 92SBqkutfpfo5PvDJNk26xM/mwhFJFlNJtqPsDNG/77UQRr03MGLuDJV1iivQuoF kPCkn4pyYYzpNaccjLqH1sAUMAdEtnw1MkmPwvfl0dIvcXqhi4mMzibOctX3Fsqh Af6PsoF1K1g8szra0Qbbjuuz+L0UAphjKbvVWHbqFwztdiRVRag= =NLpy -----END PGP SIGNATURE----- --yJ+Ta6cLeCrBxJ6Z--