Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1urFdw-0033mk-O6 for pgsql-general@arkaria.postgresql.org; Wed, 27 Aug 2025 12:52:50 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1urFdu-00F7kC-Ok for pgsql-general@arkaria.postgresql.org; Wed, 27 Aug 2025 12:52:47 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1urFdu-00F7k4-9f for pgsql-general@lists.postgresql.org; Wed, 27 Aug 2025 12:52:47 +0000 Received: from mout.gmx.net ([212.227.17.20]) by makus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.96) (envelope-from ) id 1urFds-0021B8-0j for pgsql-general@postgresql.org; Wed, 27 Aug 2025 12:52:45 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmx.net; s=s31663417; t=1756299162; x=1756903962; i=jimis@gmx.net; bh=a54VYwCRtmv2o9r145Qbv546mERmttDt9u0HA4Pkba8=; h=X-UI-Sender-Class:Date:From:To:cc:Subject:In-Reply-To:Message-ID: References:MIME-Version:Content-Type:cc:content-transfer-encoding: content-type:date:from:message-id:mime-version:reply-to:subject: to; b=JWYsOJbivO/SUzoBuko2QUtD1Jznwf+hubcob6BNh4rvKo1yuBJS4JafzP9Q96TI VnIDCKaSOdsj7PfOFmspPKGTba5QVruBflgGLiBRj5Fck4PNfa7j7pmQBuFd6dqkD LH6fgbOJcp7o2S9DVF3ft+oCS9cbf2w87r9r5hW6ftu5+S4puPj+gymDuLJXOMOOV tUFxbYaFBB6R9/yV3v1/qAMcIxWGaSd26lXKrGBxuyUYYqTuKBrlO5suRvSpKs2Jy 7uBrLEJOXK3Dei5dWNVcsaaMqeehAEwMC4KlPLmSIhdzA89nAlki1QtvGZ0TtcGXU ARe7wiIKEEPK8euhYw== X-UI-Sender-Class: 724b4f7f-cbec-4199-ad4e-598c01a50d3a Received: from [10.9.70.59] ([185.55.106.54]) by mail.gmx.net (mrgmx104 [212.227.17.168]) with ESMTPSA (Nemesis) id 1MPokN-1vCszR2SOZ-00XMuB; Wed, 27 Aug 2025 14:52:42 +0200 Date: Wed, 27 Aug 2025 14:52:39 +0200 (CEST) From: Dimitrios Apostolou To: Ron Johnson cc: pgsql-general Subject: Re: In-order pg_dump (or in-order COPY TO) In-Reply-To: Message-ID: <2s558no0-705o-94r2-5s1q-npprn7508702@tzk.arg> References: MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="0-1721996514-1756299162=:1535142" X-Provags-ID: V03:K1:x+GjyTpKbBykrt6CpB2CadL0mqd2gSYSOHVNBNu0glYYhG8491q UjNmT7ppg4gte4C6OiNa2penIMo+uc6lQBh9gf9ltUCcPovdPYWHRR5pR3xX/rKApFBOgXr 7T9hP0YuW3TeULaXvm2wVozYNhPoVm4jsZoBhIRZciR+bljbIldk8tPJZwPWz8ZoTuoC5Vq UghaZNp1n6DSSY0n96TbA== X-Spam-Flag: NO UI-OutboundReport: notjunk:1;M01:P0:oxax59eLf28=;VdGyBBQhz0IqwG/6maD3MDpGO3J ZeT8szSoRKNN/g+OdVOP7/cahNO40E+c+vCHEzb/L4NuE/1ce2R+7QhGe5GcCwY5MDv/Q3y/6 QrBELuE25ML67sgGdPvme/+ESUjArCzjAY/b7bd2XA/pLhuohaVVzJ2bUPQQSI65tz8eLcUg6 O7bTjMJw+eLVeNQXwG8b/wPJKFe66x+LiM6GFbp2XFvVoplPB9u2IHcGVWPIqkd05rJBW4QP8 o6XiPDo3kAugw3ehdGCUaoosHS1+1e+8GczbmxN5JHLJFycVdTx/HUEuQ7F/G6+TbEPXGghWA qLrvND+8GV0cktbRJsPfkAeqejo5MF9ASr/oToHaKSGRYYWmedBTEbkgwXb3AJ583qlf7FoAC KKl453Mh/YVLIp53rsN9W+CFi7WSNfchmMWlQL06t+is3MbLEg+UC1QcXjwWiMxLyNr1ErEtH E8JK0axqLqODg2+BXKJHgXdK8Had65yiM6u08Tmuk3lvNsDnH558JnA2iH8ttASOPhNNR9bEw SdRpRvIUgTmhc1dPnCYzi8gQOy4HBPZSIGiHRtOZVP1mPqwwTOW0szNc45buXH1dY0Ped2c3w b33oJsD5wGJXEpE9lHq93cg66i4YRY9JBHPx30+aQwnzxyO7SjJc4hPElQ9gNFv9TLZB4aNve xVQYt+fd7xCjCt5SC9Mb5muwxbqE82kyx0z7IANhCiarC3/udSnXHUfObikxVUJYxkolGc5nk kpiMlrYbwvuIlbn+tbvXlwvUZacjPXCCSrA2IBekeL15vsdMsNTorFoQc1fTKfSozXlqe90LC axm2YcexAGIVhj213fs5ieEGAHqcGLMn07kRFpDttPn2r8vYNQq7IvnpKJDOVf0ANq2l7tu4Y VD48tsKpfFvSlSuXNyeWwxELIGuplXHLhsgiidAVf4ZMf6wsKG4Iu03/lM8w/BGVxkFbaw8GE zMfIbN7oqr0OXr5edPAsFw9gNtjgpxgNziPGmettPiwFhQPCaSX1RklhBDlY5jRLW15DKCo1K Ufv8qT3HO8D9ILpPtR50XQKYCbVYfP8mvk6GaCHrc0XUG6QhqGE5/W4CXzC8pRs8UBWJdrorI 7JMTS9bq3MiX7Zlrn7oJbCfpb+Yb1GromeSHppC18PBpZbffhIUIik7pRvvTMublFT2yNJHgu zVMtZ4nT501ge3nbSC8uneyLVmYDkBPtXVRpkt0jTlsKGx/wknapd4toQTgXNsGeIFj+N/Pud I7iqBx0lcVcE4LgeMaGqY8LSe0dAUPBDmL59Z3J1LKl8YCiDnwECch3tVfYFFDkVXXq0obSlh bWto9RkNo+Zt6EGtKU0HEdvOpgvrm9BRS1fnLbgQSJnGeJG4McG4P1R5bJCgFUv+CN6UMDpiF IpnX03dAS0wu0iDey9eAwDG4LjtTeclX2iZZgqJTWFww8AtIDGKU+QqVlimlIDHkbchDo6NNW 0RtqSvC0Yoa17w/9F/RrGTCDxOeFdDl8srrehq0toKo22b+85fBNYg2wffKkHVUXR2pNizJJg Hp96CVfYebTwyjPMEFJovLiX8pm0FcidQOtNZ11y8npiiyj5rrkPqBGrmykZ/bcUnr+rvubUc R9Zi4rc2oN+HXWcBydQypYW2cFXnN2AmapoC9Gefh7c1mqxq/swO8JAFoZigSqeIYmDN3gngK H9LXWUXACYR5IZQ8sbZr1GUyHVKbwba8CQvPlyE2PfGyTJPMZCLuhJPPP6ZEQiobLVUhmG4fi MCTtyoxbe7bfOJr8vObUh7cPmQyPszLv2eZpIp4S+SbagD1B0eGJFyi2dZscpR2hKbE4neZS1 rlHb0mKUS3YJmlhHvpnvIq2YaG4nmhWkOIY9JKGiLIjtXm707R7xYB/5nP3mIgY9QSnxWxNpF mvcgnpFUQDNetLSUXx09zDOGsnWoRlwLeAby6AvZjz30fttN9Wd4J3i5XLRquFeF9hYuqisHl 5EIh9PWEXQ8S/BfKDM0yF72EFMUoKdry/Kdl28mabmy0SRMDwZPQfPi8ZowrlPzIdR7v64hN/ oV5YnR8eKO+dYnkRkOlAWeD0Io3cGD9sxsrfh5m4Ty41Evqh/BIvyc4v5D6IXibITUJGLPEmG lKQgjTr8VVS30VEH3KLuNyhpZ2gNCe9rn7tvXl3V+gHE+NlZrR0JaVlu28gJ3eORghwGhAnS7 /PkhSz+Kz/z2HM+UMvqAAdODuHr19VXuhLQv0RYUkJC+vDN5q6N2A59VfN2mURcb8ZrYmHVPu Q3A5zKj297zF9E9XWz4QAQ1OGv13fVaPML91cSjfHa6evpKoZph0mmoO8TEu9PU93mLsNn8DT fWWNT0nZbMztCwaeRx2HjaEELjdaFY9+Q+JjfFhCUls/0SLsBeo+alh11xWRjkKozHeD2Av5A PFcvqbfi8vPuvuMZyar9wNugq9y9DQSh7eFQK2qNHKri2QVTqtDkT8jO39ZAhvw8tnUygjtsN NS7aSOg8htWf5wHScOpmLGNeN5d7Ik8vTDR/C1lqsKdoVmRAq4nQS5qnN6ydXE9nXdeSmRhvk dWCYu/cywr2jHNCxyUXtfiPCKzLQrOl9OXqFxXCwHuaBDMxwTf+zixfRf0Brn90MICInayE+I uQTz0ZshJKnXwD35ezIe5SOMKmkU6xvbr560EStWvMidadLNvOXd4P5dbvyAPWSBo9+Pgd0b2 8FpOm52ZVF7OzWGD/QGbnwDEhse0Hj4kJrtMP/cr1OsCg9eWQWQ2sZpfegwCbPM40ZQgx8cIQ mggR4LfYhcZcjEOE5EjSkigtwRzqe/aoBqLVYi7FxBqPrA+63jyqqP7RSYeoZLx6bIzvhhm+M UHjY7SQ0h7VdDoo7vIlfxFsuWWKOfRn7ESlv4V+xRa2Tr2uIu6V+wOfB+KqSCf+gcsiF/KpJK Hfa98W+j7EuXKjodPDgsRvfREC1Onsa5BlPryH62zySUJ7vi6vXEclSTnDnYDSmM9xuNkn/zv 1MTdqW3K047jdL6vQYZwiTaefYbPKy7NxfdUcwsdDUcnh8xurziWohbLQwpF7A+K38abcZgp+ yICOMEKs56l/vYyOKDjcwnFc0CLsq2adSPfFwW0arZ+UE9JS6rXRsVorIVNcXYAvbEggywTc6 0iAIYPX2UrdR48S556vsUEZVuO4TntZctQle4rou2jjvTRlPWrD9AFp5bt1dfvVAO1yKcNEUh +X3S6IinBdF+FQ6z0YzvjKsI5/9/5vcHheA7jXHG86O6jJlDverGRT8pv2dEHHVbFduAkFTNF k7nxNyDNodFP83MSrazcEa+v2KO/9nOqRRBwTeIV1bPBab9mHR9X3sxo0ZtTPX+MxvaiT2qMe 8gcb3aIF8qShSIr22U6y41jLGfkHUJ3hf3/aAW6qglA4ZKK96Pqy+y/VHGPlfcphGB2RqXLuq 2mwRgNd15zNWV/JXArQGQ7BmjDErfhk1uocFMg0EvT2XRGUqjGRL9ahESlgIXuaUnmnYgXMsS JZXGS+GEx7TFiv7+fA0cxElYvnEJaIhBku3L8nHRPyPfGkZ75xnmg49uNkCZr1Rhe0ZDQVFQI y0sGwa8+xu8kpHlqbBV3pJ4xSTd0VTq9awUIsfXDjBr8G0ilRdGkJeToQkgYevU2NI/OnnhTe bjX4rjDwXP52NEigWYxh3+eDFwT/CjGiLdm2QOaEb8mJjEnwF2+o3bc4apkH0Gqhxu1JC7Ta0 qs+hr7j1vo0njf12E/f7RwfwrPTbE+LOJ0JxT18NDmvmrIDdwr2pOHZ2k3nA7o2CY3Kx9KUpo 3SOqwTfjCGaD0ElAwuGFAcEqzbqgNcWqA3ENnW4Jw2ay9S9hXYC7WVfFhTYQMmd6WuHqqOySa gVartyY05Bc3di6lyxKvDR4UuwMikZsT1w1bIBnGWT541jJ/eYqX5gsFjraNONZlu002WlY4/ eFeYuYJwupd3QxfneDW1/lammKQXCFxxXG5i8udVU2xzA9kDy8m0m6Or0N9Cz2q1+JUcvGxBs Fi+X79zjuunVaJ0zbjgR/gMT/HY+3dpjP549KMe6gCpXLSGOo5k+YKKYG126nf3HmO+lwg877 qURu4qhHlyaU9IQ2vuzWCL7Qg6DB+AxGL8S4uTNpJu1k+wZjsdDI5hlBfTuQum9iTUBaPEBiY HzGo0L+DdyVOK/sZN5wcNtnF+b/k81llSa3OxGNt6CzsNVCoBABz0U+c6znu6uxhUuUJo6FeQ hVvF3FafpduwkE0TdELDCJRRGtGYmZZw3qa5GW/sNSGXR+DncV5nZYVeNAaU4QDxBTfJKybpS PZgr0vhvl3OybzLx3qO1V/50NjY+DWeol2Uk4qysRZCjT/clzzQslLH4hckydE88Oj/C7j6BL cIvMbyP3746MPz5B1NsH/qhWNDeRWhVLcQ9CoPpiHGnl64DoT3C9ax1KlkgK7t+VUx80s/LzX iql7o08dyKBY7kIEU61St7EWE4M68fCANeAyJPeJ4gKd5Qc9uFoWFhhhg2h6v6SsJlaWiXuZX tDseExrfgR0WbbAZ8yQ0SkfeplQBXseaQby5kwA07YeSrBk2LykxKOp+4LmQS/A6ALHOGjiFr i4H2skHxwmeW78BrSQk1rKyjO5X9e2r08AiwFoLE5jrAc6pCvzhLGmnYabc7N306oho5k80kV l4O7g5A9KIM4msMw9CG62c+CupyU3SHtapafzU27IR5wIKxp1TAQ+1VG32HFaa30hG5OQ37tW WoV/IZw4OTxbX6+6Sc9jNfh0Jh4e List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk This message is in MIME format. The first part should be readable text, while the remaining parts are likely unreadable without MIME-aware tools. --0-1721996514-1756299162=:1535142 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: quoted-printable On Wednesday 2025-08-27 00:00, Ron Johnson wrote: > >This might be a silly question, but why are you using -Fc to create=C2=A0= multi-TB dumps instead of -Fd?=C2=A0 If nothing else, the parallelization = granted by -Fd will greatly speed up the dumps. Hi Ron, the primary reason is space. With -Fc I don't have to store the 10TB=20 archive locally. And I don't have to wait for pg_dump to finish. I pipe=20 it directly to the "borg create" command which does compression and=20 deduplication and sends new chunks to a remote borgbackup server. Regards, Dimitris P.S. please use "Reply-all" when replying, I've missed quite a few replies that I found on the list archives. :-) --0-1721996514-1756299162=:1535142--