Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1qSZ6G-006MD1-7K for pgsql-admin@arkaria.postgresql.org; Sun, 06 Aug 2023 08:26:56 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1qSZ6D-0030aC-Pw for pgsql-admin@arkaria.postgresql.org; Sun, 06 Aug 2023 08:26:54 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1qSZ6D-0030a4-Ev for pgsql-admin@lists.postgresql.org; Sun, 06 Aug 2023 08:26:53 +0000 Received: from mout.perfora.net ([74.208.4.197]) by magus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1qSZ6A-000s9y-I5 for pgsql-admin@lists.postgresql.org; Sun, 06 Aug 2023 08:26:53 +0000 Received: from smtpclient.apple ([98.169.214.209]) by mrelay.perfora.net (mreueus003 [74.208.5.2]) with ESMTPSA (Nemesis) id 0MNrKv-1qTuoe1C3v-007YIy; Sun, 06 Aug 2023 10:26:47 +0200 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable From: "Michaeldba@sqlexec.com" Mime-Version: 1.0 (1.0) Subject: Re: Parallel WAL Archival Options Date: Sun, 6 Aug 2023 04:26:36 -0400 Message-Id: <2A210A32-AB11-4587-9EB6-C0D8626D83E9@sqlexec.com> References: Cc: Pgsql-admin In-Reply-To: To: Nikhil Shetty X-Mailer: iPad Mail (20F75) X-Provags-ID: V03:K1:N3j41vBX6iCV+N4eDyh8VNU8ahpMNTa1SE7nseNqMYUN1J8iN0j FUwzuEISUXs+xcwcdfwTi2YpJhLMPGOcxXWVlPrqG9RjdkOq1PFkeSXQBKfWhb2vEs1Bm2f pwUv9kuHCPo0XGkToARwW0KxmlKVOwtiMCqKPmQRtd9k82MmYTlC5BAzS70cb0EVDtJAHnG 8BoUqP9zKPsezYsTrPuJw== X-Spam-Flag: NO UI-OutboundReport: notjunk:1;M01:P0:AvyIxAWaXUw=;11f99v7jgdjS4mpw94gdUXBpYvJ TxSeASc1b5TVMBu4BQGIOGYodQP1Rj1swZNE6nSyb+FH/sQ9Zn99T4/2BeXjwNcFA1eSPebZg ukbUr1ZUf5qU2Tv8ua3RO5/9VN5AyT3OJLyz1Ldp4JyHanPeY6GXyz4B1sy9dmSl7YLf21kIc b2Fh3LHt7WHqTAfYG1iS9GaPP1ge8Tmdq8+GOjLvloKPx4aAdstXbqugZZgkVA6vjsrJex6En PI27VSF84OqmN6IUalThqYmzCE5by24FgfRoUcXGvA1q4etc0sKF5U2XGxGsxzFj6L0LVCMGu mZECVRzpqfCYjUqX/vterV+BRUNtVkufIbm3OXjYvGexrqzoNw7BxUaHN3MVW4veQbexhsN8S k7XjX/O1u5f25nkq0X28exPcyT6nW9DO4878dHPpl7tDwaecXiYSaJA3Cca+eq3GyR7mezAf4 huraizLwKSKBwhYyDyD2HF/+3qxdSfbMaboh7NdUVHzA4uYtmg15per6O1Hh1jxItoYTICRFC EToKMDcF07N6r2vuNrOnJ6lvuYl3mfJms5CIR6fYiutXq9k79E78WgRfXLfoFLiGllputXsxK cFTIWVnWmPJ29iSJoq/fRELVrqE6+udsdBBDbiSx1V63OtrF0dq3z6t+v//l2L5/k+5VGRA0i KOx4h+CFoST2gecdk0kzBewza3IqzNKeWQHhJhKINwtp32VATt552Hmp7wpWcKuWLdj9CYMPi fZLvOfYEl4XdZ4t/JMgtrp9xFXJqTxSbT1gyvUnO9yna34f/mqLrongLTjXfDqrfRqH5lsOV7 st9x1cJ4BPKX5TtbSuYjsTnwSdmXP3P2ijv+a2Gp52IBMRDVaoJD/mjBuFONuuAriSge81K+t NPxkD/9r9ue+eWg== List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk I am using PGbackrest and I am generating many WALs per second too, and I ha= ve no problems keeping up and I am backing them up remotely. Sent from my iPad > On Aug 6, 2023, at 3:43 AM, Nikhil Shetty wrote: >=20 > =EF=BB=BFHi Team, >=20 > I would like to know which backup&restore tools will be better for scenari= os where the database is generating around 400 WALs per minute. >=20 > We are using wal-g but it is not able to keep pace with the wal generation= . We increased the upload streams to 256 but no luck >=20 > Thanks, > Nikhil