From: Stephen Frost <sfrost@snowman.net>
To: Nikhil Shetty <nikhil.dba04@gmail.com>
Cc: Pgsql-admin <pgsql-admin@lists.postgresql.org>
Subject: Re: Parallel WAL Archival Options
Date: Mon, 7 Aug 2023 10:42:31 -0400
Message-ID: <ZNEC18tW/KAyYGlG@tamriel.snowman.net> (raw)
In-Reply-To: <CAFpL5Vx86qhPAiOsUyrK=7hwKTuufbYYPp6kEnDJwvb=ZRphYg@mail.gmail.com>
References: <CAFpL5Vx86qhPAiOsUyrK=7hwKTuufbYYPp6kEnDJwvb=ZRphYg@mail.gmail.com>
Greetings,
* Nikhil Shetty (nikhil.dba04@gmail.com) wrote:
> I would like to know which backup&restore tools will be better for
> scenarios where the database is generating around 400 WALs per minute.
>
> We are using wal-g but it is not able to keep pace with the wal generation.
> We increased the upload streams to 256 but no luck
pgbackrest also does parallel WAL archiving and is able to handle
large volumes of WAL and we'd love to hear how well it works for you.
Feel free to reach out via a github issue if you have trouble making it
able to keep up.
Do be sure to also test that you're able to actually perform restores in
whatever timeframe you expect to be able to with that kind of WAL
generation.
Thanks,
Stephen
Attachments:
[application/pgp-signature] signature.asc (832B, ../ZNEC18tW%2FKAyYGlG@tamriel.snowman.net/2-signature.asc)
download
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-admin@postgresql.org
Cc: sfrost@snowman.net, nikhil.dba04@gmail.com, pgsql-admin@lists.postgresql.org
Subject: Re: Parallel WAL Archival Options
In-Reply-To: <ZNEC18tW/KAyYGlG@tamriel.snowman.net>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox