agora inbox for pgsql-admin@postgresql.org
help / color / mirror / Atom feedFrom: Naveed Iftikhar <naveed27c@yahoo.com>
To: pgsql-admin@lists.postgresql.org <pgsql-admin@lists.postgresql.org>
To: Scott Ribe <scott_ribe@elevated-dev.com>
Subject: Re: pgBackRest configuration with DDBoost
Date: Tue, 4 Jun 2024 14:44:18 +0000 (UTC)
Message-ID: <579383683.1720596.1717512258251@mail.yahoo.com> (raw)
In-Reply-To: <96F639B3-D9FC-49D2-9FAC-5799010C314E@elevated-dev.com>
References: <1353402555.1511878.1717467795288.ref@mail.yahoo.com>
<1353402555.1511878.1717467795288@mail.yahoo.com>
<CANzqJaAaCpDCV8Puw5w1803mbQtn=XHSy7VTYzSYeFTF5VLUNQ@mail.gmail.com>
<96F639B3-D9FC-49D2-9FAC-5799010C314E@elevated-dev.com>
Thanks Scott for your input, Our database is keep growing and application owner want to have incremental backups daily. Can you share how you have configured the lz4 compression with pgbackrest. Any special storage requirements?
Best Regards -Naveed-
On Monday, June 3, 2024 at 10:22:28 PM CDT, Scott Ribe <scott_ribe@elevated-dev.com> wrote:
> On Jun 3, 2024, at 9:06 PM, Ron Johnson <ronljohnsonjr@gmail.com> wrote:
>
> Takes 2 hr 45 min for us to do a weekly full backup of the 6.1TB instance using integrated gzip compression (it's an old RHEL6 system, so nothing better) and 24 threads. Size 3.3T after compression, which is surprising based on how much already-compressed bytea data there is.
FYI, Naveed, there's a tradeoff available in current versions of pgbackrest. It can be configured to use lz4 compression. For us, that means close to 50% larger backups than gzip, but many times faster. 3.2TB in 30 minutes, using 8 processes, 725GB backup size--no already compressed bytea, but a good bit of incompressible UUID columns.
Good enough that I stopped doing daily incrementals, and just take full backups daily.
view thread (9+ messages) latest in thread
Message-ID: <579383683.1720596.1717512258251@mail.yahoo.com>
Permalink: ../579383683.1720596.1717512258251@mail.yahoo.com/
Also on: postgresql.org/message-id/579383683.1720596.1717512258251@mail.yahoo.com
reply
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-admin@postgresql.org
Cc: naveed27c@yahoo.com, pgsql-admin@lists.postgresql.org, scott_ribe@elevated-dev.com
Subject: Re: pgBackRest configuration with DDBoost
In-Reply-To: <579383683.1720596.1717512258251@mail.yahoo.com>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox