public inbox for [email protected]  
help / color / mirror / Atom feed
From: Dimitrios Apostolou <[email protected]>
To: Ron Johnson <[email protected]>
Cc: pgsql-general <[email protected]>
Subject: Re: In-order pg_dump (or in-order COPY TO)
Date: Wed, 27 Aug 2025 14:52:39 +0200 (CEST)
Message-ID: <[email protected]> (raw)
In-Reply-To: <CANzqJaDGUPKM2h74wFb2DOgbKPnAe+c352eMTvehQ8D+vfxidA@mail.gmail.com>
References: <[email protected]>
	<CANzqJaDGUPKM2h74wFb2DOgbKPnAe+c352eMTvehQ8D+vfxidA@mail.gmail.com>

On Wednesday 2025-08-27 00:00, Ron Johnson wrote:
>
>This might be a silly question, but why are you using -Fc to create multi-TB dumps instead of -Fd?  If nothing else, the parallelization granted by -Fd will greatly speed up the dumps.

Hi Ron,

the primary reason is space. With -Fc I don't have to store the 10TB 
archive locally. And I don't have to wait for pg_dump to finish. I pipe 
it directly to the "borg create" command which does compression and 
deduplication and sends new chunks to a remote borgbackup server.

Regards,
Dimitris



P.S. please use "Reply-all" when replying, I've missed quite a few
      replies that I found on the list archives. :-)


view thread (22+ messages)  latest in thread

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: [email protected]
  Cc: [email protected], [email protected]
  Subject: Re: In-order pg_dump (or in-order COPY TO)
  In-Reply-To: <[email protected]>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox