public inbox for [email protected]  
help / color / mirror / Atom feed
From: Gavin Roy <[email protected]>
To: Ron Johnson <[email protected]>
Cc: pgsql-general <[email protected]>
Subject: Re: Purpose of pg_dump tar archive format?
Date: Wed, 5 Jun 2024 10:22:35 -0400
Message-ID: <CAFVAjJGcpV1V9tD8r-9mNH64KcYaRQE2D1pTM0Lq8n-GDAWx0g@mail.gmail.com> (raw)
In-Reply-To: <CANzqJaDonyXAvPpNi5ZX3WUrCCxXfPHAzOKqab29Zq-WZ5UEaQ@mail.gmail.com>
References: <CANzqJaAHOSNiOhe4D2hOBB46=puWQOZb=s=VQdNmUSOtOmRG5A@mail.gmail.com>
	<[email protected]>
	<CANzqJaCMR-5eLMYy0ukywWeKpwySCAMQRrgKmW7A2CZ-mr9+0Q@mail.gmail.com>
	<[email protected]>
	<CANzqJaBiUpeFExzS-wi8KzmZcxEEmi1FUVkoyL5=8FEx13S5dg@mail.gmail.com>
	<[email protected]>
	<CAHAc2jcACDXv8=5EVO0YVVjANP=oj_=eeYeLXiG3LQC+kU0ewA@mail.gmail.com>
	<[email protected]>
	<CANzqJaB86-8qozgb5Fmd48PJa4CrVo3o8BFGAiG0w6ynJfJJpA@mail.gmail.com>
	<CAFVAjJH3bA-rZNEyjDctD0TOZMjcyVqA7Ac_-xkBDaM8UUPFkA@mail.gmail.com>
	<CANzqJaDonyXAvPpNi5ZX3WUrCCxXfPHAzOKqab29Zq-WZ5UEaQ@mail.gmail.com>

On Tue, Jun 4, 2024 at 7:36 PM Ron Johnson <[email protected]> wrote:

> On Tue, Jun 4, 2024 at 3:47 PM Gavin Roy <[email protected]> wrote:
>
>>
>> On Tue, Jun 4, 2024 at 3:15 PM Ron Johnson <[email protected]>
>> wrote:
>>
>>>
>>> But why tar instead of custom? That was part of my original question.
>>>
>>
>> I've found it pretty useful for programmatically accessing data in a dump
>> for large databases outside of the normal pg_dump/pg_restore workflow. You
>> don't have to seek through one large binary file to get to the data section
>> to get at the data.
>>
>
> Interesting.  Please explain, though, since a big tarball _is_ "one large
> binary file" that you have to sequentially scan.  (I don't know the
> internal structure of custom format files, and whether they have file
> pointers to each table.)
>

Not if you untar it first.


> Is it because you need individual .dat "COPY" files for something other
> than loading into PG tables (since pg_restore --table=xxxx does that, too),
> and directory format archives can be inconvenient?
>

In the past I've used it for data analysis outside of Postgres.
-- 
*Gavin M. Roy*
CTO
AWeber


view thread (6+ messages)

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: [email protected]
  Cc: [email protected], [email protected]
  Subject: Re: Purpose of pg_dump tar archive format?
  In-Reply-To: <CAFVAjJGcpV1V9tD8r-9mNH64KcYaRQE2D1pTM0Lq8n-GDAWx0g@mail.gmail.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox