From: Adrian Klaver <adrian.klaver@aklaver.com>
To: Ron Johnson <ronljohnsonjr@gmail.com>
To: pgsql-generallists.postgresql.org <pgsql-general@lists.postgresql.org>
Subject: Re: Improving pg_dump performance when handling large numbers of LOBs
Date: Mon, 5 Feb 2024 11:53:27 -0800
Message-ID: <8f2cc3a4-79df-4e82-9a5f-85972b2ab56f@aklaver.com> (raw)
In-Reply-To: <CANzqJaBE39Kx3e5TUa-Fxkrkeu4EQMg_K-rzdNPFzjccq=gO=Q@mail.gmail.com>
References: <CANCMp8yTnRrVtEQnMMfxw_pxRSXsv40TWFUbnaR4rvDnBzJ2eg@mail.gmail.com>
<CANzqJaBE39Kx3e5TUa-Fxkrkeu4EQMg_K-rzdNPFzjccq=gO=Q@mail.gmail.com>
On 2/5/24 11:35 AM, Ron Johnson wrote:
> On Mon, Feb 5, 2024 at 2:01 PM Wyatt Tellis <wyatt.tellis@gmail.com>
> wrote:
>
> Hi,
>
> We've inherited a series of legacy PG 12 clusters that each
> contain a database that we need to migrate to a PG 15 cluster.
> Each database contains about 150 million large objects totaling
> about 250GB.
>
>
> 250*10^9 / (150*10^6) = 1667 bytes. That's *tiny*.
>
> Am I misunderstanding you?
I think it less about the size of the individual objects then the number
(150 million) of them.
AFAIK that can't be handled by COPY, therefore they have to be
transferred individually.
--
Adrian Klaver
adrian.klaver@aklaver.com
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients from your mail client; the link fills in
the headers below: reply via email
Some clients, webmail especially, drop In-Reply-To and References from
a link, and the reply then starts a new thread: use the mbox below.
To: pgsql-general@postgresql.org
Cc: adrian.klaver@aklaver.com, ronljohnsonjr@gmail.com
Subject: Re: Improving pg_dump performance when handling large numbers of LOBs
In-Reply-To: <8f2cc3a4-79df-4e82-9a5f-85972b2ab56f@aklaver.com>
References: <CANCMp8yTnRrVtEQnMMfxw_pxRSXsv40TWFUbnaR4rvDnBzJ2eg@mail.gmail.com> <CANzqJaBE39Kx3e5TUa-Fxkrkeu4EQMg_K-rzdNPFzjccq=gO=Q@mail.gmail.com> <8f2cc3a4-79df-4e82-9a5f-85972b2ab56f@aklaver.com>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox