pg.ddx.io  pgsql-general@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Adrian Klaver <adrian.klaver@aklaver.com>
To: Ron Johnson <ronljohnsonjr@gmail.com>
To: pgsql-generallists.postgresql.org <pgsql-general@lists.postgresql.org>
Subject: Re: Improving pg_dump performance when handling large numbers of LOBs
Date: Mon, 5 Feb 2024 11:53:27 -0800
Message-ID: <8f2cc3a4-79df-4e82-9a5f-85972b2ab56f@aklaver.com> (raw)
In-Reply-To: <CANzqJaBE39Kx3e5TUa-Fxkrkeu4EQMg_K-rzdNPFzjccq=gO=Q@mail.gmail.com>
References: <CANCMp8yTnRrVtEQnMMfxw_pxRSXsv40TWFUbnaR4rvDnBzJ2eg@mail.gmail.com>
	<CANzqJaBE39Kx3e5TUa-Fxkrkeu4EQMg_K-rzdNPFzjccq=gO=Q@mail.gmail.com>


On 2/5/24 11:35 AM, Ron Johnson wrote:
> On Mon, Feb 5, 2024 at 2:01 PM Wyatt Tellis <wyatt.tellis@gmail.com> 
> wrote:
>
>     Hi,
>
>     We've inherited a series of legacy PG 12 clusters that each
>     contain a database that we need to migrate to a PG 15 cluster.
>     Each database contains about 150 million large objects totaling
>     about 250GB.
>
>
> 250*10^9 / (150*10^6) = 1667 bytes.  That's *tiny*.
>
> Am I misunderstanding you?


I think it less about the size of the individual objects then the number 
(150 million) of them.

AFAIK that can't be handled by COPY, therefore they have to be 
transferred individually.

-- 
Adrian Klaver
adrian.klaver@aklaver.com

view thread (12+ messages)  latest in thread

Message-ID: <8f2cc3a4-79df-4e82-9a5f-85972b2ab56f@aklaver.com>
Permalink:  ../8f2cc3a4-79df-4e82-9a5f-85972b2ab56f@aklaver.com/
Also on:    postgresql.org/message-id/8f2cc3a4-79df-4e82-9a5f-85972b2ab56f@aklaver.com

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients from your mail client; the link fills in
  the headers below: reply via email
  Some clients, webmail especially, drop In-Reply-To and References from
  a link, and the reply then starts a new thread: use the mbox below.

  To: pgsql-general@postgresql.org
  Cc: adrian.klaver@aklaver.com, ronljohnsonjr@gmail.com
  Subject: Re: Improving pg_dump performance when handling large numbers of LOBs
  In-Reply-To: <8f2cc3a4-79df-4e82-9a5f-85972b2ab56f@aklaver.com>
  References: <CANCMp8yTnRrVtEQnMMfxw_pxRSXsv40TWFUbnaR4rvDnBzJ2eg@mail.gmail.com> <CANzqJaBE39Kx3e5TUa-Fxkrkeu4EQMg_K-rzdNPFzjccq=gO=Q@mail.gmail.com> <8f2cc3a4-79df-4e82-9a5f-85972b2ab56f@aklaver.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox