pg.ddx.io  pgsql-admin@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Christophe Courtois <christophe.courtois@dalibo.com>
To: Donato Marrazzo <donato.marrazzo@gmail.com>
To: Laurenz Albe <laurenz.albe@cybertec.at>
Cc: pgsql-admin@lists.postgresql.org
Subject: Re: How to get more than 2^32 BLOBs
Date: Wed, 8 Apr 2020 13:41:26 +0200
Message-ID: <e39b2ce7-1974-6e06-da3e-f92a69d702a9@dalibo.com> (raw)
In-Reply-To: <CAC1K4Gg7JwoF+ouKudB-d3_B6O_OEJmzXoSWYbquQcZTW=ie3w@mail.gmail.com>
References: <CAC1K4Ghi6fa0ck4rrB4MSaOLas9MY4mnF-jNF4iwiy75UVj4iQ@mail.gmail.com>
	<98e38782369def5f1fb865533ab22d828b442d78.camel@cybertec.at>
	<CAC1K4Gg7JwoF+ouKudB-d3_B6O_OEJmzXoSWYbquQcZTW=ie3w@mail.gmail.com>

Hi,

Le 08/04/2020 à 12:12, Donato Marrazzo a écrit :
> Hi Laurenz,
> thank you for your reply.
> Are you aware of any performance drawback?

We had a customer with millions of small Large Objects, in part because
his application forgot to unlink them.

As a consequence, pg_dump was using huge amounts of memory, making a
backup impossible. It was with PG 9.5, I don't think the situation
improved since.

> Il giorno mer 8 apr 2020 alle ore 12:06 Laurenz Albe
> <laurenz.albe@cybertec.at <mailto:laurenz.albe@cybertec.at>> ha scritto:
...
>     > I'm working on a use case were there are many tables with blobs
>     (on average not so large 32KB).
>     > I foresee that in 2-3 years time frame, the limit of overall blobs
>     will be breached: more than 2^32 blobs.
>     > - Is there a way to change the OID limit?
>     > - Should we switch to a bytea implementation?
>     > - Are there any drawback of bytea except the maximum space?

>     Don't use large objects.  They are only useful if
>     1) you have files larger than 1GB or
>     2) you need to stream writes
> 
>     There are no such limitations if you use the "bytea" data type, and
>     it is much simpler to handle at the same time.


+1


-- 
Christophe Courtois
Consultant Dalibo
https://dalibo.com/





view thread (6+ messages)  latest in thread

Message-ID: <e39b2ce7-1974-6e06-da3e-f92a69d702a9@dalibo.com>
Permalink:  ../e39b2ce7-1974-6e06-da3e-f92a69d702a9@dalibo.com/
Also on:    postgresql.org/message-id/e39b2ce7-1974-6e06-da3e-f92a69d702a9@dalibo.com

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-admin@postgresql.org
  Cc: christophe.courtois@dalibo.com, donato.marrazzo@gmail.com, laurenz.albe@cybertec.at, pgsql-admin@lists.postgresql.org
  Subject: Re: How to get more than 2^32 BLOBs
  In-Reply-To: <e39b2ce7-1974-6e06-da3e-f92a69d702a9@dalibo.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox