agora inbox for pgsql-admin@postgresql.org
help / color / mirror / Atom feedFrom: Álvaro Herrera <alvherre@kurilemu.de>
To: Sbob <sbob@quadratum-braccas.com>
Cc: pgsql-admin@lists.postgresql.org
Subject: Re: pg_bulkload slowing down
Date: Mon, 28 Jul 2025 15:23:33 +0200
Message-ID: <202507281323.55loakn7tfyx@alvherre.pgsql> (raw)
In-Reply-To: <2846ad9c-e1d7-4780-b4e0-c2bceee64b64@quadratum-braccas.com>
On 2025-Jul-28, Sbob wrote:
> All;
>
>
> We are loading a series of files into a single table, each file has approx
> 500million rows, the first file took ~ 1.25 hours, now on file number 8 it
> has been running for more than 10 hours, there is only a PK index on the
> table.
I bet it's trying to find unused OIDs for toast pointers -- there are
only 2^32-1 of those available in any one toast table, and by the eighth
file of 500 million rows, you'd run out.
You could workaround this by partitioning the table.
--
Álvaro Herrera 48°01'N 7°57'E — https://www.EnterpriseDB.com/
view thread (5+ messages) latest in thread
Message-ID: <202507281323.55loakn7tfyx@alvherre.pgsql>
Permalink: ../202507281323.55loakn7tfyx@alvherre.pgsql/
Also on: postgresql.org/message-id/202507281323.55loakn7tfyx@alvherre.pgsql
reply
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-admin@postgresql.org
Cc: alvherre@kurilemu.de, sbob@quadratum-braccas.com, pgsql-admin@lists.postgresql.org
Subject: Re: pg_bulkload slowing down
In-Reply-To: <202507281323.55loakn7tfyx@alvherre.pgsql>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox