pg.ddx.io  pgsql-committers@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Nathan Bossart <nathan@postgresql.org>
To: pgsql-committers@lists.postgresql.org
Subject: pgsql: Accommodate very large dshash tables.
Date: Tue, 17 Dec 2024 21:27:25 +0000
Message-ID: <E1tNf6D-0005pW-Fc@gemulon.postgresql.org> (raw)

Accommodate very large dshash tables.

If a dshash table grows very large (e.g., the dshash table for
cumulative statistics when there are millions of tables), resizing
it may fail with an error like:

        ERROR: invalid DSA memory alloc request size 1073741824

To fix, permit dshash resizing to allocate more than 1 GB by
providing the DSA_ALLOC_HUGE flag.

Reported-by: Andreas Scherbaum
Author: Matthias van de Meent
Reviewed-by: Cédric Villemain, Michael Paquier, Andres Freund
Discussion: https://postgr.es/m/80a12d59-0d5e-4c54-866c-e69cd6536471%40pgug.de
Backpatch-through: 13

Branch
------
REL_16_STABLE

Details
-------
https://git.postgresql.org/pg/commitdiff/2a74023221f9b9e484611581542c14fc6ef6d239

Modified Files
--------------
src/backend/lib/dshash.c | 6 ++++--
1 file changed, 4 insertions(+), 2 deletions(-)



view thread (6+ messages)  latest in thread

Message-ID: <E1tNf6D-0005pW-Fc@gemulon.postgresql.org>
Permalink:  ../E1tNf6D-0005pW-Fc@gemulon.postgresql.org/
Also on:    postgresql.org/message-id/E1tNf6D-0005pW-Fc@gemulon.postgresql.org

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-committers@postgresql.org
  Cc: nathan@postgresql.org, pgsql-committers@lists.postgresql.org
  Subject: Re: pgsql: Accommodate very large dshash tables.
  In-Reply-To: <E1tNf6D-0005pW-Fc@gemulon.postgresql.org>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox