pg.ddx.io pgsql-committers@postgresql.org mailing list archive
help / color / mirror / Atom feedpgsql: Accommodate very large dshash tables.
6+ messages / 1 participants
[nested] [flat]
* pgsql: Accommodate very large dshash tables.
@ 2024-12-17 21:27 Nathan Bossart <nathan@postgresql.org>
0 siblings, 0 replies; 6+ messages in thread
From: Nathan Bossart @ 2024-12-17 21:27 UTC (permalink / raw)
To: pgsql-committers@lists.postgresql.org
Accommodate very large dshash tables.
If a dshash table grows very large (e.g., the dshash table for
cumulative statistics when there are millions of tables), resizing
it may fail with an error like:
ERROR: invalid DSA memory alloc request size 1073741824
To fix, permit dshash resizing to allocate more than 1 GB by
providing the DSA_ALLOC_HUGE flag.
Reported-by: Andreas Scherbaum
Author: Matthias van de Meent
Reviewed-by: Cédric Villemain, Michael Paquier, Andres Freund
Discussion: https://postgr.es/m/80a12d59-0d5e-4c54-866c-e69cd6536471%40pgug.de
Backpatch-through: 13
Branch
------
master
Details
-------
https://git.postgresql.org/pg/commitdiff/84f1b0b031e6914c41623102b93fed8ab0e51253
Modified Files
--------------
src/backend/lib/dshash.c | 6 ++++--
1 file changed, 4 insertions(+), 2 deletions(-)
^ permalink raw reply [nested|flat] 6+ messages in thread
* pgsql: Accommodate very large dshash tables.
@ 2024-12-17 21:27 Nathan Bossart <nathan@postgresql.org>
0 siblings, 0 replies; 6+ messages in thread
From: Nathan Bossart @ 2024-12-17 21:27 UTC (permalink / raw)
To: pgsql-committers@lists.postgresql.org
Accommodate very large dshash tables.
If a dshash table grows very large (e.g., the dshash table for
cumulative statistics when there are millions of tables), resizing
it may fail with an error like:
ERROR: invalid DSA memory alloc request size 1073741824
To fix, permit dshash resizing to allocate more than 1 GB by
providing the DSA_ALLOC_HUGE flag.
Reported-by: Andreas Scherbaum
Author: Matthias van de Meent
Reviewed-by: Cédric Villemain, Michael Paquier, Andres Freund
Discussion: https://postgr.es/m/80a12d59-0d5e-4c54-866c-e69cd6536471%40pgug.de
Backpatch-through: 13
Branch
------
REL_17_STABLE
Details
-------
https://git.postgresql.org/pg/commitdiff/18452b70acee293d709f475c4551b3b242d4abd1
Modified Files
--------------
src/backend/lib/dshash.c | 6 ++++--
1 file changed, 4 insertions(+), 2 deletions(-)
^ permalink raw reply [nested|flat] 6+ messages in thread
* pgsql: Accommodate very large dshash tables.
@ 2024-12-17 21:27 Nathan Bossart <nathan@postgresql.org>
0 siblings, 0 replies; 6+ messages in thread
From: Nathan Bossart @ 2024-12-17 21:27 UTC (permalink / raw)
To: pgsql-committers@lists.postgresql.org
Accommodate very large dshash tables.
If a dshash table grows very large (e.g., the dshash table for
cumulative statistics when there are millions of tables), resizing
it may fail with an error like:
ERROR: invalid DSA memory alloc request size 1073741824
To fix, permit dshash resizing to allocate more than 1 GB by
providing the DSA_ALLOC_HUGE flag.
Reported-by: Andreas Scherbaum
Author: Matthias van de Meent
Reviewed-by: Cédric Villemain, Michael Paquier, Andres Freund
Discussion: https://postgr.es/m/80a12d59-0d5e-4c54-866c-e69cd6536471%40pgug.de
Backpatch-through: 13
Branch
------
REL_16_STABLE
Details
-------
https://git.postgresql.org/pg/commitdiff/2a74023221f9b9e484611581542c14fc6ef6d239
Modified Files
--------------
src/backend/lib/dshash.c | 6 ++++--
1 file changed, 4 insertions(+), 2 deletions(-)
^ permalink raw reply [nested|flat] 6+ messages in thread
* pgsql: Accommodate very large dshash tables.
@ 2024-12-17 21:27 Nathan Bossart <nathan@postgresql.org>
0 siblings, 0 replies; 6+ messages in thread
From: Nathan Bossart @ 2024-12-17 21:27 UTC (permalink / raw)
To: pgsql-committers@lists.postgresql.org
Accommodate very large dshash tables.
If a dshash table grows very large (e.g., the dshash table for
cumulative statistics when there are millions of tables), resizing
it may fail with an error like:
ERROR: invalid DSA memory alloc request size 1073741824
To fix, permit dshash resizing to allocate more than 1 GB by
providing the DSA_ALLOC_HUGE flag.
Reported-by: Andreas Scherbaum
Author: Matthias van de Meent
Reviewed-by: Cédric Villemain, Michael Paquier, Andres Freund
Discussion: https://postgr.es/m/80a12d59-0d5e-4c54-866c-e69cd6536471%40pgug.de
Backpatch-through: 13
Branch
------
REL_15_STABLE
Details
-------
https://git.postgresql.org/pg/commitdiff/9f7b7d5168acd9f0147655716b1d00ec54aeaa22
Modified Files
--------------
src/backend/lib/dshash.c | 6 ++++--
1 file changed, 4 insertions(+), 2 deletions(-)
^ permalink raw reply [nested|flat] 6+ messages in thread
* pgsql: Accommodate very large dshash tables.
@ 2024-12-17 21:27 Nathan Bossart <nathan@postgresql.org>
0 siblings, 0 replies; 6+ messages in thread
From: Nathan Bossart @ 2024-12-17 21:27 UTC (permalink / raw)
To: pgsql-committers@lists.postgresql.org
Accommodate very large dshash tables.
If a dshash table grows very large (e.g., the dshash table for
cumulative statistics when there are millions of tables), resizing
it may fail with an error like:
ERROR: invalid DSA memory alloc request size 1073741824
To fix, permit dshash resizing to allocate more than 1 GB by
providing the DSA_ALLOC_HUGE flag.
Reported-by: Andreas Scherbaum
Author: Matthias van de Meent
Reviewed-by: Cédric Villemain, Michael Paquier, Andres Freund
Discussion: https://postgr.es/m/80a12d59-0d5e-4c54-866c-e69cd6536471%40pgug.de
Backpatch-through: 13
Branch
------
REL_14_STABLE
Details
-------
https://git.postgresql.org/pg/commitdiff/84dc1303c9631343c74ce0ad806fb8fd202336f7
Modified Files
--------------
src/backend/lib/dshash.c | 6 ++++--
1 file changed, 4 insertions(+), 2 deletions(-)
^ permalink raw reply [nested|flat] 6+ messages in thread
* pgsql: Accommodate very large dshash tables.
@ 2024-12-17 21:27 Nathan Bossart <nathan@postgresql.org>
0 siblings, 0 replies; 6+ messages in thread
From: Nathan Bossart @ 2024-12-17 21:27 UTC (permalink / raw)
To: pgsql-committers@lists.postgresql.org
Accommodate very large dshash tables.
If a dshash table grows very large (e.g., the dshash table for
cumulative statistics when there are millions of tables), resizing
it may fail with an error like:
ERROR: invalid DSA memory alloc request size 1073741824
To fix, permit dshash resizing to allocate more than 1 GB by
providing the DSA_ALLOC_HUGE flag.
Reported-by: Andreas Scherbaum
Author: Matthias van de Meent
Reviewed-by: Cédric Villemain, Michael Paquier, Andres Freund
Discussion: https://postgr.es/m/80a12d59-0d5e-4c54-866c-e69cd6536471%40pgug.de
Backpatch-through: 13
Branch
------
REL_13_STABLE
Details
-------
https://git.postgresql.org/pg/commitdiff/853cef097666217f754681cb1f6f9feb319cf1df
Modified Files
--------------
src/backend/lib/dshash.c | 6 ++++--
1 file changed, 4 insertions(+), 2 deletions(-)
^ permalink raw reply [nested|flat] 6+ messages in thread
end of thread, other threads:[~2024-12-17 21:27 UTC | newest]
Thread overview: 6+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2024-12-17 21:27 pgsql: Accommodate very large dshash tables. Nathan Bossart <nathan@postgresql.org>
2024-12-17 21:27 pgsql: Accommodate very large dshash tables. Nathan Bossart <nathan@postgresql.org>
2024-12-17 21:27 pgsql: Accommodate very large dshash tables. Nathan Bossart <nathan@postgresql.org>
2024-12-17 21:27 pgsql: Accommodate very large dshash tables. Nathan Bossart <nathan@postgresql.org>
2024-12-17 21:27 pgsql: Accommodate very large dshash tables. Nathan Bossart <nathan@postgresql.org>
2024-12-17 21:27 pgsql: Accommodate very large dshash tables. Nathan Bossart <nathan@postgresql.org>
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox