pg.ddx.io pgsql-committers@postgresql.org mailing list archivehelp / color / mirror / Atom feed
pgsql: Truncate line pointer array during VACUUM. 2+ messages / 1 participants [nested] [flat]
* pgsql: Truncate line pointer array during VACUUM. @ 2021-04-07 15:48 Peter Geoghegan <pg@bowt.ie> 0 siblings, 0 replies; 2+ messages in thread From: Peter Geoghegan @ 2021-04-07 15:48 UTC (permalink / raw) To: pgsql-committers@lists.postgresql.org Truncate line pointer array during VACUUM. Teach VACUUM to truncate the line pointer array of each heap page when a contiguous group of LP_UNUSED line pointers appear at the end of the array -- these unused and unreferenced items are excluded. This process occurs during VACUUM's second pass over the heap, right after LP_DEAD line pointers on the page (those encountered/pruned during the first pass) are marked LP_UNUSED. Truncation avoids line pointer bloat with certain workloads, particularly those involving continual range DELETEs and bulk INSERTs against the same table. Also harden heapam code to check for an out-of-range page offset number in places where we weren't already doing so. Author: Matthias van de Meent <boekewurm+postgres@gmail.com> Author: Peter Geoghegan <pg@bowt.ie> Reviewed-By: Masahiko Sawada <sawada.mshk@gmail.com> Reviewed-By: Peter Geoghegan <pg@bowt.ie> Discussion: https://postgr.es/m/CAEze2WjgaQc55Y5f5CQd3L=eS5CZcff2Obxp=O6pto8-f0hC4w@mail.gmail.com Discussion: https://postgr.es/m/CAH2-Wzn6a64PJM1Ggzm=uvx2otsopJMhFQj_g1rAj4GWr3ZSzw@mail.gmail.com Branch ------ master Details ------- https://git.postgresql.org/pg/commitdiff/3c3b8a4b26891892bccf3d220580a7f413c0b9ca Modified Files -------------- src/backend/access/heap/heapam.c | 22 +++++-- src/backend/access/heap/pruneheap.c | 4 ++ src/backend/access/heap/vacuumlazy.c | 16 ++++- src/backend/storage/page/bufpage.c | 112 +++++++++++++++++++++++++++++++++-- src/include/storage/bufpage.h | 1 + 5 files changed, 144 insertions(+), 11 deletions(-) ^ permalink raw reply [nested|flat] 2+ messages in thread
* pgsql: Truncate line pointer array during heap pruning. @ 2022-04-07 22:43 Peter Geoghegan <pg@bowt.ie> 0 siblings, 0 replies; 2+ messages in thread From: Peter Geoghegan @ 2022-04-07 22:43 UTC (permalink / raw) To: pgsql-committers@lists.postgresql.org Truncate line pointer array during heap pruning. Reclaim space from the line pointer array when heap pruning leaves behind a contiguous group of LP_UNUSED items at the end of the array. This happens during subsequent page defragmentation. Certain kinds of heap line pointer bloat are ameliorated by this new optimization. Follow-up work to commit 3c3b8a4b26, which taught VACUUM to truncate the line pointer array in about the same way during VACUUM's second pass over the heap. We now apply line pointer array truncation during both the first and the second pass over the heap made by VACUUM. We can also perform line pointer array truncation during opportunistic pruning. Matthias van de Meent, with small tweaks by me. Author: Matthias van de Meent <boekewurm+postgres@gmail.com> Discussion: https://postgr.es/m/CAEze2WjgaQc55Y5f5CQd3L=eS5CZcff2Obxp=O6pto8-f0hC4w@mail.gmail.com Discussion: https://postgr.es/m/CAEze2Wg36%2B4at2eWJNcYNiW2FJmht34x3YeX54ctUSs7kKoNcA%40mail.gmail.com Branch ------ master Details ------- https://git.postgresql.org/pg/commitdiff/10a8d138235b3b8cfbce8a0145526d9b9a80cc96 Modified Files -------------- src/backend/access/heap/pruneheap.c | 4 +++- src/backend/access/heap/vacuumlazy.c | 11 ++++++++--- src/backend/storage/page/bufpage.c | 35 ++++++++++++++++++++++------------- 3 files changed, 33 insertions(+), 17 deletions(-) ^ permalink raw reply [nested|flat] 2+ messages in thread
end of thread, other threads:[~2022-04-07 22:43 UTC | newest] Thread overview: 2+ messages (download: mbox mbox.gz follow: Atom feed) -- links below jump to the message on this page -- 2021-04-07 15:48 pgsql: Truncate line pointer array during VACUUM. Peter Geoghegan <pg@bowt.ie> 2022-04-07 22:43 pgsql: Truncate line pointer array during heap pruning. Peter Geoghegan <pg@bowt.ie>
This inbox is served by DDX for PostgreSQL; see mirroring instructions for how to clone and mirror all data and code used for this inbox