pg.ddx.io  pgsql-committers@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Tomas Vondra <tomas.vondra@postgresql.org>
To: pgsql-committers@lists.postgresql.org
Subject: pgsql: Support long distance matching for zstd compression
Date: Thu, 06 Apr 2023 15:28:07 +0000
Message-ID: <E1pkRWw-001h4Y-IA@gemulon.postgresql.org> (raw)

Support long distance matching for zstd compression

zstd compression supports a special mode for finding matched in distant
past, which may result in better compression ratio, at the expense of
using more memory (the window size is 128MB).

To enable this optional mode, use the "long" keyword when specifying the
compression method (--compress=zstd:long).

Author: Justin Pryzby
Reviewed-by: Tomas Vondra, Jacob Champion
Discussion: https://postgr.es/m/20230224191840.GD1653@telsasoft.com
Discussion: https://postgr.es/m/20220327205020.GM28503@telsasoft.com

Branch
------
master

Details
-------
https://git.postgresql.org/pg/commitdiff/2820adf7755d2a377546d5b55f5b1a4a39889336

Modified Files
--------------
doc/src/sgml/protocol.sgml                    | 10 ++++-
doc/src/sgml/ref/pg_basebackup.sgml           |  4 +-
doc/src/sgml/ref/pg_dump.sgml                 |  2 +
src/backend/backup/basebackup_zstd.c          | 12 ++++++
src/bin/pg_basebackup/bbstreamer_zstd.c       | 13 ++++++
src/bin/pg_basebackup/t/010_pg_basebackup.pl  |  9 ++++-
src/bin/pg_dump/compress_zstd.c               |  5 +++
src/bin/pg_dump/t/002_pg_dump.pl              |  3 +-
src/bin/pg_verifybackup/t/008_untar.pl        |  8 ++++
src/bin/pg_verifybackup/t/010_client_untar.pl |  8 ++++
src/common/compression.c                      | 57 ++++++++++++++++++++++++++-
src/include/common/compression.h              |  2 +
12 files changed, 127 insertions(+), 6 deletions(-)



Message-ID: <E1pkRWw-001h4Y-IA@gemulon.postgresql.org>
Permalink:  ../E1pkRWw-001h4Y-IA@gemulon.postgresql.org/
Also on:    postgresql.org/message-id/E1pkRWw-001h4Y-IA@gemulon.postgresql.org

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-committers@postgresql.org
  Cc: tomas.vondra@postgresql.org, pgsql-committers@lists.postgresql.org
  Subject: Re: pgsql: Support long distance matching for zstd compression
  In-Reply-To: <E1pkRWw-001h4Y-IA@gemulon.postgresql.org>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox