Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1nYGC7-0003TV-PD for pgsql-hackers@arkaria.postgresql.org; Sat, 26 Mar 2022 23:51:43 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1nYGC5-0008GZ-7g for pgsql-hackers@arkaria.postgresql.org; Sat, 26 Mar 2022 23:51:41 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1nYGC4-0008GQ-QQ for pgsql-hackers@lists.postgresql.org; Sat, 26 Mar 2022 23:51:40 +0000 Received: from mail-io1-xd2b.google.com ([2607:f8b0:4864:20::d2b]) by magus.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.92) (envelope-from ) id 1nYGC1-0005Q8-UJ for pgsql-hackers@lists.postgresql.org; Sat, 26 Mar 2022 23:51:40 +0000 Received: by mail-io1-xd2b.google.com with SMTP id c23so13028149ioi.4 for ; Sat, 26 Mar 2022 16:51:37 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=telsasoft-com.20210112.gappssmtp.com; s=20210112; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to:user-agent; bh=XwM97/WYnift4VCiVc40kl9rPWJNFobDqH6BDddy5AE=; b=SQGA1TGCiNAKibdjZozwix8YHIGpemP45nF9wQ2tuvKmRA1lxyN7h7JF9ia9bECNwp uboP5M3cwbbXcHyr6rgAOI/10WVdtCczGW8PKVbsihWygMFrMYfLsqCkmfVBeJGsDBR9 59xnRVLeWgluOPga5Yy61+9/xHMFG9al+VKgdtSWNfWlsv5hdMJWuEeq2e26ix9+kvQQ 5fIcri0vJrm+NU1mhdIF7jPtsb+I4niofmkfzRxWWVnHW17kJIepkgVH+9D6VzDPOODj sO78Apo0J9rD7jiiykGm+x64QF0cyC9eQWIbjxz+r9/FCu1PCkJd5yc9o7iAFyNGwB7D vSjw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to:user-agent; bh=XwM97/WYnift4VCiVc40kl9rPWJNFobDqH6BDddy5AE=; b=wDXWIQI9CknnqtgN+MnXbmqlUth7oLg2nFt11xfk+wefSpPzC1e38TleUs+vt83rbu 59kIa8PoULJDMxNfjOlsownMlu3FxyknSv/jEyh3dnHQEhgKqfJqA4mFwERmdlpzL4Ob lDHXprRsTY0gWPDtmV0ulT029tf3TVuqGesJPPlFPY+Cr7T6+fBbPqQGi1D2p8jiJIyG 1IycHa/jofxb2MiU0EI0lINSWzcZ3bqjNemv/F3xWbgicVjG+fEL61DZ3KC3JBdB6OFG thxcbMKpVT+fDJ7HSzaPAEzqkV1cpep1PLalczE1UK9TO3Ugvblg/zIt6IZP2739mc0c xXlw== X-Gm-Message-State: AOAM533Exfw92MQ68OA9wQ4uoUSOkNeA4kzBWrs6TvlZPkm5OGP4TS4O 3RzkQvmxWEQJ06pUL/bYoNz9Tw== X-Google-Smtp-Source: ABdhPJx0U8nBFTRTy/a+OOC2md3l3zCcjcrXtbNuII5l12/qk3OjYIeaE083abXg4wGWaT/66ig+7Q== X-Received: by 2002:a05:6638:14c6:b0:319:e02c:1fc2 with SMTP id l6-20020a05663814c600b00319e02c1fc2mr8980743jak.44.1648338696188; Sat, 26 Mar 2022 16:51:36 -0700 (PDT) Received: from pryzbyj.telsasoft (charmander.telsasoft.com. [50.244.222.1]) by smtp.gmail.com with ESMTPSA id t7-20020a5e9907000000b00649d6bd1ec5sm5271210ioj.31.2022.03.26.16.51.35 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Sat, 26 Mar 2022 16:51:35 -0700 (PDT) Received: by pryzbyj.telsasoft (Postfix, from userid 1000) id E9FF380073B; Sat, 26 Mar 2022 18:51:34 -0500 (CDT) Date: Sat, 26 Mar 2022 18:51:34 -0500 From: Justin Pryzby To: Daniel Gustafsson Cc: Georgios , pgsql-hackers@lists.postgresql.org, Rachel Heaton Subject: Re: Add LZ4 compression in pg_dump Message-ID: <20220326235134.GK28503@telsasoft.com> References: <20220326162156.GI28503@telsasoft.com> <6FC5027A-1716-4D75-BF5B-2049A3698387@yesql.se> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <6FC5027A-1716-4D75-BF5B-2049A3698387@yesql.se> User-Agent: Mutt/1.9.4 (2018-02-28) List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk On Sun, Mar 27, 2022 at 12:37:27AM +0100, Daniel Gustafsson wrote: > > On 26 Mar 2022, at 17:21, Justin Pryzby wrote: > > > I suggested off-list to add an 0099 patch to change LZ4 to the default, to > > exercise it more on CI. > > No need to change the defaults in autoconf for that. The CFBot uses the cirrus > file in the tree so changing what the job includes can be easily done (assuming > the CFBot hasn't changed this recently which I think it hasn't). I used that > trick in the NSS patchset to add a completely new job for --with-ssl=nss beside > the --with-ssl=openssl job. I think you misunderstood - I'm suggesting not only to use with-lz4 (which was always true since 93d973494), but to change pg_dump -Fc and -Fd to use LZ4 by default (the same as I suggested for toast_compression, wal_compression, and again in last year's patch to add zstd compression to pg_dump, for which postgres was not ready). @@ -781,6 +807,11 @@ main(int argc, char **argv) compress.alg = COMPR_ALG_LIBZ; compress.level = Z_DEFAULT_COMPRESSION; #endif + +#ifdef USE_ZSTD + compress.alg = COMPR_ALG_ZSTD; // Set default for testing purposes + compress.level = ZSTD_CLEVEL_DEFAULT; +#endif