Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1pPaLs-0001KY-Bn for pgsql-hackers@arkaria.postgresql.org; Wed, 08 Feb 2023 02:38:28 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1pPaKt-0006PI-0l for pgsql-hackers@arkaria.postgresql.org; Wed, 08 Feb 2023 02:37:27 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1pPaKs-0006P9-O0 for pgsql-hackers@lists.postgresql.org; Wed, 08 Feb 2023 02:37:26 +0000 Received: from mail-il1-x12d.google.com ([2607:f8b0:4864:20::12d]) by magus.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.92) (envelope-from ) id 1pPaKo-0000lw-Ag for pgsql-hackers@lists.postgresql.org; Wed, 08 Feb 2023 02:37:26 +0000 Received: by mail-il1-x12d.google.com with SMTP id z2so6893771ilq.2 for ; Tue, 07 Feb 2023 18:37:21 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=telsasoft-com.20210112.gappssmtp.com; s=20210112; h=user-agent:in-reply-to:content-disposition:mime-version:references :message-id:subject:cc:to:from:date:from:to:cc:subject:date :message-id:reply-to; bh=7/dNrvv5361KqvKOTN/yQ/3ONVRDJS1ic8Yauzo/aQ0=; b=vvNED+jXqZDvV2NpsCUQhhUzfF3FbtcZZZpcAWGzTpLhMvSEQjHgWmLAYMLYFxBsZN pPrhy/C6wwnCb5zai/XzBx/iA9GdGtu3JGWuDcmoaqb4dlpcPnHX8ipKGZ+XDQbVNDW0 mdTTaXMcYF9nag/1LL5tCaJVTUG1LFVsOXrGbTJ1xnFsjFkToh1GXnnk4TFpyQy7pN8V sH2URLRfQO/t7ag7DlWZi6mWBmv5cNhfAlKzIqN4vH2MuO2gbSlqQfvGgjdzmeJVxCuW rSRDCUuiQV+MtbXYTXpHpHu9bzGvjGWcFjyVAuD+y7gnbMFhD+fnvMnCZPtnTM95xCtp b/4A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=user-agent:in-reply-to:content-disposition:mime-version:references :message-id:subject:cc:to:from:date:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=7/dNrvv5361KqvKOTN/yQ/3ONVRDJS1ic8Yauzo/aQ0=; b=obzfznFtDB5haFQzLBgGgpWEIHx5CJyhSan9+NIYJ6Zhm69HQoYozaMeSquv42AvLd C0OOLueLOYNCz6FIDsAlIO4Cwqyj+w3DAPRF8sLpplc5QCadA/zpdpqBpOPnzOr6gJoC Z+90s7ojCpEx3tYvV7IyQv2n8IwXW1DZ6YI0iubCzbbodciEGj9JfiJv6TMMWFur1ACn v3TlWN1KKkI366i4Bha9MX6SqfshtwrsA+XxXq3+bCGK0Fyta26III3LFpMLW47wl1rh dMiLo82TBGFz62MvdtwjZ45UcLSDkr4ZK90xxhi8Vl/0lhJ9DV2UrMhX9Cs8OqD6zza+ RVng== X-Gm-Message-State: AO0yUKWywQA5GAKM6wvDvx+YmzoOtjWX5SzLa5SecEwHqbK1e9DnvPdX DbovUhV9c0Idr9BMZcLXr/7mtA== X-Google-Smtp-Source: AK7set8CWZnkZDRQ2NrVSXfAyWp0pJCDeh6T3rkgQFW9EpsH7ecxeYgURgHFfVJg7b7cIt+0PpqUUg== X-Received: by 2002:a92:5202:0:b0:313:cd79:adcc with SMTP id g2-20020a925202000000b00313cd79adccmr4892616ilb.8.1675823840288; Tue, 07 Feb 2023 18:37:20 -0800 (PST) Received: from pryzbyj.telsasoft (charmander.telsasoft.com. [50.244.222.1]) by smtp.gmail.com with ESMTPSA id r9-20020a92ce89000000b00313ca4be5e1sm2050588ilo.12.2023.02.07.18.37.19 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 07 Feb 2023 18:37:19 -0800 (PST) Received: by pryzbyj.telsasoft (Postfix, from userid 1000) id B226280079B; Tue, 7 Feb 2023 20:37:18 -0600 (CST) Date: Tue, 7 Feb 2023 20:37:18 -0600 From: Justin Pryzby To: gkokolatos@pm.me Cc: Michael Paquier , Tomas Vondra , pgsql-hackers@lists.postgresql.org, Rachel Heaton Subject: Re: Add LZ4 compression in pg_dump Message-ID: <20230208023718.GJ1653@telsasoft.com> References: <4ZDVII-_kusch7xndcrTUt7OPSuQWQGX7n8rqp625Hdv6DijBjWZ38gjhxLSzPu8M_Dka-50eeKCiCU_dOdawwpv06dZtwGroYE9dHlIBLc=@pm.me> <20230126182245.GR22427@telsasoft.com> <20230127172320.GZ22427@telsasoft.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.9.4 (2018-02-28) List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk On Tue, Jan 31, 2023 at 09:00:56AM +0000, gkokolatos@pm.me wrote: > > In my mind, three things here are misleading, because it doesn't use > > gzip headers: > > > > | GzipCompressorState, DeflateCompressorGzip, "gzip compressed". > > > > This comment is about exactly that: > > > > * underlying stream. The second API is a wrapper around fopen/gzopen and > > * friends, providing an interface similar to those, but abstracts away > > * the possible compression. Both APIs use libz for the compression, but > > * the second API uses gzip headers, so the resulting files can be easily > > * manipulated with the gzip utility. > > > > AIUI, Michael says that it's fine that the user-facing command-line > > options use "-Z gzip" (even though the "custom" format doesn't use gzip > > headers). I'm okay with that, as long as that's discussed/understood. > > Thank you for the input Justin. I am currently waiting for input from a > third person to get some conclusion. I thought that it should be stated > before my inactiveness is considered as indifference, which is not. I'm not sure what there is to lose by making the names more accurate - especially since they're private/internal-only. Tomas marked himself as a committer, so maybe could comment. It'd be nice to also come to some conclusion about whether -Fc -Z gzip is confusing (due to not actually using gzip). BTW, do you intend to merge this for v16 ? I verified in earlier patch versions that tests all pass with lz4 as the default compression method. And checked that gzip output is compatible with before, and that old dumps restore correctly, and there's no memory leaks or other errors. -- Justin