Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1lNdhY-0000Jx-Ri for pgsql-hackers@arkaria.postgresql.org; Sat, 20 Mar 2021 15:39:44 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1lNdhX-0004dd-Fe for pgsql-hackers@arkaria.postgresql.org; Sat, 20 Mar 2021 15:39:43 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1lNdhX-0004dW-8S for pgsql-hackers@lists.postgresql.org; Sat, 20 Mar 2021 15:39:43 +0000 Received: from mail-il1-x133.google.com ([2607:f8b0:4864:20::133]) by makus.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.92) (envelope-from ) id 1lNdhQ-00042P-LW for pgsql-hackers@lists.postgresql.org; Sat, 20 Mar 2021 15:39:41 +0000 Received: by mail-il1-x133.google.com with SMTP id z9so10817532ilb.4 for ; Sat, 20 Mar 2021 08:39:36 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=telsasoft-com.20150623.gappssmtp.com; s=20150623; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to:user-agent; bh=1/DhZfbTCMYaaapHjUb0rdo1iyJL3/cEzfDGAT1nWOQ=; b=J3wxFnbtwYsupZF5LZc4kveFGcX4yoM6DyLy37pY22JgA5ZNfieJBIA28Wddx46kyl X9J+CQ7vz5a3aUqKHdG7OVdbdj4obFU8F7AshNg3AcXiTdIuCn9x0RLy+uOH5eCYW63f 4u583ougDXtRBgg+u6WKX1tGpt88nG3hSoY0431YYPGssWS5sED1Y4RBqGfBWHTi+MMM q3ArqC6UBBql3C+0SdOCl1ZG1xN63VlvL5lhJ+PD9xw2hL/7jCd0qnMyoiJMH2oMFyWU tMq9ooiHPkfxRluPyFiCHCUNgMs5rSn/foR9uIoySnknRl3k4UigTZh8ED4Tjo/ksixi nxOw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to:user-agent; bh=1/DhZfbTCMYaaapHjUb0rdo1iyJL3/cEzfDGAT1nWOQ=; b=YqMulAXG4N4Z1A5MJXm8ndK+mldjlRxt7z13ze2cO+Hn5t89ksaBtv2ca3P3UwIB6h gA9huwL06hX/2VvkOMw3SsV0SR5oJSO53EigP1s0EBrzoavsRQdEVm4kmI2LIfM3TCwg 6scQczj8kY0IPs3soGrsHJBMJeqcu+ygEakCDoJoOJD0wXlrbc0Mz+GYMapzn17miUmV deNds4Ls7MHYRp3aifGv+d00mQ+qNMoRN7Iib9Bfv4yGF+0a7rEHdxP4PMkoZxQ0TsmK 9k2N7hKEv7L1DIZaL+k6xH3TGLzGA0YaH6gqoFl08tV2GGjXciYgxeS/DhfooJnLZO+1 Wzfw== X-Gm-Message-State: AOAM532WPdMdV+/MpZljWhxjLcvCh0+yslK2UhGUe4xiFqm0Ttsop1tP 5xWko6Kmns5/3PPzlfA5VMUaWw== X-Google-Smtp-Source: ABdhPJxE66ZDeWVwJvbmOpY1vyoyQq2g3NFkwduPUPDjkkLqDpeq9qrXcQedE8iw+JvNoSNt9pHfBg== X-Received: by 2002:a92:ce88:: with SMTP id r8mr5974873ilo.78.1616254775713; Sat, 20 Mar 2021 08:39:35 -0700 (PDT) Received: from pryzbyj.telsasoft (charmander.telsasoft.com. [50.244.222.1]) by smtp.gmail.com with ESMTPSA id s16sm4377721ioe.44.2021.03.20.08.39.35 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Sat, 20 Mar 2021 08:39:35 -0700 (PDT) Received: by pryzbyj.telsasoft (Postfix, from userid 1000) id 3A4038009E1; Sat, 20 Mar 2021 10:39:34 -0500 (CDT) Date: Sat, 20 Mar 2021 10:39:34 -0500 From: Justin Pryzby To: Dilip Kumar Cc: Tom Lane , Robert Haas , Alvaro Herrera , Andres Freund , Tomas Vondra , Alexander Korotkov , David Steele , Ildus Kurbangaliev , Dmitry Dolgov <9erthalion6@gmail.com>, pgsql-hackers@lists.postgresql.org Subject: Re: [HACKERS] Custom compression methods Message-ID: <20210320153933.GT11765@telsasoft.com> References: <20210319222242.GA23930@alvherre.pgsql> <4158590.1616185209@sss.pgh.pa.us> <20210320000625.GP11765@telsasoft.com> <20210320074420.GR11765@telsasoft.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.9.4 (2018-02-28) List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk On Sat, Mar 20, 2021 at 04:37:53PM +0530, Dilip Kumar wrote: > - 0006 is fine but not sure what is the advantage over what we have today? The advantage is that it's dozens of lines shorter, and automatically includes a HINT. SET default_toast_compression = 'I do not exist compression'; ERROR: invalid value for parameter "default_toast_compression": "I do not exist compression" -DETAIL: Compression method "I do not exist compression" does not exist. +HINT: Available values: pglz, lz4. If we use a GUC hook, I think it should be to special case lz4 to say: "..must be enabled when PG was built". > - And, 0008 and 0009, I think my > 0001-Fixup-dump-toast-compression-method.patch[1] is doing this in a > much simpler way, please have a look and let me know if you think that > has any problems and we need to do the way you are doing here? I tested and saw that your patch doesn't output "SET default_toast_compression" in non-text dumps (pg_dump -Fc). Also, I think the internal newline should be removed: ALTER TABLE public.t ALTER COLUMN b SET COMPRESSION lz4; -- Justin