Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.96) (envelope-from ) id 1vYS4p-003mWS-0M for pgsql-hackers@arkaria.postgresql.org; Wed, 24 Dec 2025 16:51:08 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.96) (envelope-from ) id 1vYS4n-005C4D-2Y for pgsql-hackers@arkaria.postgresql.org; Wed, 24 Dec 2025 16:51:06 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.96) (envelope-from ) id 1vYS4n-005C43-17 for pgsql-hackers@lists.postgresql.org; Wed, 24 Dec 2025 16:51:06 +0000 Received: from mail-vk1-xa36.google.com ([2607:f8b0:4864:20::a36]) by makus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.96) (envelope-from ) id 1vYS4j-002QQT-0f for pgsql-hackers@lists.postgresql.org; Wed, 24 Dec 2025 16:51:05 +0000 Received: by mail-vk1-xa36.google.com with SMTP id 71dfb90a1353d-55fe7eb1ad1so4614814e0c.1 for ; Wed, 24 Dec 2025 08:51:00 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=xzilla-net.20230601.gappssmtp.com; s=20230601; t=1766595060; x=1767199860; darn=lists.postgresql.org; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=ygzJcptSsM9oFUfCdBUNv+Whv6FfP+iao8Ia9IPi43w=; b=FtPX95Vq2J9w1nO5NJ1lL6xiVyrKYE3d+knT6eeJKH1fHuHnxpwZx8WVmVMQoKplc7 ETpL1hZrqSwaOQbujmdFy4N0gBMOPRnLASxiMkncplEjDQjDBPuuvE4lWuESZI44ciOA Kz4YpxjsRnTbOskq0sw+RFAMuHgh/YRzHqyY4fm39vSoqkdMFAc6Oq3nw7xgdGwOk7FN 8Jg/HcDFzQgeBgMuBGk3yg3imr0Wyxs3azV8CvOvmPe/UOqRPSGULrmOWWcdHttsmlr9 KaO8hRaDb/Xe2jhVefFH9PMFu50ERk4OVwtkairtdLyAtxiU6coWmv8U74ZzZuChkcQZ +l9g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1766595060; x=1767199860; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-gg:x-gm-message-state:from :to:cc:subject:date:message-id:reply-to; bh=ygzJcptSsM9oFUfCdBUNv+Whv6FfP+iao8Ia9IPi43w=; b=UUZ6oWgoii6kOhvPZOFETZOK2qJ5dNwJuEpuI/Sr+fCoYM2yfObjZ7LWZm56lOUD9R 8ZlUCHfeG5V9nyXBkCYuc/mITU7NTIpuA/1BBpYCjqlSeJ8d49ygDDY17Af450FsHmSR VVe5kzxcL0cRSlxkVRRx8mMWFzXkQIno0OC/6sughrjiQMmENtAOp0OmSlAjkgxW979j WBhakEjxAZFwCpEFiCu4BV8YLefU/y0Y83Az4fWvKF+D6wnDxK9dbFLDOvlErEHJceU0 grs22GupL0nLu5owDFK8jnYDt6dEgNeVLtXm8QiiVc3rJTldNhpsPCj6Y50HZoL69MIo fcxQ== X-Forwarded-Encrypted: i=1; AJvYcCXZkFXSpEgV82u1+J5FpHIL3k1h8gLGNKg+gUqApZKg+rQorJrVEMFPDC+XHCRVuLGFtmVoi6LKKgbBwWPM@lists.postgresql.org X-Gm-Message-State: AOJu0YxxmdcDj6Xy6NUXOjq3YPa3p5fX7EIpMvV9L1BdYS2FL5TPDanZ 8llfGw1AS34Ozs/0swvih7Kpo8vtLllIcIZdm6b04HD50LCWabwHtYz7V5tTBT94Ro3prLlePuu xauhee/THGc2Dmxl6vmpjiUh1cXcxiTqc7z28wuzVrA== X-Gm-Gg: AY/fxX4NDyqbnIg4uzu3YGy0m7YfzSy4/2jpAOut4v+4xVOsLW84z6g7sQToGLknL5i W07N2THirPpG2Ub22s8rXXEkOGsb7fnzcFcnwUvzmTnbVzMdEYfhU4mIlW+IvM8AlJK32cRFz5K 37qm8jEDEO5NmVsknTX37kr+7EcKl6jMLTo8aFd/DbaGtvmh5/fjdmkNdaQZUYraKMqEVaHbli5 DJLySWpCw528DB0nqpy94kakRntqUPzzaBHumxpxQ1e8CbwmONPK5KdOT92y4okWuKyzw8= X-Google-Smtp-Source: AGHT+IFXNUgpHrnkXhT5gN5LUlFr3cOlE1I3Nbu2xX9Fx2AT4Yh6mPN6FF7TDGR0POQ9xF/hjG3WDehS+txxbVWMB+c= X-Received: by 2002:a05:6102:f83:b0:5db:debf:6588 with SMTP id ada2fe7eead31-5eb1a62c817mr5378702137.9.1766595059909; Wed, 24 Dec 2025 08:50:59 -0800 (PST) MIME-Version: 1.0 References: <4c70b0f6-5aba-464c-b145-464a620c1222@eisentraut.org> In-Reply-To: From: Robert Treat Date: Wed, 24 Dec 2025 11:50:48 -0500 X-Gm-Features: AQt7F2rNru-uvnXejw3PHRTlEfhdi7lk_v3eYwl99vH8IHCR0enQgtF-12ergyc Message-ID: Subject: Re: Fwd: [PATCH] Add zstd compression for TOAST using extended header format To: Michael Paquier Cc: Dharin Shah , Peter Eisentraut , pgsql-hackers@lists.postgresql.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk On Thu, Dec 18, 2025 at 5:44=E2=80=AFPM Michael Paquier wrote: > On Thu, Dec 18, 2025 at 10:44:22PM +0100, Dharin Shah wrote: > > I'll share the detailed benchmark script with the next patch revision. = But > > also a potential path forward could be that we could just fully replace > > pglz (can bring it up later in different thread) > > I don't think that we will ever be able to remove pglz. It would be > nice, as final result of course, but I also expect that not being able > to decompress pglz data is going to lead to a lot of user pain. That > would be also very expensive to check at upgrade for large instances. > Agreed that I can't see pglz being removed any time soon, if ever. Thinking through what a conversion process would look like seems unwieldy at best, so I think we definitely need it for backwards compatibility, plus I think it is useful to have a self-contained option. I'd almost suggest we should look at replacing lz4, but I don't think that is significantly easier, it just has a smaller, more invested, blast radius. That said, I do suspect ztsd could quickly become a popular recommendation and/or default among users / consultants / service providers. Robert Treat https://xzilla.net