Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1nUo3U-0001js-Ig for pgsql-hackers@arkaria.postgresql.org; Thu, 17 Mar 2022 11:12:32 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1nUo3T-0002Yh-CA for pgsql-hackers@arkaria.postgresql.org; Thu, 17 Mar 2022 11:12:31 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1nUo3S-0002Wn-Uu for pgsql-hackers@lists.postgresql.org; Thu, 17 Mar 2022 11:12:31 +0000 Received: from mail-qt1-x831.google.com ([2607:f8b0:4864:20::831]) by makus.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.92) (envelope-from ) id 1nUo3L-0007eq-DI for pgsql-hackers@lists.postgresql.org; Thu, 17 Mar 2022 11:12:29 +0000 Received: by mail-qt1-x831.google.com with SMTP id s11so4042440qtc.3 for ; Thu, 17 Mar 2022 04:12:23 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=telsasoft-com.20210112.gappssmtp.com; s=20210112; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to:user-agent; bh=ClPgMQje7uQCC/Ur+UDzC4TzQutX2Nwbo52upwQ7B3s=; b=bgdKxpyX1B+tEMhgqnBdTbPSDLTt2R3R1h+O2G0z4HX1NCiDrcHrPzDSveypqQ0hfq EJ275sQpPyj2xkf87wmrkox2U1OrYzz4KCOIfd3Enijl3K+VOGZZmdzyq/dkka2fs/hQ hnHUEHuZMtlvnkcnvX2MgXumPAl086tzK3DAuL5Xq6Uti93voUbFLhT897eN0LGEcTQZ 5WJ3O9FwJ5uJjGYsNx6wf4S3vMo/+3brt3OGHClyjSgj0Ggm6LHU27fp9pOy58GSKZ9f 1vae5NZPMHGGYdzzGjO7YXuAyWLxG4XPypJtfQ3esfyL16vU4OvZmL5jXphurkWkohUp hGcQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to:user-agent; bh=ClPgMQje7uQCC/Ur+UDzC4TzQutX2Nwbo52upwQ7B3s=; b=im+r0YW87akxf0mYnIu0dyajymBuGNGKiuDbr5tfAlWTao9/Qu6UEOCRUP2/qP8LdN HjgROFUbjkNd1+k9sVBwRX4K9J11Gq/AV5EP47E68DvZr22+6vu5blx5eePugQ7pFEVI B/lpQ9ijUs+u2W/qqRkAPYJA+0DJN65DAuu9QR8+FZAQcRfodp7HvN+YsrIV6EunHJRt zRnZDEhrllkEwJHxXAB0KROVj1EWC2YMK4+Opjn5chCXk1vj2yXtEGC7tauQvnuhs4Am CHzEKpulynfM7TD8+QDM3KaEgL1m8lRcyOz+FnJZ6o4km0RwXldeUXgPKkyVwFwHc3sP Tf2A== X-Gm-Message-State: AOAM531RtfYn3HLjistGoMbz5I2IL8GFPVqQJ0n8qJhxVrElTfZacTfH jvGfhQqphH/UY9smFoJfAp2c6w== X-Google-Smtp-Source: ABdhPJxbhOR0FIOsEobR6kaIMiqmQtvUtpMsa6wJVlbzbWhSaJWeR7RcRYePUlCCzJCQpGOEkpWNeg== X-Received: by 2002:ac8:57d6:0:b0:2e0:68af:7c52 with SMTP id w22-20020ac857d6000000b002e068af7c52mr3186918qta.380.1647515542344; Thu, 17 Mar 2022 04:12:22 -0700 (PDT) Received: from pryzbyj.telsasoft (charmander.telsasoft.com. [50.244.222.1]) by smtp.gmail.com with ESMTPSA id u19-20020a05622a199300b002e1a669eeb6sm3511150qtc.34.2022.03.17.04.12.21 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Thu, 17 Mar 2022 04:12:21 -0700 (PDT) Received: by pryzbyj.telsasoft (Postfix, from userid 1000) id 00C5D802A96; Thu, 17 Mar 2022 06:12:20 -0500 (CDT) Date: Thu, 17 Mar 2022 06:12:20 -0500 From: Justin Pryzby To: Michael Paquier Cc: Robert Haas , Georgios Kokolatos , Magnus Hagander , Dilip Kumar , pgsql-hackers@lists.postgresql.org Subject: Re: Teach pg_receivewal to use lz4 compression Message-ID: <20220317111220.GI28503@telsasoft.com> References: <98dDHVqTFjZbSkNWXboFJwkOhbR0l6v72vtj31Zels9d5P9wmLxTKqdaipQjkRFEhafwNU3Ds_V0NC8hrpu_JqEJ3JHVIzTIRKNv_IjmVJ4=@pm.me> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.9.4 (2018-02-28) List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk On Sat, Feb 12, 2022 at 12:52:40PM +0900, Michael Paquier wrote: > On Fri, Feb 11, 2022 at 10:07:49AM -0500, Robert Haas wrote: > > Over in http://postgr.es/m/CA+TgmoYUDEJga2qV_XbAZ=pGEBaOsgFmzZ6Ac4_sRwOm_+UeHA@mail.gmail.com > > I was noticing that CreateWalTarMethod doesn't support LZ4 > > compression. It would be nice if it did. I thought maybe the patch on > > this thread would fix that, but I think maybe it doesn't, because it > > looks like that's touching the WalDirectoryMethod part of that file, > > rather than the WalTarMethod part. Is that correct? > > Correct. pg_receivewal only cares about the directory method, so this > thread was limited to this part. Yes, it would be nice to extend > fully the tar method of walmethods.c to support LZ4, but I was not > sure what needed to be done, and I am still not sure based on what has > just been done as of 751b8d23. > > > And, on a related note, Michael, do you plan to get something > > committed here? > > Apart from f79962d, babbbb5 and 50e1441, I don't think that there was > something left to do for this thread. Perhaps I am missing something? I think this should use +#include "lz4frame.h" commit babbbb595d2322da095a1e6703171b3f1f2815cb Author: Michael Paquier Date: Fri Nov 5 11:33:25 2021 +0900 Add support for LZ4 compression in pg_receivewal -- Justin