Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1nQAVy-0004NT-Ga for pgsql-hackers@arkaria.postgresql.org; Fri, 04 Mar 2022 16:10:46 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1nQAVx-0001qt-8t for pgsql-hackers@arkaria.postgresql.org; Fri, 04 Mar 2022 16:10:45 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1nQAVw-0001qj-Rn for pgsql-hackers@lists.postgresql.org; Fri, 04 Mar 2022 16:10:44 +0000 Received: from mail-il1-x134.google.com ([2607:f8b0:4864:20::134]) by makus.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.92) (envelope-from ) id 1nQAVt-0007oB-D3 for pgsql-hackers@lists.postgresql.org; Fri, 04 Mar 2022 16:10:43 +0000 Received: by mail-il1-x134.google.com with SMTP id i14so6894047ilv.4 for ; Fri, 04 Mar 2022 08:10:41 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=telsasoft-com.20210112.gappssmtp.com; s=20210112; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to:user-agent; bh=DoqGaNTbkaH/YL5PDtCeE5s1q+Qd59ZxX8WuDoJVUKk=; b=R4Csp2dUaBxRvLBIn7C0yTLJDdttKBpK13Xjx0ZhhdNyJ2RiTDABvDUf/jmKK2Cpf9 LAVlr8D+8HthEYQKKplqMWxqGTAjTNZ2MzcVTvkDXKl+jEKpff9sOuszZZsUbkfqGjmx 62Un9IrtjE6BDSUd5pJrIlhg7Axw9kwlSCmJdOfwKKMBSzgCvvnReq/OOHxHGtaQ1lZK Mkld3CO51OCdq0eBolu/8IcAQfaiU/bqlD0eff1CECwxBrJroFWAg9CKitPkviRskzD0 E8dE0+zrsZIYq5ep5cXS2qkSdmUltnt2z/V5Ac8CBzHZeEh5s3r6Sv5ZAsP8Ss2ZvPWJ Javw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to:user-agent; bh=DoqGaNTbkaH/YL5PDtCeE5s1q+Qd59ZxX8WuDoJVUKk=; b=z80od5JRXVL7vQ05LhgVzNaabqp7f6TDn5Az4ut/9lJ/lZFgptbicZxXBJLdtk/ymf Q4OFRR6h0Dm3TISn7JdlzQz3V+7sFRPxf4V2nIcOH7Z8KKpI4IJLxJPgOouW/RgSdYY5 +yL5OjCUlgF344GJkQY1K4wbuxYiiwhDmM9ptdzVHAslnEpdSI+HvwTxXBpCr9oI6n4E HGS4JXxPFT5mYDNiGFc9ZjJoHcBbH43aJQlhy0La9pALEin1KA170SE6eQpTfP0Yk+C5 1VIKpmKqJZvnJySFQHzeM18NlsN58hgr2NwBmz2vsZMShIpuR/n7229OepHveyNJ8ppq Vapg== X-Gm-Message-State: AOAM530UbcSMR9nkmZ0DCso/yU8dg2d+kRrpklcgb8x5f7WNjvlxSk46 h9chqQI5ReDvsSBTLZSZIpKKhQ== X-Google-Smtp-Source: ABdhPJzPeDkngzW24tDg1QgCdCaSwkmPddJG82SK6n7uph9tkfzMiJlSHnIoHlC/ATeHDigW9Q3hEQ== X-Received: by 2002:a92:dad1:0:b0:2c6:b6:b613 with SMTP id o17-20020a92dad1000000b002c600b6b613mr7863322ilq.185.1646410240715; Fri, 04 Mar 2022 08:10:40 -0800 (PST) Received: from pryzbyj.telsasoft (charmander.telsasoft.com. [50.244.222.1]) by smtp.gmail.com with ESMTPSA id e23-20020a6b5017000000b00635b8032d45sm4899207iob.22.2022.03.04.08.10.40 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Fri, 04 Mar 2022 08:10:40 -0800 (PST) Received: by pryzbyj.telsasoft (Postfix, from userid 1000) id BDB2A800CA5; Fri, 4 Mar 2022 10:10:39 -0600 (CST) Date: Fri, 4 Mar 2022 10:10:39 -0600 From: Justin Pryzby To: Georgios Cc: pgsql-hackers@lists.postgresql.org, Rachel Heaton Subject: Re: Add LZ4 compression in pg_dump Message-ID: <20220304161039.GL27651@telsasoft.com> References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.9.4 (2018-02-28) List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk The patch is failing on cfbot/freebsd. http://cfbot.cputube.org/georgios-kokolatos.html Also, I wondered if you'd looked at the "high compression" interfaces in lz4hc.h ? Should pg_dump use that ? On Fri, Feb 25, 2022 at 08:03:40AM -0600, Justin Pryzby wrote: > Thanks for working on this. Your 0001 looks similar to what I did for zstd 1-2 > years ago. > https://commitfest.postgresql.org/32/2888/ > > I rebased and attached the latest patches I had in case they're useful to you. > I'd like to see zstd included in pg_dump eventually, but it was too much work > to shepherd the patches. Now that seems reasonable for pg16. > > With the other compression patches I've worked on, we've used an extra patch > with changes the default to the new compression algorithm, to force cfbot to > exercize the new code. > > Do you know the process with commitfests and cfbot ? > There's also this, which allows running the tests on cirrus before mailing the > patch to the hackers list. > ./src/tools/ci/README