public inbox for [email protected]help / color / mirror / Atom feed
Issues with PG15beta3 8+ messages / 2 participants [nested] [flat]
* Issues with PG15beta3 @ 2022-08-12 14:52 Didier Michel <[email protected]> 0 siblings, 1 reply; 8+ messages in thread From: Didier Michel @ 2022-08-12 14:52 UTC (permalink / raw) To: [email protected] Hello, I am integrating new pg_basebackup zstd compression functionality in Barman for compressed backup. I do encounter two main issues when using zstd compression algorithm: On ubuntu 18.04 : - command exemple: /usr/bin/pg_basebackup --dbname=dbname=replication host=db options=-cdatestyle=iso port=5432 replication=true user=barman_streaming application_name=barman_streaming_backup -v --no-password --pgdata=/var/lib/barman/main/base/20220811T162557/data --no-slot --wal-method=none --checkpoint=fast --format=tar --compress=zstd:level=5 Interesting part is "--compress=zstd:level=5" - pg_basebackup response: pg_basebackup: checkpoint completed pg_basebackup: error: this build does not support zstd compression On Ubuntu 20.04 and 22.04: The same command works. But When I try to introduce workers option (ie "--compress=zstd:level=5,workers=2") it fails with following error: pg_basebackup: checkpoint completed pg_basebackup: error: could not set compression worker count to 2: Unsupported parameter Unless I have misused pg_basebackup (which is completely possible), I am wondering if there could be an issue with PG packaging or compilation (especially for workers that triggers threads) Hoping this can help deliver PG15. Regards. Didier Michel ^ permalink raw reply [nested|flat] 8+ messages in thread
* Re: Issues with PG15beta3 @ 2022-08-12 17:38 Christoph Berg <[email protected]> parent: Didier Michel <[email protected]> 0 siblings, 1 reply; 8+ messages in thread From: Christoph Berg @ 2022-08-12 17:38 UTC (permalink / raw) To: Didier Michel <[email protected]>; +Cc: [email protected] Re: Didier Michel > On ubuntu 18.04 : > pg_basebackup: error: this build does not support zstd compression Hi Didier, bionic's zstd is too old, PG requires at least 1.4.0. libzstd-dev | 1.3.3+dfsg-2ubuntu1 | bionic | amd64, arm64, armhf, i386, ppc64el, s390x Christoph ^ permalink raw reply [nested|flat] 8+ messages in thread
* Re: Issues with PG15beta3 @ 2022-08-13 11:26 Didier Michel <[email protected]> parent: Christoph Berg <[email protected]> 0 siblings, 1 reply; 8+ messages in thread From: Didier Michel @ 2022-08-13 11:26 UTC (permalink / raw) To: Christoph Berg <[email protected]>; +Cc: [email protected] Ho thank you Christoph I only checked pg_basebackup version Didier On Fri, Aug 12, 2022 at 7:38 PM Christoph Berg <[email protected]> wrote: > Re: Didier Michel > > On ubuntu 18.04 : > > pg_basebackup: error: this build does not support zstd compression > > Hi Didier, > > bionic's zstd is too old, PG requires at least 1.4.0. > > libzstd-dev | 1.3.3+dfsg-2ubuntu1 | bionic | amd64, arm64, > armhf, i386, ppc64el, s390x > > Christoph > ^ permalink raw reply [nested|flat] 8+ messages in thread
* Re: Issues with PG15beta3 @ 2022-08-22 18:05 Didier Michel <[email protected]> parent: Didier Michel <[email protected]> 0 siblings, 1 reply; 8+ messages in thread From: Didier Michel @ 2022-08-22 18:05 UTC (permalink / raw) To: Christoph Berg <[email protected]>; +Cc: [email protected] Do you have any ideas regarding ubuntu focal and Jammy ? Didier Focal? On Sat, Aug 13, 2022 at 1:26 PM Didier Michel < [email protected]> wrote: > Ho thank you Christoph I only checked pg_basebackup version > > Didier > > On Fri, Aug 12, 2022 at 7:38 PM Christoph Berg <[email protected]> wrote: > >> Re: Didier Michel >> > On ubuntu 18.04 : >> > pg_basebackup: error: this build does not support zstd compression >> >> Hi Didier, >> >> bionic's zstd is too old, PG requires at least 1.4.0. >> >> libzstd-dev | 1.3.3+dfsg-2ubuntu1 | bionic | amd64, arm64, >> armhf, i386, ppc64el, s390x >> >> Christoph >> > ^ permalink raw reply [nested|flat] 8+ messages in thread
* Re: Issues with PG15beta3 @ 2022-08-23 08:10 Christoph Berg <[email protected]> parent: Didier Michel <[email protected]> 0 siblings, 1 reply; 8+ messages in thread From: Christoph Berg @ 2022-08-23 08:10 UTC (permalink / raw) To: Didier Michel <[email protected]>; +Cc: [email protected] Re: Didier Michel > Do you have any ideas regarding ubuntu focal and Jammy ? What ideas? Christoph ^ permalink raw reply [nested|flat] 8+ messages in thread
* Re: Issues with PG15beta3 @ 2022-08-23 09:01 Didier Michel <[email protected]> parent: Christoph Berg <[email protected]> 0 siblings, 1 reply; 8+ messages in thread From: Didier Michel @ 2022-08-23 09:01 UTC (permalink / raw) To: Christoph Berg <[email protected]>; Didier Michel <[email protected]>; [email protected] Sorry, I did not include previous message: With focal and Jammy, pg_basebackup returns another error when I try to use several workers (ie "--compress=zstd:level=5,workers=2") pg_basebackup: checkpoint completed pg_basebackup: error: could not set compression worker count to 2: Unsupported parameter I checked zstd version and it is higher then 1.4.0 (1.4.4). So I am wondering if there is something else I should check. Regards On Tue, Aug 23, 2022 at 10:10 AM Christoph Berg <[email protected]> wrote: > Re: Didier Michel > > Do you have any ideas regarding ubuntu focal and Jammy ? > > What ideas? > > Christoph > ^ permalink raw reply [nested|flat] 8+ messages in thread
* Re: Issues with PG15beta3 @ 2022-08-23 09:06 Christoph Berg <[email protected]> parent: Didier Michel <[email protected]> 0 siblings, 1 reply; 8+ messages in thread From: Christoph Berg @ 2022-08-23 09:06 UTC (permalink / raw) To: Didier Michel <[email protected]>; +Cc: [email protected] Re: Didier Michel > Sorry, I did not include previous message: > With focal and Jammy, pg_basebackup returns another error when I try to use > several workers (ie "--compress=zstd:level=5,workers=2") > > pg_basebackup: checkpoint completed > pg_basebackup: error: could not set compression worker count to 2: > Unsupported parameter Try without the workers part? I guess that needs a yet newer zstd version. Christoph ^ permalink raw reply [nested|flat] 8+ messages in thread
* Re: Issues with PG15beta3 @ 2022-08-24 08:10 Didier Michel <[email protected]> parent: Christoph Berg <[email protected]> 0 siblings, 0 replies; 8+ messages in thread From: Didier Michel @ 2022-08-24 08:10 UTC (permalink / raw) To: Christoph Berg <[email protected]>; +Cc: [email protected] Thank you for your feedback. I found this on zstd code that also help a lot: On older versions of libzstd, this option does not exist, and trying to set it will fail. Similarly for newer versions if they are compiled without threading support So I will check (not sure yet how ) if zstd packaged in ubuntu Jammy is compiled with threading support. Thank you again for your help and time. Didier On Tue, Aug 23, 2022 at 11:06 AM Christoph Berg <[email protected]> wrote: > Re: Didier Michel > > Sorry, I did not include previous message: > > With focal and Jammy, pg_basebackup returns another error when I try to > use > > several workers (ie "--compress=zstd:level=5,workers=2") > > > > pg_basebackup: checkpoint completed > > pg_basebackup: error: could not set compression worker count to 2: > > Unsupported parameter > > Try without the workers part? I guess that needs a yet newer zstd > version. > > Christoph > ^ permalink raw reply [nested|flat] 8+ messages in thread
end of thread, other threads:[~2022-08-24 08:10 UTC | newest] Thread overview: 8+ messages (download: mbox mbox.gz follow: Atom feed) -- links below jump to the message on this page -- 2022-08-12 14:52 Issues with PG15beta3 Didier Michel <[email protected]> 2022-08-12 17:38 ` Christoph Berg <[email protected]> 2022-08-13 11:26 ` Didier Michel <[email protected]> 2022-08-22 18:05 ` Didier Michel <[email protected]> 2022-08-23 08:10 ` Christoph Berg <[email protected]> 2022-08-23 09:01 ` Didier Michel <[email protected]> 2022-08-23 09:06 ` Christoph Berg <[email protected]> 2022-08-24 08:10 ` Didier Michel <[email protected]>
This inbox is served by agora; see mirroring instructions for how to clone and mirror all data and code used for this inbox