public inbox for [email protected]
help / color / mirror / Atom feedIssues with PG15beta3
8+ messages / 2 participants
[nested] [flat]
* Issues with PG15beta3
@ 2022-08-12 14:52 Didier Michel <[email protected]>
2022-08-12 17:38 ` Re: Issues with PG15beta3 Christoph Berg <[email protected]>
0 siblings, 1 reply; 8+ messages in thread
From: Didier Michel @ 2022-08-12 14:52 UTC (permalink / raw)
To: [email protected]
Hello,
I am integrating new pg_basebackup zstd compression functionality in Barman
for compressed backup.
I do encounter two main issues when using zstd compression algorithm:
On ubuntu 18.04 :
- command exemple: /usr/bin/pg_basebackup --dbname=dbname=replication
host=db options=-cdatestyle=iso port=5432 replication=true
user=barman_streaming
application_name=barman_streaming_backup -v --no-password
--pgdata=/var/lib/barman/main/base/20220811T162557/data --no-slot
--wal-method=none
--checkpoint=fast
--format=tar
--compress=zstd:level=5
Interesting part is "--compress=zstd:level=5"
- pg_basebackup response:
pg_basebackup: checkpoint completed
pg_basebackup: error: this build does not support zstd compression
On Ubuntu 20.04 and 22.04:
The same command works. But When I try to introduce workers option (ie
"--compress=zstd:level=5,workers=2") it fails with following error:
pg_basebackup: checkpoint completed
pg_basebackup: error: could not set compression worker count to 2:
Unsupported parameter
Unless I have misused pg_basebackup (which is completely possible), I am
wondering if there could be an issue with PG packaging or compilation
(especially for workers that triggers threads)
Hoping this can help deliver PG15.
Regards.
Didier Michel
^ permalink raw reply [nested|flat] 8+ messages in thread
* Re: Issues with PG15beta3
2022-08-12 14:52 Issues with PG15beta3 Didier Michel <[email protected]>
@ 2022-08-12 17:38 ` Christoph Berg <[email protected]>
2022-08-13 11:26 ` Re: Issues with PG15beta3 Didier Michel <[email protected]>
0 siblings, 1 reply; 8+ messages in thread
From: Christoph Berg @ 2022-08-12 17:38 UTC (permalink / raw)
To: Didier Michel <[email protected]>; +Cc: [email protected]
Re: Didier Michel
> On ubuntu 18.04 :
> pg_basebackup: error: this build does not support zstd compression
Hi Didier,
bionic's zstd is too old, PG requires at least 1.4.0.
libzstd-dev | 1.3.3+dfsg-2ubuntu1 | bionic | amd64, arm64, armhf, i386, ppc64el, s390x
Christoph
^ permalink raw reply [nested|flat] 8+ messages in thread
* Re: Issues with PG15beta3
2022-08-12 14:52 Issues with PG15beta3 Didier Michel <[email protected]>
2022-08-12 17:38 ` Re: Issues with PG15beta3 Christoph Berg <[email protected]>
@ 2022-08-13 11:26 ` Didier Michel <[email protected]>
2022-08-22 18:05 ` Re: Issues with PG15beta3 Didier Michel <[email protected]>
0 siblings, 1 reply; 8+ messages in thread
From: Didier Michel @ 2022-08-13 11:26 UTC (permalink / raw)
To: Christoph Berg <[email protected]>; +Cc: [email protected]
Ho thank you Christoph I only checked pg_basebackup version
Didier
On Fri, Aug 12, 2022 at 7:38 PM Christoph Berg <[email protected]> wrote:
> Re: Didier Michel
> > On ubuntu 18.04 :
> > pg_basebackup: error: this build does not support zstd compression
>
> Hi Didier,
>
> bionic's zstd is too old, PG requires at least 1.4.0.
>
> libzstd-dev | 1.3.3+dfsg-2ubuntu1 | bionic | amd64, arm64,
> armhf, i386, ppc64el, s390x
>
> Christoph
>
^ permalink raw reply [nested|flat] 8+ messages in thread
* Re: Issues with PG15beta3
2022-08-12 14:52 Issues with PG15beta3 Didier Michel <[email protected]>
2022-08-12 17:38 ` Re: Issues with PG15beta3 Christoph Berg <[email protected]>
2022-08-13 11:26 ` Re: Issues with PG15beta3 Didier Michel <[email protected]>
@ 2022-08-22 18:05 ` Didier Michel <[email protected]>
2022-08-23 08:10 ` Re: Issues with PG15beta3 Christoph Berg <[email protected]>
0 siblings, 1 reply; 8+ messages in thread
From: Didier Michel @ 2022-08-22 18:05 UTC (permalink / raw)
To: Christoph Berg <[email protected]>; +Cc: [email protected]
Do you have any ideas regarding ubuntu focal and Jammy ?
Didier
Focal?
On Sat, Aug 13, 2022 at 1:26 PM Didier Michel <
[email protected]> wrote:
> Ho thank you Christoph I only checked pg_basebackup version
>
> Didier
>
> On Fri, Aug 12, 2022 at 7:38 PM Christoph Berg <[email protected]> wrote:
>
>> Re: Didier Michel
>> > On ubuntu 18.04 :
>> > pg_basebackup: error: this build does not support zstd compression
>>
>> Hi Didier,
>>
>> bionic's zstd is too old, PG requires at least 1.4.0.
>>
>> libzstd-dev | 1.3.3+dfsg-2ubuntu1 | bionic | amd64, arm64,
>> armhf, i386, ppc64el, s390x
>>
>> Christoph
>>
>
^ permalink raw reply [nested|flat] 8+ messages in thread
* Re: Issues with PG15beta3
2022-08-12 14:52 Issues with PG15beta3 Didier Michel <[email protected]>
2022-08-12 17:38 ` Re: Issues with PG15beta3 Christoph Berg <[email protected]>
2022-08-13 11:26 ` Re: Issues with PG15beta3 Didier Michel <[email protected]>
2022-08-22 18:05 ` Re: Issues with PG15beta3 Didier Michel <[email protected]>
@ 2022-08-23 08:10 ` Christoph Berg <[email protected]>
2022-08-23 09:01 ` Re: Issues with PG15beta3 Didier Michel <[email protected]>
0 siblings, 1 reply; 8+ messages in thread
From: Christoph Berg @ 2022-08-23 08:10 UTC (permalink / raw)
To: Didier Michel <[email protected]>; +Cc: [email protected]
Re: Didier Michel
> Do you have any ideas regarding ubuntu focal and Jammy ?
What ideas?
Christoph
^ permalink raw reply [nested|flat] 8+ messages in thread
* Re: Issues with PG15beta3
2022-08-12 14:52 Issues with PG15beta3 Didier Michel <[email protected]>
2022-08-12 17:38 ` Re: Issues with PG15beta3 Christoph Berg <[email protected]>
2022-08-13 11:26 ` Re: Issues with PG15beta3 Didier Michel <[email protected]>
2022-08-22 18:05 ` Re: Issues with PG15beta3 Didier Michel <[email protected]>
2022-08-23 08:10 ` Re: Issues with PG15beta3 Christoph Berg <[email protected]>
@ 2022-08-23 09:01 ` Didier Michel <[email protected]>
2022-08-23 09:06 ` Re: Issues with PG15beta3 Christoph Berg <[email protected]>
0 siblings, 1 reply; 8+ messages in thread
From: Didier Michel @ 2022-08-23 09:01 UTC (permalink / raw)
To: Christoph Berg <[email protected]>; Didier Michel <[email protected]>; [email protected]
Sorry, I did not include previous message:
With focal and Jammy, pg_basebackup returns another error when I try to use
several workers (ie "--compress=zstd:level=5,workers=2")
pg_basebackup: checkpoint completed
pg_basebackup: error: could not set compression worker count to 2:
Unsupported parameter
I checked zstd version and it is higher then 1.4.0 (1.4.4). So I am
wondering if there is something else I should check.
Regards
On Tue, Aug 23, 2022 at 10:10 AM Christoph Berg <[email protected]> wrote:
> Re: Didier Michel
> > Do you have any ideas regarding ubuntu focal and Jammy ?
>
> What ideas?
>
> Christoph
>
^ permalink raw reply [nested|flat] 8+ messages in thread
* Re: Issues with PG15beta3
2022-08-12 14:52 Issues with PG15beta3 Didier Michel <[email protected]>
2022-08-12 17:38 ` Re: Issues with PG15beta3 Christoph Berg <[email protected]>
2022-08-13 11:26 ` Re: Issues with PG15beta3 Didier Michel <[email protected]>
2022-08-22 18:05 ` Re: Issues with PG15beta3 Didier Michel <[email protected]>
2022-08-23 08:10 ` Re: Issues with PG15beta3 Christoph Berg <[email protected]>
2022-08-23 09:01 ` Re: Issues with PG15beta3 Didier Michel <[email protected]>
@ 2022-08-23 09:06 ` Christoph Berg <[email protected]>
2022-08-24 08:10 ` Re: Issues with PG15beta3 Didier Michel <[email protected]>
0 siblings, 1 reply; 8+ messages in thread
From: Christoph Berg @ 2022-08-23 09:06 UTC (permalink / raw)
To: Didier Michel <[email protected]>; +Cc: [email protected]
Re: Didier Michel
> Sorry, I did not include previous message:
> With focal and Jammy, pg_basebackup returns another error when I try to use
> several workers (ie "--compress=zstd:level=5,workers=2")
>
> pg_basebackup: checkpoint completed
> pg_basebackup: error: could not set compression worker count to 2:
> Unsupported parameter
Try without the workers part? I guess that needs a yet newer zstd
version.
Christoph
^ permalink raw reply [nested|flat] 8+ messages in thread
* Re: Issues with PG15beta3
2022-08-12 14:52 Issues with PG15beta3 Didier Michel <[email protected]>
2022-08-12 17:38 ` Re: Issues with PG15beta3 Christoph Berg <[email protected]>
2022-08-13 11:26 ` Re: Issues with PG15beta3 Didier Michel <[email protected]>
2022-08-22 18:05 ` Re: Issues with PG15beta3 Didier Michel <[email protected]>
2022-08-23 08:10 ` Re: Issues with PG15beta3 Christoph Berg <[email protected]>
2022-08-23 09:01 ` Re: Issues with PG15beta3 Didier Michel <[email protected]>
2022-08-23 09:06 ` Re: Issues with PG15beta3 Christoph Berg <[email protected]>
@ 2022-08-24 08:10 ` Didier Michel <[email protected]>
0 siblings, 0 replies; 8+ messages in thread
From: Didier Michel @ 2022-08-24 08:10 UTC (permalink / raw)
To: Christoph Berg <[email protected]>; +Cc: [email protected]
Thank you for your feedback.
I found this on zstd code that also help a lot:
On older versions of libzstd, this option does not exist, and
trying to set it will fail. Similarly for newer versions if they
are compiled without threading support
So I will check (not sure yet how ) if zstd packaged in ubuntu Jammy is
compiled with threading support.
Thank you again for your help and time.
Didier
On Tue, Aug 23, 2022 at 11:06 AM Christoph Berg <[email protected]> wrote:
> Re: Didier Michel
> > Sorry, I did not include previous message:
> > With focal and Jammy, pg_basebackup returns another error when I try to
> use
> > several workers (ie "--compress=zstd:level=5,workers=2")
> >
> > pg_basebackup: checkpoint completed
> > pg_basebackup: error: could not set compression worker count to 2:
> > Unsupported parameter
>
> Try without the workers part? I guess that needs a yet newer zstd
> version.
>
> Christoph
>
^ permalink raw reply [nested|flat] 8+ messages in thread
end of thread, other threads:[~2022-08-24 08:10 UTC | newest]
Thread overview: 8+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2022-08-12 14:52 Issues with PG15beta3 Didier Michel <[email protected]>
2022-08-12 17:38 ` Christoph Berg <[email protected]>
2022-08-13 11:26 ` Didier Michel <[email protected]>
2022-08-22 18:05 ` Didier Michel <[email protected]>
2022-08-23 08:10 ` Christoph Berg <[email protected]>
2022-08-23 09:01 ` Didier Michel <[email protected]>
2022-08-23 09:06 ` Christoph Berg <[email protected]>
2022-08-24 08:10 ` Didier Michel <[email protected]>
This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox