Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1rPhr4-00DXHt-WD for pgsql-admin@arkaria.postgresql.org; Tue, 16 Jan 2024 11:43:43 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1rPhr3-0037xN-LK for pgsql-admin@arkaria.postgresql.org; Tue, 16 Jan 2024 11:43:41 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1rPhr3-0037xE-8t for pgsql-admin@lists.postgresql.org; Tue, 16 Jan 2024 11:43:41 +0000 Received: from jakobs.com ([85.214.83.89] helo=rs.plausibolo.de) by magus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1rPhr0-0026kl-0p for pgsql-admin@lists.postgresql.org; Tue, 16 Jan 2024 11:43:40 +0000 Received: from localhost (localhost [127.0.0.1]) by rs.plausibolo.de (Postfix) with ESMTP id 2BA3D3804C5; Tue, 16 Jan 2024 12:43:36 +0100 (CET) Received: from rs.plausibolo.de ([IPv6:::1]) by localhost (h2367442.stratoserver.net [IPv6:::1]) (amavisd-new, port 10024) with ESMTP id dY2ywpIMSPnF; Tue, 16 Jan 2024 12:43:36 +0100 (CET) Received: from [192.168.178.88] (xdsl-212-8-136-111.nc.de [212.8.136.111]) by rs.plausibolo.de (Postfix) with ESMTPSA id A767D3804BF; Tue, 16 Jan 2024 12:43:35 +0100 (CET) Message-ID: <1973cf63-3c87-c48e-f91e-89f39c455b7e@jakobs.com> Date: Tue, 16 Jan 2024 12:43:34 +0100 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.12.0 Subject: Re: failed to setup barman backup when Posgres is running in Podman Container Content-Language: de-DE To: pgsql-admin@lists.postgresql.org References: From: Holger Jakobs In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="------------UQ4bLfF9TlM9GmOwdGTVAXKc" List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --------------UQ4bLfF9TlM9GmOwdGTVAXKc Content-Type: multipart/mixed; boundary="------------AfKrPElAsMjo8ctSNtOd6DK3"; protected-headers="v1" From: Holger Jakobs To: pgsql-admin@lists.postgresql.org Message-ID: <1973cf63-3c87-c48e-f91e-89f39c455b7e@jakobs.com> Subject: Re: failed to setup barman backup when Posgres is running in Podman Container References: In-Reply-To: --------------AfKrPElAsMjo8ctSNtOd6DK3 Content-Type: multipart/alternative; boundary="------------NtNM5rt1yD4fCZc6kaupK9HK" --------------NtNM5rt1yD4fCZc6kaupK9HK Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: base64 QW0gMTYuMDEuMjQgdW0gMDk6NTQgc2NocmllYiBSb21hcyBLb250cmltYXM6DQo+IEhpLA0K Pg0KPiBJZiBJIHVuZGVyc3RhbmQgY29ycmVjdGx5LCB5b3UgYWxyZWFkeSBoYXZlIFdBTCBz dHJlYW1pbmcgc2V0dXAgYW5kIA0KPiBpdCdzIGluIE9LIHN0YXRlIChzZXR0aW5nIGluIGlu IGNvbmYgc3RyZWFtaW5nX2FyY2hpdmVyID0gb24pLiBCYXJtYW4gDQo+IHdpbGwgY29udGlu dW91c2x5IHJlY2VpdmUgYW5kIGFyY2hpdmUgdHJhbnNhY3Rpb24gbG9ncy7CoFdoeSB3b3Vs ZCB5b3UgDQo+IHN0aWxsIG5lZWQgc3RhbmRhcmQgYXJjaGl2ZV9jb21tYW5kPw0KPiBodHRw czovL2RvY3MucGdiYXJtYW4ub3JnL3JlbGVhc2UvMy45LjAvI3dhbC1zdHJlYW1pbmcNCj4N Cj4NCj4NCj4gT24gVGh1LCAxMSBKYW4gMjAyNCBhdCAxMToxMywgZHVjIGhpZXAgaGEgPGhh ZHVjaGllcEBnb29nbGVtYWlsLmNvbT4gDQo+IHdyb3RlOg0KPg0KPg0KPiAgICAgRGVhciBB bGwsDQo+DQo+DQo+ICAgICBJIGFtIHRyeWluZyB0byB1c2UgQmFybWFuIHRvIGJhY2sgdXAg UG9zdGdyZVNRTCwgd2hpY2ggaXMgcnVubmluZw0KPiAgICAgaW4gYSBQb2RtYW4gY29udGFp bmVyLiBIb3dldmVyLCBJIGVuY291bnRlciB0aGUgZXJyb3IgIldBTA0KPiAgICAgYXJjaGl2 ZTogRkFJTEVELCIgYXMgc2hvd24gYmVsb3c6DQo+DQo+ICAgICAgICAgI2Jhcm1hbiBjaGVj ayB0ZXN0ZGINCj4gICAgICAgICBTZXJ2ZXIgdGVzdGRiOg0KPiAgICAgICAgIFdBTCBhcmNo aXZlOiBGQUlMRUQgKHBsZWFzZSBtYWtlIHN1cmUgV0FMIHNoaXBwaW5nIGlzIHNldCB1cCkN Cj4gICAgICAgICBQb3N0Z3JlU1FMOiBPSw0KPiAgICAgICAgIHN1cGVydXNlcjogT0sNCj4g ICAgICAgICBQb3N0Z3JlU1FMIHN0cmVhbWluZzogT0sNCj4gICAgICAgICB3YWxfbGV2ZWw6 IE9LDQo+ICAgICAgICAgcmVwbGljYXRpb24gc2xvdDogT0sNCj4gICAgICAgICBkaXJlY3Rv cmllczogT0sNCj4gICAgICAgICByZXRlbnRpb24gcG9saWN5IHNldHRpbmdzOiBPSw0KPiAg ICAgICAgIGJhY2t1cCBtYXhpbXVtIGFnZTogT0sgKG5vIGxhc3RfYmFja3VwX21heGltdW1f YWdlIHByb3ZpZGVkKQ0KPiAgICAgICAgIGNvbXByZXNzaW9uIHNldHRpbmdzOiBPSw0KPiAg ICAgICAgIGZhaWxlZCBiYWNrdXBzOiBPSyAodGhlcmUgYXJlIDAgZmFpbGVkIGJhY2t1cHMp DQo+ICAgICAgICAgbWluaW11bSByZWR1bmRhbmN5IHJlcXVpcmVtZW50czogT0sgKGhhdmUg MCBiYWNrdXBzLCBleHBlY3RlZA0KPiAgICAgICAgIGF0IGxlYXN0IDApDQo+ICAgICAgICAg cGdfYmFzZWJhY2t1cDogT0sNCj4gICAgICAgICBwZ19iYXNlYmFja3VwIGNvbXBhdGlibGU6 IE9LDQo+ICAgICAgICAgcGdfYmFzZWJhY2t1cCBzdXBwb3J0cyB0YWJsZXNwYWNlcyBtYXBw aW5nOiBPSw0KPiAgICAgICAgIHBnX3JlY2VpdmV4bG9nOiBPSw0KPiAgICAgICAgIHBnX3Jl Y2VpdmV4bG9nIGNvbXBhdGlibGU6IE9LDQo+ICAgICAgICAgcmVjZWl2ZS13YWwgcnVubmlu ZzogT0sNCj4gICAgICAgICBhcmNoaXZlciBlcnJvcnM6IE9LDQo+DQo+ICAgICBJIGhhdmUg aWRlbnRpZmllZCB0aGF0IG5vcm1hbGx5LCB3aGVuIHRoZSBQb3N0Z3JlU1FMIGRhdGFiYXNl IGlzDQo+ICAgICBpbnN0YWxsZWQgb24gYSByZWd1bGFyIFZNIChub3QgaW4gYSBjb250YWlu ZXIpLCB0aGUNCj4gICAgIGFyY2hpdmVfY29tbWFuZCBwYXJhbWV0ZXIgdW5kZXIgcG9zdGdy ZXNxbC5jb25mIGxvb2tzIGxpa2UgdGhpczoNCj4NCj4gICAgICAgICBhcmNoaXZlX2NvbW1h bmQgPSAncnN5bmMgLWEgJXANCj4gICAgICAgICBiYXJtYW5AYmFybWFuLWJhY2t1cC1zZXJ2 ZXItaXA6L2RhdGEvYmFybWFuL21haW4tZGItc2VydmVyL2luY29taW5nLyVmJw0KPg0KPiAg ICAgSG93ZXZlciwgd2hlbiBQb3N0Z3JlU1FMIGlzIGluc3RhbGxlZCBvbiBhIFBvZG1hbiBj b250YWluZXIsIEkNCj4gICAgIGNhbm5vdCB1c2UgdGhlIGFib3ZlIGFyY2hpdmVfY29tbWFu ZCBiZWNhdXNlIHdpdGhpbiB0aGUgUG9zdGdyZVNRTA0KPiAgICAgY29udGFpbmVyLCBpdCBk b2Vzbid0IHVuZGVyc3RhbmQgcnN5bmMsIHNzaCwgYW5kIHRoZSBiYXJtYW4gdXNlci4NCj4g ICAgIFRoYXQncyB3aHkgSSBoYXZlIHRvIHVzZSBhIG5vcm1hbCBjb3B5IGNvbW1hbmQgbGlr ZToNCj4NCj4gICAgIMKgIMKgIMKgIMKgIMKgIGFyY2hpdmVfY29tbWFuZCA9ICdjcCAtaSAl cCAvc3J2L2FyY2hpdmUvJWYnDQo+DQo+ICAgICBJIHRoZW4gbW91bnRlZCB0aGlzIHdhbC1m aWxlcyBmb2xkZXIgb24NCj4gICAgICcvZGF0YS9iYXJtYW4vbWFpbi1kYi1zZXJ2ZXIvaW5j b21pbmcvJWYnLiBBcyBhIHJlc3VsdCwgYWxsIHRoZXNlDQo+ICAgICB3YWxfZmlsZXMgaGF2 ZSB0aGUgUG9zdGdyZVNRTCBvd25lcnNoaXAgYW5kIG5vdCB0aGUgYmFybWFuDQo+ICAgICBv d25lcnNoaXAuIFRoZSBiYXJtYW4gdXNlciBoYXMgbm8gcHJpdmlsZWdlcyB0byBjaGFuZ2Ug dGhlc2UNCj4gICAgIHdhbC1maWxlcywgd2hpY2ggaXMgd2h5IHRoZSBXQUwgYXJjaGl2ZSBp cyBtYXJrZWQgYXMgRkFJTEVELg0KPg0KPiAgICAgRG8geW91IGtub3cgaG93IHRvIHNvbHZl IHRoaXMgaXNzdWU/IGRvIEkgaGF2ZSB0byBpbnN0YWxsIEJhcm1hbg0KPiAgICAgYW5kIFBv c3RncmVTUUwgaW4gdGhlIHNhbWUgUG9kIGNvbnRhaW5lciBpbiBvcmRlciB0byBiYWNrdXDC oA0KPiAgICAgUG9zdGdyZVNRTCBjb250YWluZXI/IE9yIGlzIHRoZXJlIGFub3RoZXIgc29s dXRpb24gdG8gdGhpcyBwcm9ibGVtPw0KPg0KPiAgICAgVGhhbmsgeW91IGZvciB5b3VyIHN1 cHBvcnQgaW4gYWR2YW5jZS4NCj4NCj4gICAgIEJlc3QsDQo+ICAgICBIYQ0KPg0KDQogPiBX aHkgd291bGQgeW91IHN0aWxsIG5lZWQgc3RhbmRhcmQgYXJjaGl2ZV9jb21tYW5kPw0KDQpZ b3UgbmVlZCBpdCBvbmx5IGlmIHRoZSBzdHJlYW1pbmcgc2Vjb25kYXJ5IHNlcnZlcnMgYXJl IG9mZmxpbmUgZm9yIGEgDQp3aGlsZSBhbmQgY2Fubm90IHN0cmVhbSBvbGQgV0FMIGZpbGVz IGZyb20gdGhlIHByaW1hcnkgYmVjYXVzZSB0aGUgaGF2ZSANCmJlZW4gZGVsZXRlZCB0aGVy ZS4NCg0KQXJjaGl2ZSBzaGlwcGluZyBjYW4gdGhlbiBjb21lIHRvIHRoZSByZXNjdWUsIHNv IHRoYXQgdGhlIHN0YW5kYnkgc2VydmVyIA0KY2FuIGdldCB0aGUgbWlzc2luZyBXQUwgZmls ZSBmcm9tIHRoZSBhcmNoaXZlLiBTdWJzZXF1ZW50bHksIGl0IHdpbGwgDQpjb250aW51ZSB0 byBzdHJlYW0gZGlyZWN0bHkgZnJvbSB0aGUgcHJpbWFyeS4NCg0KUmVnYXJkcywNCg0KSG9s Z2VyDQoNCi0tIA0KSG9sZ2VyIEpha29icywgQmVyZ2lzY2ggR2xhZGJhY2gsIFRlbC4gKzQ5 LTE3OC05NzU5MDEyDQoNCg== --------------NtNM5rt1yD4fCZc6kaupK9HK Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Am 16.01.24 um 09:54 schrieb Romas Kontrimas:
Hi,

If I understand correctly, you already have WAL streaming setup and it's in OK state (setting in in conf streaming_archiver =3D on). Barman will continuously receive and archive transaction logs.=C2=A0Why would you still need standard archive_command?
= https:= //docs.pgbarman.org/release/3.9.0/#wal-streaming



On Thu, 11 Jan 2024 at 11:1= 3, duc hiep ha <hadu= chiep@googlemail.com> wrote:
=

Dear All,


I am trying to use Barman to back up PostgreSQL, which is running in a Podman container. However, I encounter the error "WAL archive: FAILED," as shown below:

#barman check testdb
Server testdb:
WAL archive: FAILED (please make sure WAL shipping is set up)
PostgreSQL: OK
superuser: OK
PostgreSQL streaming: OK
wal_level: OK
replication slot: OK
directories: OK
retention policy settings: OK
backup maximum age: OK (no last_backup_maximum_age provided)
compression settings: OK
failed backups: OK (there are 0 failed backups)
minimum redundancy requirements: OK (have 0 backups, expected at least 0)
pg_basebackup: OK
pg_basebackup compatible: OK
pg_basebackup supports tablespaces mapping: OK
pg_receivexlog: OK
pg_receivexlog compatible: OK
receive-wal running: OK
archiver errors: OK

I have identified that normally, when the PostgreSQL database is installed on a regular VM (not in a container), the archive_command parameter under postgresql.conf looks like this:

archive_command =3D 'rsyn= c -a %p barman@barman-backup-server-ip:/data/barman/main-db-ser= ver/incoming/%f'

However, when PostgreSQL is installed on a Podman container, I cannot use the above archive_command because within the PostgreSQL container, it doesn't understand rsync, ssh, and the barman user. That's why I have to use a normal copy command like:

=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 archive_command =3D = 'cp -i %p /srv/archive/%f'

I then mounted this wal-files folder on '/data/barman/main-db-server/incoming/%f'. As a result, all these wal_files have the PostgreSQL ownership and not the barman ownership. The barman user has no privileges to change these wal-files, which is why the WAL archive is marked as FAILED.

Do you know how to solve this issue? do I have to install Barman and PostgreSQL in the same Pod container in order to backup=C2=A0 PostgreSQL container= ? Or is there another solution to this problem?

Thank you for your support in advance.

Best,
Ha


> Why would you still need standard archive_command?

You need it only if the streaming secondary servers are offline for a while and cannot stream old WAL files from the primary because the have been deleted there.

Archive shipping can then come to the rescue, so that the standby server can get the missing WAL file from the archive. Subsequently, it will continue to stream directly from the primary.

Regards,

Holger

--=20
Holger Jakobs, Bergisch Gladbach, Tel. +49-178-9759012
--------------NtNM5rt1yD4fCZc6kaupK9HK-- --------------AfKrPElAsMjo8ctSNtOd6DK3-- --------------UQ4bLfF9TlM9GmOwdGTVAXKc Content-Type: application/pgp-signature; name="OpenPGP_signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="OpenPGP_signature" -----BEGIN PGP SIGNATURE----- wmMEABEIACMWIQScuJCxWJK1p5BOebGKV5yTsxlhugUCZaZr5gUDAAAAAAAKCRCKV5yTsxlhuj4g AKDGB2tKVZHOBj4LfmihasbuAbnxFQCgxYWuE2S+FWU/q92rOaADly6KvbQ= =3s8l -----END PGP SIGNATURE----- --------------UQ4bLfF9TlM9GmOwdGTVAXKc--