Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.96) (envelope-from ) id 1w8pUK-000vE4-1B for pgsql-hackers@arkaria.postgresql.org; Sat, 04 Apr 2026 01:07:48 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.96) (envelope-from ) id 1w8pUJ-00EsSH-0M for pgsql-hackers@arkaria.postgresql.org; Sat, 04 Apr 2026 01:07:47 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.96) (envelope-from ) id 1w8pUI-00EsS8-2J for pgsql-hackers@lists.postgresql.org; Sat, 04 Apr 2026 01:07:47 +0000 Received: from mail-dy1-x1335.google.com ([2607:f8b0:4864:20::1335]) by magus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.98.2) (envelope-from ) id 1w8pUG-00000000TOq-2LEy for pgsql-hackers@lists.postgresql.org; Sat, 04 Apr 2026 01:07:46 +0000 Received: by mail-dy1-x1335.google.com with SMTP id 5a478bee46e88-2bd801b40dbso215614eec.0 for ; Fri, 03 Apr 2026 18:07:44 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1775264862; cv=none; d=google.com; s=arc-20240605; b=DVbopYQ3pueIR6i0ZkElEPGEWhFjc+V8TCqTT9q1YKP/QV8M8Z17k5gmt+CcnOy2W+ 2Ei/61efFKPfkG2XCeAYnD/09BLSLYECe0bgUn+LklLKgIrmJr663eicX9JzcOUpfp+u 422dRg/eUDb+oZeoPmu7eu2KTTp5krNwC7iMw5Ai0WwsZ3cFtqwzv/n3MRfcurFVkIkS wbmCx3eD/C4Y0f4n57PA/9NVHUTABVpMqV+fcQoZAXPjIe+pwSo3LYZ1HP8adQ0of0BW 2oa/zWvI+BUIYj4D/WFhOQ11XKU29utquOqIAk2doacvUrPN252z30juQFHBJ9T8A6CR TYgQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:dkim-signature; bh=J+NymTI6NRGO9fUlNpOoCKmMI6JfrpLF8UKX/7aLIT8=; fh=sslTxWjRvlnDZdx/nIrDeyHB1CzC7sbMims7xN0UCjo=; b=ddgi0JyH0OoM9CNAGW7aFU4ruQ/5Ab1DIg34XTnKJjlhoD5iw2ImgHt+TQQV3i0gF5 2veIYQZI6MfvRwI1vWlgcdP4eEf2KQq0x2Bo8HvwOkeycqqzUCAYIPWT4Bk4jZHfbEYF ajwS7m7wY6hf3ZzFyrZXBhp/5tYY6iJ4XUMrJebdaO+Ap0OL6LS8BPS6dG+4wZcs7i7r 9Za13rWSupR5+2+CXU4v1Gml3JSnbb0PQ0n6wnGQudyHCXIFpZIuFmnhX7f1UBqrjawV vQ3UflZTTNMZGeAymdMlY8Ivbzo1wmxEdwUnmRN06G/jIYmwBxs90K/no43eueuncyfw dKng==; darn=lists.postgresql.org ARC-Authentication-Results: i=1; mx.google.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20251104; t=1775264862; x=1775869662; darn=lists.postgresql.org; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=J+NymTI6NRGO9fUlNpOoCKmMI6JfrpLF8UKX/7aLIT8=; b=W216FC8D/3EIGp/zkkzf8x3WSdeGQnYUDj7R0WvAKK4+HJdOUGvzkJm2JpGGNexcTZ 91wiJ7noUwLZNv9duNYefxLSvLPKrYvEZ/QV56GhxWKl0DbLGxvc2meQ+jXMvAjMpokc iEGGX8cKv4aL9TRfVm+wCn+GUnVRenF2rKV6AW6utyAVHv6QxmY/XDpP6hnGqcvBvegx g0m/BRmtrXUTWhX574dbU4XYl1B15wu5tLlEfCbtK7N7UhkQJEqQsMgRkvr6q/7LDu7V w71kF+/XXf8vW0gSaZehhhC69PB7qE8RBzyfkEWtr3h+ALbJ1/PhTeQujyB34gbOoWTa PKKA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1775264862; x=1775869662; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-gg:x-gm-message-state:from :to:cc:subject:date:message-id:reply-to; bh=J+NymTI6NRGO9fUlNpOoCKmMI6JfrpLF8UKX/7aLIT8=; b=FEbvnrq62i5QwDBDU2MtxBG/65zJO9laXvJ5i6oSq35cpdJgg6ahbxSkhNpREShfAX PHKxTckcXBg8kF/8n/VUoV79CtcVXS3WZTtdH86GPu5r7NnsZnOn3u+rhV9s0eE30O6A jUceq5bujoAaHbtrLZjzYHjTykIaXYqwpTqGVBzv5oHGJiC5EDQmjaBEiSIOkrf3IxRs 2E+fPOtf+ubn9RgrT4rgpyQxcv+FJPurwfWqUZH4MKuYk/Pccrxgzsl+l//Ruhe0fjk9 HcdfNpjAAGHPbgXQqFHGIS6+0CqQajepzB2fM3n5uPR3Rk4Xg8Soz3KVyQHJp9mg0jCc 8Gbw== X-Forwarded-Encrypted: i=1; AJvYcCUKY+M8ve1NJLdbBK4jOYIB7t/4ebk8qBN/cDhOeZhwZfz5gNVIGprLQ8TodAjJSQB+XSLFxiYnXOSy3ZCe@lists.postgresql.org X-Gm-Message-State: AOJu0YxXoeY1tYdwhJ1ixDJGc8bYV1neCvFzr6jKZWPx7mfqw19iBkyB wGeKnbTjQCHbpbj3oxmDcrDKMwp3xSJOm1+6Q0uAet8NC6tVMRAxHbaNl9BhnGp5hZUArmf5W8O KH/pKpTUtb5i+4aknLUgCluTxQDcJATE= X-Gm-Gg: AeBDieueY6jOGwzSCkNZKLo0UfKLu0tDdPQeglZhuZYGp0jCX7I6mTlnu+VFAAAM0o4 CQn3WgeEMP1XI5ywas+i8IB2MVOSG17CNRcE59zhm1f4F47AH45Qyv2MUcMjyvS67KcsMecL4cL v7zsLpWwSq1xrzw61H58dgZUYAP9WivFHVnEFxDUJtAZ1nns5iUILpaiHJLYxZhYooNybnpd5mn t5EcX3IrpA8Cf31BZn8xXpLyXXtGbk0EI06J3tG8TWDUUNZ6SHfZ9wP1sD7LZ7h/BLLv9CvflU/ nZIjTAPjgrT4PgMeMLZttRYrkyoTMzr6fW4Y07ammcYAyYPEwRKNzNP+N8etXJMq X-Received: by 2002:a05:7300:4347:b0:2c0:c961:4b98 with SMTP id 5a478bee46e88-2cbfc85e0eemr1049543eec.7.1775264861617; Fri, 03 Apr 2026 18:07:41 -0700 (PDT) MIME-Version: 1.0 References: <2250061.1774104346@sss.pgh.pa.us> <3341199.1774221191@sss.pgh.pa.us> <3424809.1774234940@sss.pgh.pa.us> <1624716.1774736283@sss.pgh.pa.us> <1626907.1774737417@sss.pgh.pa.us> <97a382c0-1f19-4ea0-951f-e37e6abc34a3@vondra.me> <1630755.1774739531@sss.pgh.pa.us> <1873141.1774823011@sss.pgh.pa.us> <3049460.1775067940@sss.pgh.pa.us> <3118179.1775092964@sss.pgh.pa.us> <3565835.1775147392@sss.pgh.pa.us> <3579709.1775151816@sss.pgh.pa.us> <63de1553-829a-488d-8ee0-976afb8dd32c@vondra.me> <3586483.1775155672@sss.pgh.pa.us> In-Reply-To: From: Thomas Munro Date: Sat, 4 Apr 2026 14:07:04 +1300 X-Gm-Features: AQROBzDlcVfVpODjpXSpCeXs-bb9LtoiMw_Ub3ksbRIbkb9uGaT2LuFPDS7lS0s Message-ID: Subject: Re: pg_waldump: support decoding of WAL inside tarfile To: Nazir Bilal Yavuz Cc: Sami Imseih , Tom Lane , Tomas Vondra , Andres Freund , Michael Paquier , Andrew Dunstan , Amul Sul , Zsolt Parragi , Robert Haas , Chao Li , Anthonin Bonnefoy , Fujii Masao , Jakub Wartak , PostgreSQL Hackers Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk On Sat, Apr 4, 2026 at 4:30=E2=80=AFAM Nazir Bilal Yavuz wrote: > On Fri, 3 Apr 2026 at 17:59, Sami Imseih wrote: > > > On Sat, Apr 4, 2026 at 12:38=E2=80=AFAM Nazir Bilal Yavuz wrote: > > > > I also tried Thomas' > > > > "v2-0001-Improve-tar-portability-logic-from-ebba64c0" [3] but it > > > > didn't fix the problem on OpenBSD [4]. > > > > > > Apparently it wants -F ustar, like this. Funny that it passed on the > > > build farm animals though. Oh, it looks like they changed the defaul= t > > > fairly recently. > > > > LGTM with just a correction of my earlier comment. > > Thanks for the patches! I confirm that both v3 and v4 fix the problem > for OpenBSD CI. Pushed, after testing on an OpenBSD VM and making some corrections: * I'd screwed up the test command line in a way that worked by coincidence ** OpenBSD tar writes to a tape device by default, so use -f /dev/null ** I'd forgotten =3D=3D 0, so the result was inverted, hiding that screwup * -f /dev/null is a better form for all of them because the default destination is a build option * needed elsif instead of if, or BSD tar finished up getting both --format=3Dustar and -F ustar * ran perltidy, keeping only the hunks due to this patch CI passes and shows "212 subtests passed" for all five Unixen + Windows/mingw, but only "156 subtests passed" for Windows/MSVC. .cirrus.tasks.yml appears to use the same $TAR for both, namely the system tar, so I think we can say that *this* thing is working, but something else might be wrong with our scripting glue somewhere? The other OSes on our list are AIX and Solaris. From a quick look at their manuals, I don't foresee issues with pax or large UIDs. Hopefully that covers everything!