Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1pvpNl-0006cc-O0 for pgsql-hackers@arkaria.postgresql.org; Mon, 08 May 2023 01:09:41 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1pvpNk-0005d7-H5 for pgsql-hackers@arkaria.postgresql.org; Mon, 08 May 2023 01:09:40 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1pvpNk-0005cx-8X for pgsql-hackers@lists.postgresql.org; Mon, 08 May 2023 01:09:40 +0000 Received: from sss.pgh.pa.us ([66.207.139.130]) by magus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1pvpNc-001Gi1-Tp for pgsql-hackers@lists.postgresql.org; Mon, 08 May 2023 01:09:39 +0000 Received: from sss1.sss.pgh.pa.us (localhost [127.0.0.1]) by sss.pgh.pa.us (8.15.2/8.15.2) with ESMTP id 34819P55219663; Sun, 7 May 2023 21:09:25 -0400 From: Tom Lane To: Michael Paquier cc: gkokolatos@pm.me, Andrew Dunstan , Alexander Lakhin , Tomas Vondra , Justin Pryzby , shiy.fnst@fujitsu.com, pgsql-hackers@lists.postgresql.org, Rachel Heaton Subject: Re: Add LZ4 compression in pg_dump In-reply-to: References: <7zu6GYFi72jByVk2SEe_nd8r1DHhwA35vSntAE9sAfiMX9Lfk6bwimkwmu7GDgYaEvL27SE4qF1uK4_LHWQM4H-SXOwkMAI-GV8PKGmED_E=@pm.me> <32ba9612-1982-4b2d-135a-5d1222987082@enterprisedb.com> <3beb0dd7-c927-3eca-689f-716e255d5b27@enterprisedb.com> <94ae9bca-5ebb-1e68-bb7b-4f32e89fefbe@gmail.com> <71868915-0345-1b7b-f3d6-ec66547c662a@dunslane.net> Comments: In-reply-to Michael Paquier message dated "Mon, 08 May 2023 09:31:06 +0900" MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-ID: <219661.1683508165.1@sss.pgh.pa.us> Content-Transfer-Encoding: quoted-printable Date: Sun, 07 May 2023 21:09:25 -0400 Message-ID: <219662.1683508165@sss.pgh.pa.us> List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk Michael Paquier writes: > While testing this patch, I have triggered an error pointing out that > the decompression path of LZ4 is broken for table data. I can > reproduce that with a dump of the regression database, as of: > make installcheck > pg_dump --format=3Dd --file=3Ddump_lz4 --compress=3Dlz4 regression > createdb regress_lz4 > pg_restore --format=3Dd -d regress_lz4 dump_lz4 > pg_restore: error: COPY failed for table "clstr_tst": ERROR: extra data= after last expected column > CONTEXT: COPY clstr_tst, line 15: "32 6 seis xyzzyxyzzyxyzzyxyzzyxyzzyx= yzzyxyzzyxyzzyxyzzyxyzzyxyzzyxyzzyxyzzyxyzzyxyzzyxyzzyxyzzyxyzzy..." > pg_restore: warning: errors ignored on restore: 1 Ugh. Reproduced here ... so we need an open item for this. regards, tom lane