MIME-Version: 1.0
References: <CALvfUkBxTYy5uWPFVwpk_7ii2zgT07t3d-yR_cy4sfrrLU=kcg@mail.gmail.com>
 <fc1e39f8-274f-4be6-8a70-9fb0d9fe84a2@aklaver.com> <CAFCRh-_LhP5Ln4-beVz=1pQ9VycU3hAxnJHXhPHZRmX0BSCVEQ@mail.gmail.com>
 <CAFCRh--Vhx0105S7SWAYHGcVMTSRtbcoArDUGSbYSWRUGunW_g@mail.gmail.com>
 <CAKFQuwZb3zaSqkOvGXRRLZEW61az+4xyHZ7tBPR91JfrcdCKvA@mail.gmail.com>
 <3853387.1701096982@sss.pgh.pa.us> <CAFCRh-_GdiUvjd5z5FfvTfhruOnYqBu163XU47zZE8RNATCJGQ@mail.gmail.com>
 <3a98decf-3fe3-4b49-9b68-fda01338872c@sedlakovi.org> <CALvfUkCq3pvkmniWEKZwkbA6hNNvkANF3OamMfhC170RgY+HJg@mail.gmail.com>
 <24e3ee88-ec1e-421b-89ae-8a47ee0d2df1@joeconway.com> <b22367ef-6ac1-e1c0-da05-0e760e1b7e29@dunslane.net>
 <CALvfUkD9ZFUU2pe9RMPqdGaKXu5OZi5xzOiPokGhOoPJ56FgAw@mail.gmail.com> <7117a356-916c-4cf3-bad8-861490e65dcf@joeconway.com>
In-Reply-To: <7117a356-916c-4cf3-bad8-861490e65dcf@joeconway.com>
From: Davin Shearer <davin@apache.org>
Date: Sun, 3 Dec 2023 17:38:28 -0500
Message-ID: <CALvfUkBKTr9WLAbHQYmwZ7SVp5_VDey1F1uCZtKL4+H1-WvyBw@mail.gmail.com>
Subject: Re: Emitting JSON to file using COPY TO
To: Joe Conway <mail@joeconway.com>, 
	PostgreSQL-development <pgsql-hackers@postgresql.org>, Andrew Dunstan <andrew@dunslane.net>
Content-Type: multipart/alternative; boundary="000000000000b22d6c060ba2a9af"
Archived-At: <https://www.postgresql.org/message-id/CALvfUkBKTr9WLAbHQYmwZ7SVp5_VDey1F1uCZtKL4%2BH1-WvyBw%40mail.gmail.com>
Precedence: bulk

--000000000000b22d6c060ba2a9af
Content-Type: text/plain; charset="UTF-8"

" being quoted as \\" breaks the JSON. It needs to be \".  This has been my
whole problem with COPY TO for JSON.

Please validate that the output is in proper format with correct quoting
for special characters. I use `jq` on the command line to validate and
format the output.

On Sun, Dec 3, 2023, 10:51 Joe Conway <mail@joeconway.com> wrote:

> On 12/3/23 10:31, Davin Shearer wrote:
> > Please be sure to include single and double quotes in the test values
> > since that was the original problem (double quoting in COPY TO breaking
> > the JSON syntax).
>
> test=# copy (select * from foo limit 4) to stdout (format json);
> {"id":2456092,"f1":"line with ' in it:
> 2456092","f2":"2023-12-03T10:44:40.9712-05:00"}
> {"id":2456093,"f1":"line with \\" in it:
> 2456093","f2":"2023-12-03T10:44:40.971221-05:00"}
> {"id":2456094,"f1":"line with ' in it:
> 2456094","f2":"2023-12-03T10:44:40.971225-05:00"}
> {"id":2456095,"f1":"line with \\" in it:
> 2456095","f2":"2023-12-03T10:44:40.971228-05:00"}
>
> --
> Joe Conway
> PostgreSQL Contributors Team
> RDS Open Source Databases
> Amazon Web Services: https://aws.amazon.com
>
>

--000000000000b22d6c060ba2a9af
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"auto">&quot; being quoted as \\&quot; breaks the JSON. It needs=
 to be \&quot;.=C2=A0 This has been my whole problem with COPY TO for JSON.=
<div dir=3D"auto"><br></div><div dir=3D"auto">Please validate that the outp=
ut is in proper format with correct quoting for special characters. I use `=
jq` on the command line to validate and format the output.=C2=A0</div></div=
><br><div class=3D"gmail_quote"><div dir=3D"ltr" class=3D"gmail_attr">On Su=
n, Dec 3, 2023, 10:51 Joe Conway &lt;<a href=3D"mailto:mail@joeconway.com">=
mail@joeconway.com</a>&gt; wrote:<br></div><blockquote class=3D"gmail_quote=
" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">O=
n 12/3/23 10:31, Davin Shearer wrote:<br>
&gt; Please be sure to include single and double quotes in the test values =
<br>
&gt; since that was the original problem (double quoting in COPY TO breakin=
g <br>
&gt; the JSON syntax).<br>
<br>
test=3D# copy (select * from foo limit 4) to stdout (format json);<br>
{&quot;id&quot;:2456092,&quot;f1&quot;:&quot;line with &#39; in it: <br>
2456092&quot;,&quot;f2&quot;:&quot;2023-12-03T10:44:40.9712-05:00&quot;}<br=
>
{&quot;id&quot;:2456093,&quot;f1&quot;:&quot;line with \\&quot; in it: <br>
2456093&quot;,&quot;f2&quot;:&quot;2023-12-03T10:44:40.971221-05:00&quot;}<=
br>
{&quot;id&quot;:2456094,&quot;f1&quot;:&quot;line with &#39; in it: <br>
2456094&quot;,&quot;f2&quot;:&quot;2023-12-03T10:44:40.971225-05:00&quot;}<=
br>
{&quot;id&quot;:2456095,&quot;f1&quot;:&quot;line with \\&quot; in it: <br>
2456095&quot;,&quot;f2&quot;:&quot;2023-12-03T10:44:40.971228-05:00&quot;}<=
br>
<br>
-- <br>
Joe Conway<br>
PostgreSQL Contributors Team<br>
RDS Open Source Databases<br>
Amazon Web Services: <a href=3D"https://aws.amazon.com" rel=3D"noreferrer n=
oreferrer" target=3D"_blank">https://aws.amazon.com</a><br>
<br>
</blockquote></div>

--000000000000b22d6c060ba2a9af--