Content-Type: multipart/alternative;
 boundary="------------2RlHY3j00VqAXn30faEtUHVz"
Message-ID: <c73dc5ff-7b75-9faf-8534-9b214f214734@dunslane.net>
Date: Thu, 7 Dec 2023 08:19:19 -0500
MIME-Version: 1.0
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101
 Thunderbird/102.15.1
Subject: Re: Emitting JSON to file using COPY TO
Content-Language: en-US
To: "David G. Johnston" <david.g.johnston@gmail.com>,
 Joe Conway <mail@joeconway.com>
Cc: Sehrope Sarkuni <sehrope@jackdb.com>, Tom Lane <tgl@sss.pgh.pa.us>,
 Davin Shearer <davin@apache.org>,
 PostgreSQL-development <pgsql-hackers@postgresql.org>
References: <CALvfUkBxTYy5uWPFVwpk_7ii2zgT07t3d-yR_cy4sfrrLU=kcg@mail.gmail.com>
 <CALvfUkAbj4Bwg0FjYpvj0-zddcetWg1Sejt=OGBTDskbqOFS_A@mail.gmail.com>
 <46cc4507-a0d9-4044-b2ce-5a8bca8015c0@joeconway.com>
 <CALvfUkD8+bcNs1cYeU3wK9YsyZ7zUjs2aTxO+++Vq7zKeUE7+w@mail.gmail.com>
 <2554e520-e103-8978-dcb5-807dfeb77402@dunslane.net>
 <cb1f118c-4698-4451-9ba9-dd8595f06c37@joeconway.com>
 <926ff917-8371-40ec-b5e6-ab7b0e09bdc5@joeconway.com>
 <315b81d4-4b67-7828-0355-3808cd14acd1@dunslane.net>
 <7a60faf6-e7f1-419d-aee6-10a78ea2fe81@joeconway.com>
 <2e7ff718-895d-83fc-46f7-be25e23b23b4@dunslane.net>
 <1104915.1701877459@sss.pgh.pa.us>
 <19a5f9d8-bd1f-9e51-0f5b-510c1189a8a7@dunslane.net>
 <CAH7T-aoWF9oHuUC2PJ303YVRFurkLMPayHawZayqdhtT2fpEHg@mail.gmail.com>
 <4d5688f4-9582-4093-8448-e1867bc9e2bc@joeconway.com>
 <CAH7T-aow6jM-v1K462O7N=doOZxSD79zsH6prDCft7wv91F48A@mail.gmail.com>
 <4ad29199-361f-4740-a919-12080ad5ed65@joeconway.com>
 <CAKFQuwaw+n=FBLUXs-jPQbcrvN9Bmgu6eTM-q+GpnHpKBDUsJg@mail.gmail.com>
From: Andrew Dunstan <andrew@dunslane.net>
In-Reply-To: <CAKFQuwaw+n=FBLUXs-jPQbcrvN9Bmgu6eTM-q+GpnHpKBDUsJg@mail.gmail.com>
Archived-At: <https://www.postgresql.org/message-id/c73dc5ff-7b75-9faf-8534-9b214f214734%40dunslane.net>
Precedence: bulk

This is a multi-part message in MIME format.
--------------2RlHY3j00VqAXn30faEtUHVz
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit


On 2023-12-06 We 17:56, David G. Johnston wrote:
> On Wed, Dec 6, 2023 at 3:38 PM Joe Conway <mail@joeconway.com> wrote:
>
>     So the questions are:
>     1. Do those two formats work for the initial implementation?
>
>
> Yes.  We provide a stream-oriented format and one atomic-import format.
>
>     2. Is the default correct or should it be switched
>         e.g. rather than specifying FORCE_ARRAY to get an
>         array, something like FORCE_NO_ARRAY to get JSON lines
>         and the JSON array is default?
>
>
> No default?
>
> Require explicit of a sub-format when the main format is JSON.
>
> JSON_OBJECT_ROWS
> JSON_ARRAY_OF_OBJECTS
>
> For a future compact array-structured-composites sub-format:
> JSON_ARRAY_OF_ARRAYS
> JSON_ARRAY_ROWS
>
>

No default seems unlike the way we treat other COPY options. I'm not 
terribly fussed about which format to have as the default, but I think 
we should have one.


cheers


andrew

--
Andrew Dunstan
EDB:https://www.enterprisedb.com

--------------2RlHY3j00VqAXn30faEtUHVz
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: 8bit

<html>
  <head>
    <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
  </head>
  <body>
    <p><br>
    </p>
    <div class="moz-cite-prefix">On 2023-12-06 We 17:56, David G.
      Johnston wrote:<br>
    </div>
    <blockquote type="cite"
cite="mid:CAKFQuwaw+n=FBLUXs-jPQbcrvN9Bmgu6eTM-q+GpnHpKBDUsJg@mail.gmail.com">
      <meta http-equiv="content-type" content="text/html; charset=UTF-8">
      <div dir="ltr">
        <div dir="ltr">
          <div class="gmail_default"
            style="font-family:arial,helvetica,sans-serif"><span
              style="font-family:Arial,Helvetica,sans-serif">On Wed, Dec
              6, 2023 at 3:38 PM Joe Conway &lt;<a
                href="mailto:mail@joeconway.com" moz-do-not-send="true"
                class="moz-txt-link-freetext">mail@joeconway.com</a>&gt;
              wrote:</span><br>
          </div>
        </div>
        <div class="gmail_quote">
          <blockquote class="gmail_quote" style="margin:0px 0px 0px
            0.8ex;border-left:1px solid
            rgb(204,204,204);padding-left:1ex">So the questions are:<br>
            1. Do those two formats work for the initial implementation?<br>
          </blockquote>
          <div><br>
          </div>
          <div>
            <div class="gmail_default"
              style="font-family:arial,helvetica,sans-serif">Yes.  We
              provide a stream-oriented format and one atomic-import
              format.</div>
          </div>
          <div><br>
          </div>
          <blockquote class="gmail_quote" style="margin:0px 0px 0px
            0.8ex;border-left:1px solid
            rgb(204,204,204);padding-left:1ex">
            2. Is the default correct or should it be switched<br>
                e.g. rather than specifying FORCE_ARRAY to get an<br>
                array, something like FORCE_NO_ARRAY to get JSON lines<br>
                and the JSON array is default?<br>
            <br>
          </blockquote>
          <div><br>
          </div>
          <div class="gmail_default"
            style="font-family:arial,helvetica,sans-serif">No default?</div>
          <div class="gmail_default"
            style="font-family:arial,helvetica,sans-serif"><br>
          </div>
          <div class="gmail_default"
            style="font-family:arial,helvetica,sans-serif">Require
            explicit of a sub-format when the main format is JSON.</div>
          <div class="gmail_default"
            style="font-family:arial,helvetica,sans-serif"><br>
          </div>
          <div class="gmail_default"
            style="font-family:arial,helvetica,sans-serif">JSON_OBJECT_ROWS</div>
          <div class="gmail_default"
            style="font-family:arial,helvetica,sans-serif">JSON_ARRAY_OF_OBJECTS</div>
          <div class="gmail_default"
            style="font-family:arial,helvetica,sans-serif"><br>
          </div>
          <div class="gmail_default"
            style="font-family:arial,helvetica,sans-serif">For a future
            compact array-structured-composites sub-format:</div>
          <div class="gmail_default"
            style="font-family:arial,helvetica,sans-serif">JSON_ARRAY_OF_ARRAYS</div>
          <div class="gmail_default"
            style="font-family:arial,helvetica,sans-serif">JSON_ARRAY_ROWS</div>
          <div class="gmail_default"
            style="font-family:arial,helvetica,sans-serif"><br>
          </div>
          <div class="gmail_default"
            style="font-family:arial,helvetica,sans-serif"><br>
          </div>
        </div>
      </div>
    </blockquote>
    <p><br>
    </p>
    <p>No default seems unlike the way we treat other COPY options. I'm
      not terribly fussed about which format to have as the default, but
      I think we should have one. <br>
    </p>
    <p><br>
    </p>
    <p>cheers</p>
    <p><br>
    </p>
    <p>andrew<br>
    </p>
    <pre class="moz-signature" signature-switch-id="d0437855-2267-4610-80b3-83167ec45b0b" cols="72">--
Andrew Dunstan
EDB: <a class="moz-txt-link-freetext" href="https://www.enterprisedb.com">https://www.enterprisedb.com</a>
</pre>
  </body>
</html>

--------------2RlHY3j00VqAXn30faEtUHVz--