MIME-Version: 1.0
In-Reply-To: 
 <CAKFQuwbjwyaaFUOEzxoYCBDm25ujOayCniwiWimPML_A_VaGYA@mail.gmail.com>
References: 
 <CA+ssMORBYVFxedSXVVxL5VPeo=9AbYRQ-zbpuKJm6vEjmJ1CFA@mail.gmail.com>
 <CAKFQuwbjwyaaFUOEzxoYCBDm25ujOayCniwiWimPML_A_VaGYA@mail.gmail.com>
From: Nicolas Paris <niparisco@gmail.com>
Date: Tue, 7 Jun 2016 14:36:46 +0200
Message-ID: 
 <CA+ssMOT04Wg+OGfSc5AUk8nVQOxkVS6=CD-h7bH-pAH-ix50cw@mail.gmail.com>
Subject: Re: array size exceeds the maximum allowed (1073741823)
 when building a json
To: "David G. Johnston" <david.g.johnston@gmail.com>
Cc: pgsql-performance <pgsql-performance@postgresql.org>
Content-Type: multipart/alternative; boundary=001a114420243bb33c0534af71b1
Precedence: bulk
Sender: pgsql-performance-owner@postgresql.org

--001a114420243bb33c0534af71b1
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

2016-06-07 14:31 GMT+02:00 David G. Johnston <david.g.johnston@gmail.com>:

> On Tue, Jun 7, 2016 at 7:44 AM, Nicolas Paris <niparisco@gmail.com> wrote=
:
>
>> Hello,
>>
>> I run a query transforming huge tables to a json document based on a per=
iod.
>> It works great for a modest period (little dataset).
>> However, when increasing the period (huge dataset) I get this error:
>>
>> SQL ERROR[54000]
>> ERROR: array size exceeds the maximum allowed (1073741823)
>>
>> =E2=80=8Bhttps://www.postgresql.org/about/=E2=80=8B
>
> =E2=80=8BMaximum Field Size: 1 GB=E2=80=8B
>

It means a json cannot exceed 1GB in postgresql, right ?
Then I must build it with an external tool ?
=E2=80=8B


>
> =E2=80=8BIt doesn't matter that the data never actually is placed into a =
physical
> table.
>
> David J.
>
>

--001a114420243bb33c0534af71b1
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div class=3D"gmail_extra">2016-06-07 14:31 GMT+02:00 Davi=
d G. Johnston <span dir=3D"ltr">&lt;<a href=3D"mailto:david.g.johnston@gmai=
l.com" target=3D"_blank">david.g.johnston@gmail.com</a>&gt;</span>:<br><div=
 class=3D"gmail_quote"><blockquote class=3D"gmail_quote" style=3D"margin:0 =
0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir=3D"ltr"><spa=
n class=3D""><div style=3D"font-family:arial,helvetica,sans-serif"><span st=
yle=3D"font-family:arial,sans-serif">On Tue, Jun 7, 2016 at 7:44 AM, Nicola=
s Paris </span><span dir=3D"ltr" style=3D"font-family:arial,sans-serif">&lt=
;<a href=3D"mailto:niparisco@gmail.com" target=3D"_blank">niparisco@gmail.c=
om</a>&gt;</span><span style=3D"font-family:arial,sans-serif"> wrote:</span=
><br></div></span><div class=3D"gmail_extra"><div class=3D"gmail_quote"><sp=
an class=3D""><blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px=
 0.8ex;border-left-width:1px;border-left-style:solid;border-left-color:rgb(=
204,204,204);padding-left:1ex"><div dir=3D"ltr"><div style=3D"font-family:t=
ahoma,sans-serif;color:rgb(0,51,51)"><pre><code>Hello,<br><br>I run a query=
 transforming huge tables to a json document based on a period.<br>It works=
 great for a modest period (little dataset). <br>However, when increasing t=
he period (huge dataset) I get this error:<br></code></pre><pre><code>SQL E=
RROR</code><code><code>[54000]<br></code>ERROR: array size exceeds the maxi=
mum allowed (1073741823)<br><br></code></pre></div></div></blockquote></spa=
n><div><div style=3D"font-family:arial,helvetica,sans-serif">=E2=80=8B<a hr=
ef=3D"https://www.postgresql.org/about/" target=3D"_blank">https://www.post=
gresql.org/about/</a>=E2=80=8B<br></div></div><div><br></div><div><div styl=
e=3D"font-family:arial,helvetica,sans-serif">=E2=80=8BMaximum Field Size: 1=
 GB=E2=80=8B</div></div></div></div></div></blockquote><div><br><div class=
=3D"gmail_default" style=3D"font-family:tahoma,sans-serif;color:rgb(0,51,51=
);display:inline">It means a json cannot exceed 1GB in postgresql, right ?<=
br></div><div class=3D"gmail_default" style=3D"font-family:tahoma,sans-seri=
f;color:rgb(0,51,51);display:inline">Then I must build it with an external =
tool ?<br></div><div class=3D"gmail_default" style=3D"font-family:tahoma,sa=
ns-serif;color:rgb(0,51,51);display:inline">=E2=80=8B</div>=C2=A0</div><blo=
ckquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #c=
cc solid;padding-left:1ex"><div dir=3D"ltr"><div class=3D"gmail_extra"><br>=
</div><div class=3D"gmail_extra"><div style=3D"font-family:arial,helvetica,=
sans-serif">=E2=80=8BIt doesn&#39;t matter that the data never actually is =
placed into a physical table.</div><div style=3D"font-family:arial,helvetic=
a,sans-serif"><br></div><div style=3D"font-family:arial,helvetica,sans-seri=
f">David J.</div><div style=3D"font-family:arial,helvetica,sans-serif"><br>=
</div></div></div>
</blockquote></div><br></div></div>

--001a114420243bb33c0534af71b1--