Subject: Re: Storing large large JSON objects in JSONB
To: Thomas Kellerer <shammat@gmx.net>, pgsql-admin@lists.postgresql.org
Cc: Wells Oliver <wells.oliver@gmail.com>
References: 
 <CAOC+FBWRavHQWtQRJ_suSRjtDR9PrnDeRm9CWojr2ogYgDA7Ww@mail.gmail.com>
 <16681dbd-639c-0d38-d3ee-28c808c05a4d@gmx.net>
 <CAOC+FBUT7YSGWV3KR29fASRMCBDXvFXSwTsnTS_=z=8ZKf+eVQ@mail.gmail.com>
 <b193cc6f-6883-b5ea-40a5-7cfd20b299ae@gmx.net>
From: Aleksey M Boltenkov <padrebolt@yandex.ru>
Message-ID: <e2ddde5e-8fb1-0d1c-d0f8-6b9e632ec7d4@yandex.ru>
Date: Tue, 12 Jul 2022 09:02:42 +0300
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101
 Firefox/52.0 Thunderbird/52.9.1
MIME-Version: 1.0
In-Reply-To: <b193cc6f-6883-b5ea-40a5-7cfd20b299ae@gmx.net>
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 8bit
Content-Language: en-US
Archived-At: 
 <https://www.postgresql.org/message-id/e2ddde5e-8fb1-0d1c-d0f8-6b9e632ec7d4%40yandex.ru>
Precedence: bulk

On 07/11/22 20:49, Thomas Kellerer wrote:
>
> Wells Oliver schrieb am 11.07.2022 um 18:25:
>>> On Mon, Jul 11, 2022 at 5:11 AM Thomas Kellerer <shammat@gmx.net 
>>> <mailto:shammat@gmx.net>> wrote:
>>>
>>>     Wells Oliver schrieb am 09.07.2022 um 21:37:
>>>      > We have a couple of tables where we like to store very large 
>>> JSON
>>>      > objects in a JSONB column.
>>>     Note, that the upper limit for a single jsonb value is 255MB
>>>     Not 1GB as it is e.g. the case for text or json.
>
>> What exactly does that mean? The upper limit at which TOAST is used
>> for storage, or what? We certainly have objects larger than 256MB in
>> JSONB columns.
> Hmm, that's strange, because when I try to create a JSONB value that is
> larger than 256MB I get the following error:
>
>    ERROR: total size of jsonb object elements exceeds the maximum of 
> 268435455 bytes
>
> Are you sure you are using jsonb, not json maybe?
> To my knowledge the json data type does not have this limit.
>
>
>
>
Wow! We are using citus for storing likely objects. 256MB. My opinion is 
you are doing something wrong.