Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1oAxXZ-0003s3-R8 for pgsql-admin@arkaria.postgresql.org; Mon, 11 Jul 2022 17:49:49 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1oAxXY-0004hf-Mj for pgsql-admin@arkaria.postgresql.org; Mon, 11 Jul 2022 17:49:48 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1oAxXY-0004hQ-Bi for pgsql-admin@lists.postgresql.org; Mon, 11 Jul 2022 17:49:48 +0000 Received: from mout.gmx.net ([212.227.15.19]) by magus.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1oAxXW-0008IT-9D for pgsql-admin@lists.postgresql.org; Mon, 11 Jul 2022 17:49:47 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.net; s=badeba3b8450; t=1657561784; bh=InJtmqxMz+KhlHtptS+HtIs46J7q9PM0nbi8qquHhQI=; h=X-UI-Sender-Class:Subject:To:Cc:References:From:Date:In-Reply-To; b=aGR5kyoPSZGXcM2ZEF1cSuczoI4CQFQochXj5hhNjMVfQIouw8tFeLU8FoyIqQ8Z7 X5yW40dkv/L+POCfEUFzb828PHJ44K8dNh+Wxb0NHk40i3JhJ/wC9Q4m6BwLlSnUGA ZyWArR5CPQi26U/CSS+oeyqVd8AzAmhmowfcs7cE= X-UI-Sender-Class: 01bb95c1-4bf8-414a-932a-4f6e2808ef9c Received: from [192.168.178.20] ([83.171.160.91]) by mail.gmx.net (mrgmx004 [212.227.17.190]) with ESMTPSA (Nemesis) id 1N3bWr-1nTotv1iDL-010d6v; Mon, 11 Jul 2022 19:49:44 +0200 Subject: Re: Storing large large JSON objects in JSONB To: pgsql-admin@lists.postgresql.org Cc: Wells Oliver References: <16681dbd-639c-0d38-d3ee-28c808c05a4d@gmx.net> From: Thomas Kellerer Message-ID: Date: Mon, 11 Jul 2022 19:49:43 +0200 User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.1.21) Gecko/20090302 Thunderbird/2.0.0.21 Mnenhy/0.7.5.666 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: de-DE Content-Transfer-Encoding: quoted-printable X-Provags-ID: V03:K1:bLjTuZVqDLlqO9uXjxA8D8YEg/IxyQ/Ijf0mqPQpWAf8s6ba1q4 2MMKVRrcpb/5JydDPeHlFL6cn4/qz2+eYZha4G/Bjdi3rtqZWgXpuz77tYtEddT8Mf7ywW5 CbKHB7PCZovNjnXZfS+9DSLosLvyFLge05QibWwqoj/xDou5iUrRJSxb0zvzyuReM/nn5fz 4Wv2TNQ9P2128N1GiXfIQ== X-Spam-Flag: NO X-UI-Out-Filterresults: notjunk:1;V03:K0:CE1nmMRPFII=:y/m0CwPuahPsxbvm9iQW+y pPAN3Hs7Nuu8e/3UxNe1UnQSUUJr9a1HpzPVDL3wqWLuC0S/wrPCdlkpQXWyRSDoWYTslZ3Lz 5XO8cf3Ume8MeJAtc+WvjTbRepE+DH1FIbpN0lZDkxNfCYISR/85xMWBETvRbllBHPE6QI3lx hsjHDcmw8sQojfyZBObcEqfWB4TkTFJ8S93yO11ziiWilvwdNcRnbJ7bINPcO5UB3wHEsd1j9 JZP9Ip0DJrFpLuxpe9Dd/aipk53xre7TKO/3mV9QGmwm+RTtVrs/7fnENF8oDBZKiLjy9rm9r LmT6Nx/IFrYmGjfK8OIhr/F8cLSBKzW4RkdN8e0+GM/p3I8LM1xF5b7jVbtHayDaz7EPSRzL2 bqpw4ZmocFyb2wHVazh9wOj3LEAe2Colt+Y5ZsrMsMbTyEHMRXivFxLc8oKDh9mrGWYxPwrw9 dlMPlgj/Xm+ZceTYOY675otmHOIJlU8NoQAyNV0/PxAdGUBGb3mXQvUG7uVgZRJII33/nvQWH w8b94pxBK52UsknpAtHhHRNlL+5Kr5dv8vKYJRpM8FE+AA/k/GgI0CFAr4WqdbUypQPNOpdEr ysJyxVfy45KDsp7VmBYnOll+HfwjjV3raRTYzPPwCH3HCrBghLjgaucfaMMUrUDc0TPsuG9i2 coZDp6n7YU3qsUjWPMpWzwyQr8phtPnNVT6bbDbQrclNAgzZNgTwyQzwjCDkhnsNf+h2PWX+1 vCt+sMov6iWCWh/GCSxEVuwmpqeQjIyErELF2x8aGLz7mKteygkAIqmZCVV670sKw3mhxHLyo KROUTO4U6mubha/2LKEEXK/mfZfwRQqEtpocazZbgFYn18zr1wmjU4NzarWSOoB88aWtM87AR h6EqKUZCDk9mWwzDEJuGrnqoHabN/9SsrAawfGlxeU/SwkylTv8EI1BPORif01k438Ok8iFch zKOxcAdTjuNgPh0zGCvuLihRQnivVPeWN/PDIEUlR4CG7hRnQpXV+RSUhlNJ7EVDTay4bT2Jm rKu9JkizJbKvc1fY4agWQrDBuUC5ENhOvezshnUcPCsk+AIw5IRagrZ89t6n7GvOCxYQ27xAd Fl9KF0kGERsy/jqtBrYNn3P9ZWU9MTw+YhYZmq8UfIM/yi4jqyLlpxUcg== List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk Wells Oliver schrieb am 11.07.2022 um 18:25: >> On Mon, Jul 11, 2022 at 5:11 AM Thomas Kellerer > wrote: >> >> Wells Oliver schrieb am 09.07.2022 um 21:37: >> > We have a couple of tables where we like to store very large JSO= N >> > objects in a JSONB column. >> Note, that the upper limit for a single jsonb value is 255MB >> Not 1GB as it is e.g. the case for text or json. > What exactly does that mean? The upper limit at which TOAST is used > for storage, or what? We certainly have objects larger than 256MB in > JSONB columns. Hmm, that's strange, because when I try to create a JSONB value that is larger than 256MB I get the following error: ERROR: total size of jsonb object elements exceeds the maximum of 2684= 35455 bytes Are you sure you are using jsonb, not json maybe? To my knowledge the json data type does not have this limit.