pg.ddx.io  pgsql-general@postgresql.org mailing list archive  

help / color / mirror / Atom feed

From: Joe Conway <mail@joeconway.com>
To: Nathan Bossart <nathandbossart@gmail.com>
To: Tom Lane <tgl@sss.pgh.pa.us>
Cc: Andrew Dunstan <andrew@dunslane.net>
Cc: Davin Shearer <davin@apache.org>
Cc: PostgreSQL-development <pgsql-hackers@postgresql.org>
Subject: Re: Emitting JSON to file using COPY TO
Date: Wed, 6 Dec 2023 14:48:52 -0500
Message-ID: <77312d02-9325-4f14-9fe0-2746c2ee12bc@joeconway.com> (raw)
In-Reply-To: <20231206164439.GC2873889@nathanxps13>
References: <cb1f118c-4698-4451-9ba9-dd8595f06c37@joeconway.com>
	<926ff917-8371-40ec-b5e6-ab7b0e09bdc5@joeconway.com>
	<315b81d4-4b67-7828-0355-3808cd14acd1@dunslane.net>
	<7a60faf6-e7f1-419d-aee6-10a78ea2fe81@joeconway.com>
	<2e7ff718-895d-83fc-46f7-be25e23b23b4@dunslane.net>
	<!bbf922c5-f571-483e-a2c6-2730b02183fe@joeconway.com>
	<1104915.1701877459@sss.pgh.pa.us>
	<19a5f9d8-bd1f-9!e51-0f5b-510c1189a8a7@dunslane.net>
	<1110690.1701880139@sss.pgh.pa.us>
	<20231206163349.GA2873889@nathanxps13>
	<20231206164439.GC2873889@nathanxps13>

On 12/6/23 11:44, Nathan Bossart wrote:
> On Wed, Dec 06, 2023 at 10:33:49AM -0600, Nathan Bossart wrote:
>> 	(format csv)
>> 	Time: 12295.480 ms (00:12.295)
>> 	Time: 12311.059 ms (00:12.311)
>> 	Time: 12305.469 ms (00:12.305)
>> 
>> 	(format json)
>> 	Time: 24568.621 ms (00:24.569)
>> 	Time: 23756.234 ms (00:23.756)
>> 	Time: 24265.730 ms (00:24.266)
> 
> I should also note that the json output is 85% larger than the csv output.

I'll see if I can add some caching to composite_to_json(), but based on 
the relative data size it does not sound like there is much performance 
left on the table to go after, no?

-- 
Joe Conway
PostgreSQL Contributors Team
RDS Open Source Databases
Amazon Web Services: https://aws.amazon.com

view thread (163+ messages)  latest in thread

Message-ID: <77312d02-9325-4f14-9fe0-2746c2ee12bc@joeconway.com>
Permalink:  ../77312d02-9325-4f14-9fe0-2746c2ee12bc@joeconway.com/
Also on:    postgresql.org/message-id/77312d02-9325-4f14-9fe0-2746c2ee12bc@joeconway.com

copy link · copy postgr.es

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-general@postgresql.org
  Cc: mail@joeconway.com, nathandbossart@gmail.com, tgl@sss.pgh.pa.us, andrew@dunslane.net, davin@apache.org, pgsql-hackers@postgresql.org
  Subject: Re: Emitting JSON to file using COPY TO
  In-Reply-To: <77312d02-9325-4f14-9fe0-2746c2ee12bc@joeconway.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox