pg.ddx.io  pgsql-committers@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Jacob Champion <jchampion@postgresql.org>
To: pgsql-committers@lists.postgresql.org
Subject: pgsql: test_json_parser: Speed up 002_inline.pl
Date: Wed, 01 Oct 2025 16:51:51 +0000
Message-ID: <E1v403S-000xdO-32@gemulon.postgresql.org> (raw)

test_json_parser: Speed up 002_inline.pl

Some macOS machines are having trouble with 002_inline, which executes
the JSON parser test executables hundreds of times in a nested loop.
Both developer machines and buildfarm critters have shown excessive test
durations, upwards of 20 seconds.

Push the innermost loop of 002_inline, which iterates through differing
chunk sizes, down into the test executable. (I'd eventually like to push
all of the JSON unit tests down into C, but this is an easy win in the
short term.) Testers have reported a speedup between 4-9x.

Reported-by: Robert Haas <robertmhaas@gmail.com>
Suggested-by: Andres Freund <andres@anarazel.de>
Tested-by: Andrew Dunstan <andrew@dunslane.net>
Tested-by: Tom Lane <tgl@sss.pgh.pa.us>
Tested-by: Robert Haas <robertmhaas@gmail.com>
Discussion: https://postgr.es/m/CA%2BTgmobKoG%2BgKzH9qB7uE4MFo-z1hn7UngqAe9b0UqNbn3_XGQ%40mail.gmail.com
Backpatch-through: 17

Branch
------
master

Details
-------
https://git.postgresql.org/pg/commitdiff/fd726b8379a8191da9e74d28761c967eda13f5f2

Modified Files
--------------
src/test/modules/test_json_parser/README           |  10 +-
src/test/modules/test_json_parser/t/002_inline.pl  |  26 ++++-
.../test_json_parser_incremental.c                 | 127 +++++++++++++--------
3 files changed, 106 insertions(+), 57 deletions(-)



view thread (3+ messages)

Message-ID: <E1v403S-000xdO-32@gemulon.postgresql.org>
Permalink:  ../E1v403S-000xdO-32@gemulon.postgresql.org/
Also on:    postgresql.org/message-id/E1v403S-000xdO-32@gemulon.postgresql.org

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-committers@postgresql.org
  Cc: jchampion@postgresql.org, pgsql-committers@lists.postgresql.org
  Subject: Re: pgsql: test_json_parser: Speed up 002_inline.pl
  In-Reply-To: <E1v403S-000xdO-32@gemulon.postgresql.org>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox