From: Andrew Dunstan <andrew@dunslane.net>
To: pgsql-committers@lists.postgresql.org
Subject: pgsql: Introduce a non-recursive JSON parser
Date: Thu, 04 Apr 2024 10:56:55 +0000
Message-ID: <E1rsKm6-000Rum-G7@gemulon.postgresql.org> (raw)
Introduce a non-recursive JSON parser
This parser uses an explicit prediction stack, unlike the present
recursive descent parser where the parser state is represented on the
call stack. This difference makes the new parser suitable for use in
incremental parsing of huge JSON documents that cannot be conveniently
handled piece-wise by the recursive descent parser. One potential use
for this will be in parsing large backup manifests associated with
incremental backups.
Because this parser is somewhat slower than the recursive descent
parser, it is not replacing that parser, but is an additional parser
available to callers.
For testing purposes, if the build is done with -DFORCE_JSON_PSTACK, all
JSON parsing is done with the non-recursive parser, in which case only
trivial regression differences in error messages should be observed.
Author: Andrew Dunstan
Reviewed-By: Jacob Champion
Discussion: https://postgr.es/m/7b0a51d6-0d9d-7366-3a1a-f74397a02f55@dunslane.net
Branch
------
master
Details
-------
https://git.postgresql.org/pg/commitdiff/3311ea86edc7a689614bad754e17371865cdc11f
Modified Files
--------------
src/common/jsonapi.c | 954 +-
src/include/common/jsonapi.h | 30 +
src/include/pg_config_manual.h | 7 +
src/test/modules/Makefile | 1 +
src/test/modules/meson.build | 1 +
src/test/modules/test_json_parser/Makefile | 36 +
src/test/modules/test_json_parser/README | 25 +
src/test/modules/test_json_parser/meson.build | 52 +
.../t/001_test_json_parser_incremental.pl | 23 +
src/test/modules/test_json_parser/t/002_inline.pl | 83 +
.../test_json_parser/t/003_test_semantic.pl | 36 +
.../test_json_parser_incremental.c | 320 +
.../test_json_parser/test_json_parser_perf.c | 86 +
src/test/modules/test_json_parser/tiny.json | 378 +
src/test/modules/test_json_parser/tiny.out | 19534 +++++++++++++++++++
src/tools/pgindent/typedefs.list | 6 +
16 files changed, 21563 insertions(+), 9 deletions(-)
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-committers@postgresql.org
Cc: andrew@dunslane.net, pgsql-committers@lists.postgresql.org
Subject: Re: pgsql: Introduce a non-recursive JSON parser
In-Reply-To: <E1rsKm6-000Rum-G7@gemulon.postgresql.org>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox