pg.ddx.io  pgsql-committers@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Tom Lane <tgl@sss.pgh.pa.us>
To: pgsql-committers@lists.postgresql.org
Subject: pgsql: Fix parsing of ignored operators in websearch_to_tsquery().
Date: Fri, 14 Jun 2024 00:35:10 +0000
Message-ID: <E1sHuuL-001Ogc-Co@gemulon.postgresql.org> (raw)

Fix parsing of ignored operators in websearch_to_tsquery().

The manual says clearly that punctuation in the input of
websearch_to_tsquery() is ignored, except for the special cases
of dashes and quotes.  However, this failed for cases like
"(foo bar) or something", or in general an ISOPERATOR character
in front of the "or".  We'd switch back to WAITOPERAND state,
then ignore the operator character while remaining in that state,
and then reach the "or" in WAITOPERAND state which (intentionally)
makes us treat it as data.

The fix is simple enough: if we see an ISOPERATOR character while in
WAITOPERATOR state, we have to skip it while staying in that state.
(We don't need to worry about other punctuation characters: those will
be consumed as though they were words, but then rejected by lexizing.)

In v14 and up (since commit eb086056f) we can simplify the code a bit
more too, because there is no longer a reason for the WAITOPERAND
state to distinguish between quoted and unquoted operands.

Per bug #18479 from Manos Emmanouilidis.  Back-patch to all supported
branches.

Discussion: https://postgr.es/m/18479-d9b46e2fc242c33e@postgresql.org

Branch
------
master

Details
-------
https://git.postgresql.org/pg/commitdiff/56a8296212b68267dc2bddeb1fb40a893b1aadb3

Modified Files
--------------
src/backend/utils/adt/tsquery.c       | 22 +++++++++-------------
src/test/regress/expected/tsearch.out |  7 +++++++
src/test/regress/sql/tsearch.sql      |  3 +++
3 files changed, 19 insertions(+), 13 deletions(-)



view thread (6+ messages)  latest in thread

Message-ID: <E1sHuuL-001Ogc-Co@gemulon.postgresql.org>
Permalink:  ../E1sHuuL-001Ogc-Co@gemulon.postgresql.org/
Also on:    postgresql.org/message-id/E1sHuuL-001Ogc-Co@gemulon.postgresql.org

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-committers@postgresql.org
  Cc: tgl@sss.pgh.pa.us, pgsql-committers@lists.postgresql.org
  Subject: Re: pgsql: Fix parsing of ignored operators in websearch_to_tsquery().
  In-Reply-To: <E1sHuuL-001Ogc-Co@gemulon.postgresql.org>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox