From: Tom Lane <tgl@sss.pgh.pa.us>
To: Laurenz Albe <laurenz.albe@cybertec.at>
Cc: pperalta@gmail.com
Cc: pgsql-bugs@lists.postgresql.org
Subject: Re: BUG #18149: Incorrect lexeme for english token "proxy"
Date: Sat, 07 Oct 2023 10:18:56 -0400
Message-ID: <3123965.1696688336@sss.pgh.pa.us> (raw)
In-Reply-To: <25d0bf34e0f7e0d9f3455e1b7adaf5a5aee810e1.camel@cybertec.at>
References: <18149-936d14e6fc76ca61@postgresql.org>
<25d0bf34e0f7e0d9f3455e1b7adaf5a5aee810e1.camel@cybertec.at>
Laurenz Albe <laurenz.albe@cybertec.at> writes:
> On Thu, 2023-10-05 at 21:44 +0000, PG Bug reporting form wrote:
>> The english dictionary is using the lexeme "proxi" for the token "proxy". As
>> a result, the search term "proxy" is not yielding results for records that
>> contain this word.
> I cannot reproduce that.
Me either. It suggests that you're trying to match against documents
that haven't been put through the same normalization process as the
query.
>> I think this lexeme was chosen to support the plural of proxy which is
>> proxies. However there are other plurals where the root word is spelled
>> different and Postgres creates the correct lexeme such as: [goose or mouse]
> The snowball dictionary has no real knowledge of the words. Stemming is
> done by applying some heuristics which work "well enough" in most cases.
Yeah. I don't see anything hugely wrong with this particular
transformation. It is doing something useful, in that "proxy"
and "proxies" are both converted to the same lexeme "proxi".
In an ideal world, the lexeme would be "proxy", but it doesn't
really make that much difference if it isn't.
In any case, changing it now wouldn't be very practical, because
existing documents will already have been made into tsvectors
using this rule.
regards, tom lane
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-bugs@postgresql.org
Cc: tgl@sss.pgh.pa.us, laurenz.albe@cybertec.at, pperalta@gmail.com, pgsql-bugs@lists.postgresql.org
Subject: Re: BUG #18149: Incorrect lexeme for english token "proxy"
In-Reply-To: <3123965.1696688336@sss.pgh.pa.us>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox