pg.ddx.io pgsql-admin@postgresql.org mailing list archive
help / color / mirror / Atom feedFull Text Indexing Using Tsearch2-Module
3+ messages / 3 participants
[nested] [flat]
* Full Text Indexing Using Tsearch2-Module
@ 2006-01-23 09:35 Praveen Kumar (TUV) <praveen.k@renaissance-it.com>
0 siblings, 1 reply; 3+ messages in thread
From: Praveen Kumar (TUV) @ 2006-01-23 09:35 UTC (permalink / raw)
To: Michael Fuhr <mike@fuhr.org>; +Cc: brad@kieser.net; pgsql-admin
Hello All,
I have installed Tsearch-Module for full text indexing .But when I search text using gist(idxFTI) index on table I also found
all data which have same accent.Example
1.If I try search for MANI word it also search for MANY word.
2.If I try search for ANDY word it also search for ANDI word.
Please can you tell me how to avoid this problem ? If i want to search text MANI it should search only for MANI not MANY.
^ permalink raw reply [nested|flat] 3+ messages in thread
* Re: Full Text Indexing Using Tsearch2-Module
@ 2006-01-23 16:44 Michael Fuhr <mike@fuhr.org>
parent: Praveen Kumar (TUV) <praveen.k@renaissance-it.com>
0 siblings, 1 reply; 3+ messages in thread
From: Michael Fuhr @ 2006-01-23 16:44 UTC (permalink / raw)
To: Praveen Kumar (TUV) <praveen.k@renaissance-it.com>; +Cc: brad@kieser.net; pgsql-admin
On Mon, Jan 23, 2006 at 03:05:07PM +0530, Praveen Kumar (TUV) wrote:
> I have installed Tsearch-Module for full text indexing .But when
> I search text using gist(idxFTI) index on table I also found all
> data which have same accent.Example
> 1.If I try search for MANI word it also search for MANY word.
> 2.If I try search for ANDY word it also search for ANDI word.
> Please can you tell me how to avoid this problem ? If i want to
> search text MANI it should search only for MANI not MANY.
Your tsearch2 configuration is turning the words "many" and "andy"
into the lexemes "mani" and "andi", like this:
test=> SELECT * FROM ts_debug('many andy');
ts_name | tok_type | description | token | dict_name | tsvector
---------+----------+-------------+-------+-----------+----------
default | lword | Latin word | many | {en_stem} | 'mani'
default | lword | Latin word | andy | {en_stem} | 'andi'
(2 rows)
To learn how to change that see "Parsing and Lexing" and "Configurations"
in the tsearch2 documentation:
http://www.sai.msu.su/~megera/postgres/gist/tsearch/V2/docs/tsearch2-guide.html#parsing_lexing
http://www.sai.msu.su/~megera/postgres/gist/tsearch/V2/docs/tsearch2-ref.html#configurations
Another approach is to think of tsearch2 as returning "might match"
rows and add another restriction to find the definite matches:
test=> SELECT * FROM foo
test-> WHERE idxcontent @@ to_tsquery('many');
id | content | idxcontent
----+---------+------------
1 | many | 'mani':1
2 | mani | 'mani':1
(2 rows)
test=> SELECT * FROM foo
test-> WHERE idxcontent @@ to_tsquery('many') AND content ~* 'many';
id | content | idxcontent
----+---------+------------
1 | many | 'mani':1
(1 row)
--
Michael Fuhr
^ permalink raw reply [nested|flat] 3+ messages in thread
* Re: Full Text Indexing Using Tsearch2-Module
@ 2006-01-23 16:49 Oleg Bartunov <oleg@sai.msu.su>
parent: Michael Fuhr <mike@fuhr.org>
0 siblings, 0 replies; 3+ messages in thread
From: Oleg Bartunov @ 2006-01-23 16:49 UTC (permalink / raw)
To: Michael Fuhr <mike@fuhr.org>; +Cc: Praveen Kumar (TUV) <praveen.k@renaissance-it.com>; brad@kieser.net; pgsql-admin
The simplest way is to use custom dictionary like 'synonym' !
many:many
and let it first dictionary !
Oleg
On Mon, 23 Jan 2006, Michael Fuhr wrote:
> On Mon, Jan 23, 2006 at 03:05:07PM +0530, Praveen Kumar (TUV) wrote:
>> I have installed Tsearch-Module for full text indexing .But when
>> I search text using gist(idxFTI) index on table I also found all
>> data which have same accent.Example
>> 1.If I try search for MANI word it also search for MANY word.
>> 2.If I try search for ANDY word it also search for ANDI word.
>> Please can you tell me how to avoid this problem ? If i want to
>> search text MANI it should search only for MANI not MANY.
>
> Your tsearch2 configuration is turning the words "many" and "andy"
> into the lexemes "mani" and "andi", like this:
>
> test=> SELECT * FROM ts_debug('many andy');
> ts_name | tok_type | description | token | dict_name | tsvector
> ---------+----------+-------------+-------+-----------+----------
> default | lword | Latin word | many | {en_stem} | 'mani'
> default | lword | Latin word | andy | {en_stem} | 'andi'
> (2 rows)
>
> To learn how to change that see "Parsing and Lexing" and "Configurations"
> in the tsearch2 documentation:
>
> http://www.sai.msu.su/~megera/postgres/gist/tsearch/V2/docs/tsearch2-guide.html#parsing_lexing
> http://www.sai.msu.su/~megera/postgres/gist/tsearch/V2/docs/tsearch2-ref.html#configurations
>
> Another approach is to think of tsearch2 as returning "might match"
> rows and add another restriction to find the definite matches:
>
> test=> SELECT * FROM foo
> test-> WHERE idxcontent @@ to_tsquery('many');
> id | content | idxcontent
> ----+---------+------------
> 1 | many | 'mani':1
> 2 | mani | 'mani':1
> (2 rows)
>
> test=> SELECT * FROM foo
> test-> WHERE idxcontent @@ to_tsquery('many') AND content ~* 'many';
> id | content | idxcontent
> ----+---------+------------
> 1 | many | 'mani':1
> (1 row)
>
>
Regards,
Oleg
_____________________________________________________________
Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru),
Sternberg Astronomical Institute, Moscow University, Russia
Internet: oleg@sai.msu.su, http://www.sai.msu.su/~megera/
phone: +007(495)939-16-83, +007(495)939-23-83
^ permalink raw reply [nested|flat] 3+ messages in thread
end of thread, other threads:[~2006-01-23 16:49 UTC | newest]
Thread overview: 3+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2006-01-23 09:35 Full Text Indexing Using Tsearch2-Module Praveen Kumar (TUV) <praveen.k@renaissance-it.com>
2006-01-23 16:44 ` Michael Fuhr <mike@fuhr.org>
2006-01-23 16:49 ` Oleg Bartunov <oleg@sai.msu.su>
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox