pg.ddx.io pgsql-performance@postgresql.org mailing list archivehelp / color / mirror / Atom feed
Keyword searching question 2+ messages / 1 participants [nested] [flat]
* Keyword searching question @ 2004-07-06 17:52 borajetta <borajetta@hotmail.com> 0 siblings, 0 replies; 2+ messages in thread From: borajetta @ 2004-07-06 17:52 UTC (permalink / raw) To: pgsql-performance I have been trying to get keyword searching quicker and have now decided to make smaller tables. I was working with tables of about 50 000 000 rows but now will use about 1.5million rows, I am using a TSearch2 to find keywords in the titles column of the rows. I have indexes using a gist index on the TSearch2 using 'default'. I wanted to know if it would be quicker to change my words in the title into crc32 bit integers and then look for them using an index which would be on the crc numbers. I could then cluster on the crc numbers and this should result in a fast search but I just want to know if you know of better ways of doing keyword searching, I need it to be about 1-4 seconds and return usually around 1-5 thousand rows. I know places like google and ebay do seaches and only return 200 or 100 max rows, this can be done on our current system very fast as you just limit the number returned but for our purposes I need to return all the rows, Thanks smokedvw ^ permalink raw reply [nested|flat] 2+ messages in thread
* Re: Keyword searching question @ 2004-07-06 17:56 borajetta <borajetta@hotmail.com> 0 siblings, 0 replies; 2+ messages in thread From: borajetta @ 2004-07-06 17:56 UTC (permalink / raw) To: pgsql-performance Forgot to mention that were running post gres 7.4.2 using a dual optiron system and 4gig ram. The results are used by the PHP web server. Thanks again ----- Original Message ----- From: borajetta To: pgsql-performance@postgresql.org Sent: Tuesday, July 06, 2004 10:52 AM Subject: Keyword searching question I have been trying to get keyword searching quicker and have now decided to make smaller tables. I was working with tables of about 50 000 000 rows but now will use about 1.5million rows, I am using a TSearch2 to find keywords in the titles column of the rows. I have indexes using a gist index on the TSearch2 using 'default'. I wanted to know if it would be quicker to change my words in the title into crc32 bit integers and then look for them using an index which would be on the crc numbers. I could then cluster on the crc numbers and this should result in a fast search but I just want to know if you know of better ways of doing keyword searching, I need it to be about 1-4 seconds and return usually around 1-5 thousand rows. I know places like google and ebay do seaches and only return 200 or 100 max rows, this can be done on our current system very fast as you just limit the number returned but for our purposes I need to return all the rows, Thanks smokedvw ^ permalink raw reply [nested|flat] 2+ messages in thread
end of thread, other threads:[~2004-07-06 17:56 UTC | newest] Thread overview: 2+ messages (download: mbox mbox.gz follow: Atom feed) -- links below jump to the message on this page -- 2004-07-06 17:52 Keyword searching question borajetta <borajetta@hotmail.com> 2004-07-06 17:56 Re: Keyword searching question borajetta <borajetta@hotmail.com>
This inbox is served by DDX for PostgreSQL; see mirroring instructions for how to clone and mirror all data and code used for this inbox