pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: borajetta <borajetta@hotmail.com>
To: pgsql-performance@postgresql.org
Subject: Keyword searching question
Date: Tue, 6 Jul 2004 10:52:59 -0700
Message-ID: <BAY17-DAV9OimiNEzkm0006e86e@hotmail.com> (raw)

I have been trying to get keyword searching quicker and have now decided to make smaller tables.

I was working with tables of about 50 000 000 rows but now will use about 1.5million rows, I am using a TSearch2 to find keywords in the titles column of the rows.  I have indexes using a gist index on the TSearch2 using 'default'.
I wanted to know if it would be quicker to change my words in the title into crc32 bit integers and then look for them using an index which would be on the crc numbers.  I could then cluster on the crc numbers and this should result in a fast search but I just want to know if you know of better ways of doing keyword searching, I need it to be about 1-4 seconds and return usually around 1-5 thousand rows.

I know places like google and ebay do seaches and only return 200 or 100 max rows, this can be done on our current system very fast as you just limit the number returned but for our purposes I need to return all the rows,

Thanks
smokedvw

view thread (2+ messages)  latest in thread

Message-ID: <BAY17-DAV9OimiNEzkm0006e86e@hotmail.com>
Permalink:  ../BAY17-DAV9OimiNEzkm0006e86e@hotmail.com/
Also on:    postgresql.org/message-id/BAY17-DAV9OimiNEzkm0006e86e@hotmail.com

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: borajetta@hotmail.com
  Subject: Re: Keyword searching question
  In-Reply-To: <BAY17-DAV9OimiNEzkm0006e86e@hotmail.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox