pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: David Garamond <lists@zara.6.isreserved.com>
To: Steve Atkins <steve@blighty.com>
Cc: pgsql-general@postgresql.org
Subject: Re: Text Search vs MYSQL vs Lucene
Date: Thu, 09 Sep 2004 22:33:11 +0700
Message-ID: <414077B7.5080808@zara.6.isreserved.com> (raw)
In-Reply-To: <20040909142006.GA24396@gp.word-to-the-wise.com>
References: <414052F4.5050000@portalvu.com>
	<20040909142006.GA24396@gp.word-to-the-wise.com>

Steve Atkins wrote:
>>What would be performance of pgSQL text search vs MySQL vs Lucene (flat 
>>file) for a 2 terabyte db?
>>thanks for any comments.
> 
> My experience with tsearch2 has been that indexing even moderately
> large chunks of data is too slow to be feasible. Moderately large
> meaning tens of megabytes.

My experience with MySQL's full text search as well as the various 
MySQL-based text indexing programs (forgot the names, it's been a while) 
for some 10-20GB of mail archives has been pretty disappointing too. My 
biggest gripe is with the indexing speed. It literally takes days to 
index less than a million documents.

I ended up using Swish++. Microsoft's CHM compiler also has pretty 
amazing indexing speed (though it crashes quite often when encountering 
bad HTML).

-- 
dave



view thread (6+ messages)  latest in thread

Message-ID: <414077B7.5080808@zara.6.isreserved.com>
Permalink:  ../414077B7.5080808@zara.6.isreserved.com/
Also on:    postgresql.org/message-id/414077B7.5080808@zara.6.isreserved.com

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: lists@zara.6.isreserved.com, steve@blighty.com, pgsql-general@postgresql.org
  Subject: Re: Text Search vs MYSQL vs Lucene
  In-Reply-To: <414077B7.5080808@zara.6.isreserved.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox