From: David Garamond <lists@zara.6.isreserved.com>
To: Steve Atkins <steve@blighty.com>
Cc: pgsql-general@postgresql.org
Subject: Re: Text Search vs MYSQL vs Lucene
Date: Thu, 09 Sep 2004 22:33:11 +0700
Message-ID: <414077B7.5080808@zara.6.isreserved.com> (raw)
In-Reply-To: <20040909142006.GA24396@gp.word-to-the-wise.com>
References: <414052F4.5050000@portalvu.com>
<20040909142006.GA24396@gp.word-to-the-wise.com>
Steve Atkins wrote:
>>What would be performance of pgSQL text search vs MySQL vs Lucene (flat
>>file) for a 2 terabyte db?
>>thanks for any comments.
>
> My experience with tsearch2 has been that indexing even moderately
> large chunks of data is too slow to be feasible. Moderately large
> meaning tens of megabytes.
My experience with MySQL's full text search as well as the various
MySQL-based text indexing programs (forgot the names, it's been a while)
for some 10-20GB of mail archives has been pretty disappointing too. My
biggest gripe is with the indexing speed. It literally takes days to
index less than a million documents.
I ended up using Swish++. Microsoft's CHM compiler also has pretty
amazing indexing speed (though it crashes quite often when encountering
bad HTML).
--
dave
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-performance@postgresql.org
Cc: lists@zara.6.isreserved.com, steve@blighty.com, pgsql-general@postgresql.org
Subject: Re: Text Search vs MYSQL vs Lucene
In-Reply-To: <414077B7.5080808@zara.6.isreserved.com>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox