Received: from localhost (maia-4.hub.org [200.46.204.183]) by postgresql.org (Postfix) with ESMTP id 73F589FB231 for ; Wed, 28 Feb 2007 04:33:41 -0400 (AST) Received: from postgresql.org ([200.46.204.71]) by localhost (mx1.hub.org [200.46.204.183]) (amavisd-new, port 10024) with ESMTP id 25848-05 for ; Wed, 28 Feb 2007 04:33:39 -0400 (AST) X-Greylist: from auto-whitelisted by SQLgrey-1.7.4 Received: from developer.pgadmin.org (developer.pgadmin.org [63.246.23.140]) by postgresql.org (Postfix) with ESMTP id 287CE9FB20F for ; Wed, 28 Feb 2007 04:33:38 -0400 (AST) Received: from [172.24.32.77] ([62.232.55.118]) (authenticated bits=0) by developer.pgadmin.org (8.13.8/8.13.8) with ESMTP id l1S86tvr015799 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Wed, 28 Feb 2007 08:06:56 GMT Message-ID: <45E53E5A.5060600@postgresql.org> Date: Wed, 28 Feb 2007 08:33:30 +0000 From: Dave Page User-Agent: Thunderbird 1.5.0.9 (Macintosh/20061207) MIME-Version: 1.0 To: Charles Sprickman CC: Magnus Hagander , Madison Kelly , pgsql-performance@postgresql.org Subject: Re: Writting a "search engine" for a pgsql DB References: <45E30ADA.2050700@alteeve.com> <20070227131558.GP12721@svr2.hagander.net> <45E4333B.9020008@postgresql.org> In-Reply-To: X-Enigmail-Version: 0.94.1.2 OpenPGP: url=http://www.pgadmin.org/pgp/davepage.pgp Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Virus-Scanned: Maia Mailguard 1.0.1 X-Spam-Status: No, hits=0.019 tagged_above=0 required=5 tests=AWL, BAYES_40, DNS_FROM_RFC_ABUSE X-Spam-Level: X-Archive-Number: 200702/338 X-Sequence-Number: 23392 Charles Sprickman wrote: > On Tue, 27 Feb 2007, Dave Page wrote: > >> Magnus Hagander wrote: >>> >>> Just as a datapoint, we did try to use mnogosearch for the >>> postgresql.org website+archives search, and it fell over completely. >>> Indexing took way too long, and we had search times several thousand >>> times longer than with tsearch2. >>> >>> That said, I'm sure there are cases when it works fine :-) >> >> There are - in fact before your time the site did use Mnogosearch. We >> moved to our own port of ASPSeek when we outgrew Mnogo's capabilities, >> and then to your TSearch code when we outgrew ASPSeek. > > At risk of pulling this way too far off topic, may I ask how many > documents (mail messages) you were dealing with when things started to > fall apart with mnogo? I honestly don't remember now, but it would have been in the tens or maybe low hundreds of thousands. Don't get me wrong, I've built sites where Mnogo is still running fine and does a great job - it just doesn't scale well. > We're looking at it for a new project that will > hopefully get bigger and bigger. We will be throwing groups of mailing > lists into their own mnogo config/tables... If we should save ourselves > the pain and look at something more homebrew, then we'll start > investigating "Tsearch". Well put it this way, the PostgreSQL mailing list archives outgrew Mnogo years ago and even ASPSeek was beginning to struggle when it got removed a few months back. Regards, Dave