Received: from localhost (unknown [200.46.204.183]) by developer.postgresql.org (Postfix) with ESMTP id 0F9622E0042 for ; Wed, 18 Jun 2008 10:56:19 -0300 (ADT) Received: from developer.postgresql.org ([200.46.204.71]) by localhost (mx1.hub.org [200.46.204.183]) (amavisd-maia, port 10024) with ESMTP id 90359-01 for ; Wed, 18 Jun 2008 10:56:02 -0300 (ADT) X-Greylist: from auto-whitelisted by SQLgrey-1.7.6 Received: from lists.commandprompt.com (host-159.commandprompt.net [207.173.203.159]) by developer.postgresql.org (Postfix) with ESMTP id CBFD32E003F for ; Wed, 18 Jun 2008 10:55:54 -0300 (ADT) Received: from commandprompt.com (227-54-222-209.mycybernet.net [209.222.54.227]) (authenticated bits=0) by lists.commandprompt.com (8.13.8/8.13.8) with ESMTP id m5IDvaWi026207 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for ; Wed, 18 Jun 2008 06:57:39 -0700 Date: Wed, 18 Jun 2008 09:55:48 -0400 From: Andrew Sullivan To: pgsql-admin@postgresql.org Subject: Re: full-text search question Message-ID: <20080618135548.GD433@commandprompt.com> Mail-Followup-To: Andrew Sullivan , pgsql-admin@postgresql.org References: <269b27950806180549k323833c7n38a0d9f434542bf2@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <269b27950806180549k323833c7n38a0d9f434542bf2@mail.gmail.com> User-Agent: Mutt/1.5.17 (2007-11-01) X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.0 (lists.commandprompt.com [207.173.203.159]); Wed, 18 Jun 2008 06:57:40 -0700 (PDT) X-Virus-Scanned: Maia Mailguard 1.0.1 X-Archive-Number: 200806/139 X-Sequence-Number: 29477 On Wed, Jun 18, 2008 at 02:49:48PM +0200, Sabbiolina wrote: > www.google.com is only treated as a unique word? Why not producing multiple > tokens like www.google.com, www, ., google, ., com? (obviously www and . can > be nulled or stopworded). You wouldn't want to get the token ".". It's not a token, but a label boundary. So in your analogy of treating the labels in a FQDN as "words", the "." needs to be treated the way spaces are between words. A -- Andrew Sullivan ajs@commandprompt.com +1 503 667 4564 x104 http://www.commandprompt.com/