Message-ID: <5358F6BE.2020104@vmware.com>
Date: Thu, 24 Apr 2014 14:34:22 +0300
From: Heikki Linnakangas <hlinnakangas@vmware.com>
Organization: VMware
User-Agent: Mozilla/5.0 (X11; Linux x86_64;
 rv:24.0) Gecko/20100101 Icedove/24.4.0
MIME-Version: 1.0
To: Sergey Konoplev <gray.ru@gmail.com>, Ivan Voras <ivoras@freebsd.org>
CC: Jeff Janes <jeff.janes@gmail.com>,
 postgres performance list <pgsql-performance@postgresql.org>
Subject: Re: tsearch2, large data and indexes
References: 
 <CAF-QHFUaRk-v4bnTUQ0_eepH0MEKaCaVM-fwiTP1uxM8EgKQVw@mail.gmail.com>
 <53560EE5.3080300@vmware.com>
 <CAF-QHFWbee3Anp+KKc5DEe2wufHtWYZ8zc1ysqXu2-0SW+v-UA@mail.gmail.com>
 <CAMkU=1y7-HOb2=iNkmPXC_mePRqSnkftCG5UdStrzwDJBO7WLg@mail.gmail.com>
 <CAF-QHFVYw5-2MwAVqCpZp8spyEfVP_k918naG=XV0ypTe=gOvA@mail.gmail.com>
 <CAL_0b1vo9ibxHG3MayGKNxiOJH3is3kav5E1x+eBQZv6QC4Wow@mail.gmail.com>
In-Reply-To: 
 <CAL_0b1vo9ibxHG3MayGKNxiOJH3is3kav5E1x+eBQZv6QC4Wow@mail.gmail.com>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
Precedence: bulk
Sender: pgsql-performance-owner@postgresql.org

On 04/24/2014 01:56 AM, Sergey Konoplev wrote:
> On Wed, Apr 23, 2014 at 4:08 AM, Ivan Voras <ivoras@freebsd.org> wrote:
>> Ok, I found out what is happening, quoting from the documentation:
>>
>> "GIN indexes are not lossy for standard queries, but their performance
>> depends logarithmically on the number of unique words. (However, GIN
>> indexes store only the words (lexemes) oftsvector values, and not
>> their weight labels. Thus a table row recheck is needed when using a
>> query that involves weights.)"
>>
>> My query doesn't have weights but the tsvector in the table has them -
>> I take it this is what is meant by "involves weights."
>>
>> So... there's really no way for tsearch2 to produce results based on
>> the index alone, without recheck? This is... limiting.
>
> My guess is that you could use strip() function [1] to get rid of
> weights in your table or, that would probably be better, in your index
> only by using expressions in it and in the query, eg.

As the docs say, the GIN index does not store the weights. As such, 
there is no need to strip them. A recheck would be necessary if your 
query needs the weights, precisely because the weights are not included 
in the index.

(In the OP's query, it's the ranking that was causing the detoasting.)

- Heikki


-- 
Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-performance