Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1WCc1y-0001yI-38 for pgsql-hackers@arkaria.postgresql.org; Sun, 09 Feb 2014 21:35:14 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.80) (envelope-from ) id 1WCc1x-0001jD-J1 for pgsql-hackers@arkaria.postgresql.org; Sun, 09 Feb 2014 21:35:13 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1WCc1v-0001i7-7X for pgsql-hackers@postgresql.org; Sun, 09 Feb 2014 21:35:11 +0000 Received: from mail.gransy.com ([2001:1528:137::f1]) by magus.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1WCc1q-0005Vo-Qu for pgsql-hackers@postgresql.org; Sun, 09 Feb 2014 21:35:10 +0000 Received: from antispam.gransy.com (antispam.gransy.com [77.78.104.124]) by mail.gransy.com (Postfix) with ESMTP id 4ABFC508D7F for ; Sun, 9 Feb 2014 22:35:03 +0100 (CET) X-Virus-Scanned: G-Hosting.cz + Station.cz + Klenot.cz + Subreg.cz amavisd-new at antispam.gransy.com Received: from mail.gransy.com ([82.208.29.194]) by antispam.gransy.com (antispam.gransy.com [77.78.104.124]) (amavisd-new, port 10024) with ESMTP id wHPAiGVgCFPy for ; Sun, 9 Feb 2014 22:35:14 +0100 (CET) Received: from [192.168.1.227] (ip-78-45-139-138.net.upcbroadband.cz [78.45.139.138]) (using TLSv1 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) (Authenticated sender: tv@fuzzy.cz) by mail.gransy.com (Postfix) with ESMTPSA id 0326B508D7C for ; Sun, 9 Feb 2014 22:35:01 +0100 (CET) Message-ID: <52F7F485.6010902@fuzzy.cz> Date: Sun, 09 Feb 2014 22:35:01 +0100 From: Tomas Vondra User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.3.0 MIME-Version: 1.0 To: pgsql-hackers@postgresql.org Subject: Re: GIN improvements part2: fast scan References: <51D00FB6.9030008@vmware.com> <528533D9.3040501@vmware.com> <52E141BA.5000302@vmware.com> <52E4141E.60609@fuzzy.cz> <52E42AD0.5060600@vmware.com> <52E4AA3A.9000607@fuzzy.cz> <52E53458.2010106@vmware.com> <52E72A10.5040908@fuzzy.cz> <52EE21D1.2080804@vmware.com> <52EED0FC.2060503@fuzzy.cz> <52EEF472.9020106@fuzzy.cz> In-Reply-To: Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Pg-Spam-Score: -1.9 (-) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-hackers Precedence: bulk Sender: pgsql-hackers-owner@postgresql.org On 3.2.2014 07:53, Oleg Bartunov wrote: > Tomasa, it'd be nice if you use real data in your testing. > > One very good application of gin fast-scan is dramatic performance > improvement of hstore/jsonb @> operator, see slides 57, 58 > http://www.sai.msu.su/~megera/postgres/talks/hstore-dublin-2013.pdf. > I'd like not to lost this benefit :) > > Oleg > > PS. I used data delicious-rss-1250k.gz from > http://randomwalker.info/data/delicious/ Hi Oleg, I'm working on extending the GIN testing to include this test (and I'll use it to test both for GIN and hstore-v2 patches). I do have the dataset, but I need the queries too - how did you generate the queries for your benchmark? Do you have some query generator at hand? In your Dublin talk I see just this query type select count(*) from hs where h @> 'tags=>{{term=>NYC}}'; but that seems inadequate for representative benchmark. Are there other types of queries that need to be tested / might be interesting? E.g. queries with multiple search terms etc.? regards Tommas -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers