pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Henrik Thostrup Jensen <htj@nordu.net>
To: Jeff Janes <jeff.janes@gmail.com>
To: Emre Hasegeli <emre@hasegeli.com>
To: pgsql-performance <pgsql-performance@postgresql.org>
Subject: Re: Gist indexing performance with cidr types
Date: Thu, 27 Aug 2015 11:35:31 +0200 (CEST)
Message-ID: <alpine.DEB.2.11.1508271121170.3739@pyrite> (raw)
In-Reply-To: <CAMkU=1x=puaY9M-xk6=9TZQbWe6EBSMDQFVGNPHGRrM9f_Gc7A@mail.gmail.com>
References: <alpine.DEB.2.11.1508251504160.31004@pyrite>
	<CAE2gYzyv8zCeKUKyE8EcZcVtdTFeZaUucRjRqmtzu2jT5EQQyQ@mail.gmail.com>
	<alpine.DEB.2.11.1508260940060.35330@pyrite>
	<alpine.DEB.2.11.1508261031400.35330@pyrite>
	<CAE2gYzxh0SVZe=nOsaLqfnNWKAi_HvDn4s+-J-co9aYwcw71Vw@mail.gmail.com>
	<alpine.DEB.2.11.1508261245250.35330@pyrite>
	<CAMkU=1x=puaY9M-xk6=9TZQbWe6EBSMDQFVGNPHGRrM9f_Gc7A@mail.gmail.com>
List-Unsubscribe:  <mailto:majordomo@postgresql.org?body=unsub%20pgsql-performance>

On Wed, 26 Aug 2015, Jeff Janes wrote:

> Any chance you can share the actual underlying data?

Sure. I added a snapshot to the repo:
https://github.com/job/irrexplorer/blob/master/data/irrexplorer_dump.sql.gz?raw=true

> I noticed it wasn't on github, but is that because it is proprietary, or
> just because you don't think it is interesting?

I hoped it wouldn't be this complicated :-).

BGP and IRR data is (mostly) public, but it changes constantly, so there 
is little sense in putting in the repo, as it is not the authorative 
source (we have a script to boostrap with instead).


> If you loop over the 732 rows yourself, issuing the simple query against each retrieved constant value:
> 
> explain (analyze,buffers) select routes.route from routes where route && $1
> 
> Does each one take about the same amount of time, or are there some outlier values which take much more time than the others?

I wrote a small script to try this out. It queries for each route 20 times 
to try and suppress the worst noise. I've sorted the results by time and 
put it here: https://gist.github.com/htj/1817883f92a9cb17a4f8
(ignore the ntp timing issue causing a negative value)

Some observations:

- v6 is faster than v4 which is expected.

- The slowest prefixes by all seem to start bits '11'.
   However it is only by a factor of 1.5x which is not really significant


     Best regards, Henrik

  Henrik Thostrup Jensen <htj at nordu.net>
  Software Developer, NORDUnet




-- 
Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-performance



view thread (12+ messages)  latest in thread

Message-ID: <alpine.DEB.2.11.1508271121170.3739@pyrite>
Permalink:  ../alpine.DEB.2.11.1508271121170.3739@pyrite/
Also on:    postgresql.org/message-id/alpine.DEB.2.11.1508271121170.3739@pyrite

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: htj@nordu.net, jeff.janes@gmail.com, emre@hasegeli.com
  Subject: Re: Gist indexing performance with cidr types
  In-Reply-To: <alpine.DEB.2.11.1508271121170.3739@pyrite>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox