pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Dave Tenny <tenny@attbi.com>
To: Bruno Wolff III <bruno@wolff.to>
Cc: Shridhar Daithankar <shridhar_daithankar@persistent.co.in>
Cc: pgsql-performance@postgresql.org
Subject: Re: IN list processing performance (yet again)
Date: Wed, 28 May 2003 16:13:17 -0400
Message-ID: <3ED5185D.2000102@attbi.com> (raw)
In-Reply-To: <20030528184150.GB6118@wolff.to>
References: <3ED4B0E5.3050703@attbi.com>
	<200305281846.38928.shridhar_daithankar@nospam.persistent.co.in>
	<3ED4F8B6.7030905@attbi.com>
	<20030528184150.GB6118@wolff.to>

Bruno Wolff III wrote:

>On Wed, May 28, 2003 at 13:58:14 -0400,
>  Dave Tenny <tenny@attbi.com> wrote:
>  
>
>>A join isn't an option, these elements come a a selection of entity ID's 
>>that are specific to some client context.
>>Some other people suggested joins too. 
>>    
>>
>
>You can union the values together and then join (or use where exists) with the
>result. This may not be faster and you may not be able to union several
>thousand selects together in a single statement. But it shouldn't be too
>much work to test it out.
>  
>
I assume you mean something like:

test=# select million.id, million.val from million, (select 10000 as a 
union select 20000 as a) t2 where million.id = t2.a;
  id   |  val
-------+-------
 10000 |     0
 20000 | 10000
(2 rows)

Ouch!  That's deviant.   Haven't tried it yet and I cringe at the 
thought of it, but I might take a run at it.  However that's going to
run up the buffer space quickly.  That was one of my as yet unsnaswered 
questions, what is the pragmatic buffer size limit
for queries?

I'm /really/ hoping we'll come up with something better, like an 
understanding of why IN lists are non-linear in the first
place when the column is indexed, and whether it's fixable through some 
other means or whether it's a bug that should be fixed.

After all, I'm trying to support multiple databases, and other databases 
kick butt on this.  It's just postgresql that's
having difficulty.

(Btw, I've also tried statement batching, but that's a lose for now, at 
least with the current JDBC drivers and 7.3.2).

view thread (23+ messages)  latest in thread

Message-ID: <3ED5185D.2000102@attbi.com>
Permalink:  ../3ED5185D.2000102@attbi.com/
Also on:    postgresql.org/message-id/3ED5185D.2000102@attbi.com

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients from your mail client; the link fills in
  the headers below: reply via email
  Some clients, webmail especially, drop In-Reply-To and References from
  a link, and the reply then starts a new thread: use the mbox below.

  To: pgsql-performance@postgresql.org
  Cc: tenny@attbi.com, bruno@wolff.to, shridhar_daithankar@persistent.co.in
  Subject: Re: IN list processing performance (yet again)
  In-Reply-To: <3ED5185D.2000102@attbi.com>
  References: <3ED4B0E5.3050703@attbi.com> <200305281846.38928.shridhar_daithankar@nospam.persistent.co.in> <3ED4F8B6.7030905@attbi.com> <20030528184150.GB6118@wolff.to> <3ED5185D.2000102@attbi.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox