From: Bruce Momjian <maillist@candle.pha.pa.us>
To: Stuart Rison <rison@biochemistry.ucl.ac.uk>
Cc: Tom Lane <tgl@sss.pgh.pa.us>
Cc: Daniel Lopez <ridruejo@atm9.com.dtu.dk>
Cc: pgsql-sql@hub.org
Subject: Re: [SQL] Subselect performance
Date: Tue, 21 Sep 1999 11:23:10 -0400 (EDT)
Message-ID: <199909211523.LAA11575@candle.pha.pa.us> (raw)
In-Reply-To: <Pine.LNX.4.10.9909211548510.23132-100000@bsmlx17>
> On Tue, 21 Sep 1999, Tom Lane wrote:
>
> > Daniel Lopez <ridruejo@atm9.com.dtu.dk> writes:
> > > $list = select d from c
> > > select b from a where b in ( $list )
> > > is 5 seconds
> >
> > > select b from a where b in (select d from c)
> > > is 3 minutes!! (although it should be at least as fast as a)!
> >
> > Not necessarily. Your first example is depending on the fact that
> > the "list" (number of values selected from c) is short. Try it with
> > 10000 or 100000 values from c, if you want to see the backend crash ;-)
>
> I've encoutered this sort of issue myself where I just wanted the
> sub-select to be performed once. Granted it would not work if you wanted
> to select 10000 or 100000 but what if you have a very larged table a and a
> very small table c (using the example above). As you pointed out,
> currently you're looking at 'a x c' runtime... Ugh indeed; whereas just
> executing the subselect once and cut and pasting that you have an order of
> 'a' runtime...
OK, I am jumping in here, because it seems we have some strange
behavour.
The only subselect problem I know of is that:
select b from a where b in (select d from c)
will execute the subquery just once, but will do a sequential scan for
of the subquery results for each row of 'a' looking for 'b' that is in
the set of result rows.
This is a major performance problem, one that is known, and one that
should be fixed, but I am sounding like a broken record.
The solution is to allow the subquery results to be mergejoined(sorted),
or hashjoined with the outer query.
Am I correct, or is something else going on here?
--
Bruce Momjian | http://www.op.net/~candle
maillist@candle.pha.pa.us | (610) 853-3000
+ If your life is a hard drive, | 830 Blythe Avenue
+ Christ can be your backup. | Drexel Hill, Pennsylvania 19026
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients from your mail client; the link fills in
the headers below: reply via email
Some clients, webmail especially, drop In-Reply-To and References from
a link, and the reply then starts a new thread: use the mbox below.
To: pgsql-sql@postgresql.org
Cc: maillist@candle.pha.pa.us, rison@biochemistry.ucl.ac.uk, tgl@sss.pgh.pa.us, ridruejo@atm9.com.dtu.dk, pgsql-sql@hub.org
Subject: Re: [SQL] Subselect performance
In-Reply-To: <199909211523.LAA11575@candle.pha.pa.us>
References: <Pine.LNX.4.10.9909211548510.23132-100000@bsmlx17> <199909211523.LAA11575@candle.pha.pa.us>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox