pg.ddx.io  pgsql-sql@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Tom Lane <tgl@sss.pgh.pa.us>
To: Saltsgaver, Scott <scottsa@aiinet.com>
Cc: 'pgsql-sql@postgreSQL.org' <pgsql-sql@postgreSQL.org>
Subject: Re: [SQL] Techniques for quickly finding words in a phrase...
Date: Fri, 11 Feb 2000 18:08:43 -0500
Message-ID: <21821.950310523@sss.pgh.pa.us> (raw)
In-Reply-To: <7283DE19D141D111AD0E00A0C95B1955024888FD@mail2.aiinet.com>
References: <7283DE19D141D111AD0E00A0C95B1955024888FD@mail2.aiinet.com>

"Saltsgaver, Scott" <scottsa@aiinet.com> writes:
> SELECT p.id, phrase FROM Phrase AS p, PhraseWords AS pw
>     WHERE
>         ((p.id = pw.id) AND word LIKE 'WAS%')
>         AND EXISTS (SELECT id FROM PhraseWords AS pw
>                 WHERE (p.id = pw.id) AND word LIKE 'WHIT%')
>         AND EXISTS (SELECT id FROM PhraseWords AS pw
>                 WHERE (p.id = pw.id) AND word LIKE 'SNOW%');

> For some reason, the select still takes > 1 minute on a fairly decent
> sized Linux box (500Mhz, 128MB ram).

Subselects are pretty inefficient in Postgres at present.  Try rewriting
it as a join:

SELECT p.id, phrase FROM Phrase AS p, PhraseWords AS pw1,
	PhraseWords AS pw2, PhraseWords AS pw3
WHERE p.id = pw1.id AND pw1.word LIKE 'WAS%'
	AND p.id = pw2.id AND pw2.word LIKE 'WHIT%'
	AND p.id = pw3.id AND pw3.word LIKE 'SNOW%';

(with the obvious adjustments depending on how many words in your
search phrase).

If you are using search phrases with more than half a dozen words,
you will probably need to enable GEQO planning to avoid spending
an unreasonable amount of time in planning the query.  (If 'explain'
itself starts to take a long time, you are seeing excessive plan time.)

			regards, tom lane



view thread (4+ messages)  latest in thread

Message-ID: <21821.950310523@sss.pgh.pa.us>
Permalink:  ../21821.950310523@sss.pgh.pa.us/
Also on:    postgresql.org/message-id/21821.950310523@sss.pgh.pa.us

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients from your mail client; the link fills in
  the headers below: reply via email
  Some clients, webmail especially, drop In-Reply-To and References from
  a link, and the reply then starts a new thread: use the mbox below.

  To: pgsql-sql@postgresql.org
  Cc: tgl@sss.pgh.pa.us, scottsa@aiinet.com
  Subject: Re: [SQL] Techniques for quickly finding words in a phrase...
  In-Reply-To: <21821.950310523@sss.pgh.pa.us>
  References: <7283DE19D141D111AD0E00A0C95B1955024888FD@mail2.aiinet.com> <21821.950310523@sss.pgh.pa.us>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox