pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Ken Geis <kgeis@speakeasy.org>
To: Richard Huxton <dev@archonet.com>
To: pgsql-performance@postgresql.org
Subject: Re: plan problem
Date: Wed, 07 Apr 2004 02:03:27 -0700
Message-ID: <4073C3DF.2070307@speakeasy.org> (raw)
In-Reply-To: <200404070938.11482.dev@archonet.com>
References: <40731252.2030002@speakeasy.org>
	<200404070938.11482.dev@archonet.com>

Richard Huxton wrote:
> On Tuesday 06 April 2004 21:25, Ken Geis wrote:
> 
>>I am trying to find an efficient way to draw a random sample from a
>>complex query.  I also want it to be easy to use within my application.
>>
>>So I've defined a view that encapsulates the query.  The id in the
>>"driving" table is exposed, and I run a query like:
>>
>>select * from stats_record_view
>>  where id in (select id from driver_stats
>>                order by random()
>>                limit 30000);
> 
> 
> How about a join?
> 
> SELECT s.*
> FROM
> stats_record_view s
> JOIN
> (SELECT id FROM driver_stats ORDER BY random() LIMIT 30000) AS r
> ON s.id = r.id;

Yes, I tried this too after I sent the first mail, and this was somewhat 
better.  I ended up adding a random column to the driving table, putting 
an index on it, and exposing that column in the view.  Now I can say

SELECT * FROM stats_record_view WHERE random < 0.093;

For my application, it's OK if the same sample is picked time after time 
and it may change if data is added.

...
> Also worth checking the various list archives - this has come up in the past, 
> but some time ago.

There are some messages in the archives about how to get a random 
sample.  I know how to do that, and that's not why I posted my message. 
  Are you saying that the planner behavior I spoke of is in the 
archives?  I wouldn't know what to search on to find that thread.  Does 
anyone think that the planner issue has merit to address?  Can someone 
help me figure out what code I would look at?


Ken Geis





view thread (5+ messages)  latest in thread

Message-ID: <4073C3DF.2070307@speakeasy.org>
Permalink:  ../4073C3DF.2070307@speakeasy.org/
Also on:    postgresql.org/message-id/4073C3DF.2070307@speakeasy.org

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: kgeis@speakeasy.org, dev@archonet.com
  Subject: Re: plan problem
  In-Reply-To: <4073C3DF.2070307@speakeasy.org>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox