pg.ddx.io  pgsql-sql@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Julian Scarfe <jscarfe@callnetuk.com>
To: Peter Eisentraut <peter_e@gmx.net>
Cc: Tom Lane <tgl@sss.pgh.pa.us>
Cc: pgsql-sql <pgsql-sql@postgresql.org>
Subject: Re: [SQL] DISTINCT ON: speak now or forever hold your peace
Date: Tue, 25 Jan 2000 13:23:58 +0000
Message-ID: <B4B3546E.5A80%jscarfe@callnetuk.com> (raw)
In-Reply-To: <Pine.GSO.4.02A.10001251157120.11899-100000@Val.DoCS.UU.SE>

on 25/1/00 10:59, Peter Eisentraut at e99re41@DoCS.UU.SE wrote:

> On Tue, 25 Jan 2000, Julian Scarfe wrote:

>> I use 'distinct on' to get the most recent reports for each of a group of
>> locations.  E.g.:
>> 
>> create table reports (
>> location     varchar(16),
>> report_time  datetime,
>> report_text  text);
>> 
>> select distinct on location * from reports where location ~~ 'Lond%' order by
>> location, reporttime desc;<pgsql-hackers@postgreSQL.org>
>> 
>> to get the tuples that offer the most recent reports for each of London,
>> Londonderry, Londy etc.
>> 
>> Is there an alternative?
> 
> select location, max(report_time) from reports group by location
> 
> This also has the negligible advantage that it gives you determinate
> results.

But I want report_text *too* -- that's the important bit, and it's not an
aggregate or common column in the group. So:

> Am I wrong or can DISTINCT ON not be rewritten in terms of GROUP BY in all
> cases?

I don't think so.

It has to be something like:

select * from reports as r1 where r1.report_time = (select max(report_time)
from reports as r2 where r2.location = r1.location) and r1.location ~~
'Lond%';

However, to my surprise, that's as quick as doing the 'distinct on'.


host=> explain select * from reports as r1 where r1.report_time = (select
max(report_time) from reports as r2 where r2.location = r1.location) and
r1.location ~~ 'Lond%';
NOTICE:  QUERY PLAN:

Index Scan using reports_by_location_issuetime on reports r1  (cost=186.24
size=2 width=334)
  SubPlan
    ->  Aggregate  (cost=3.62 size=0 width=0)
          ->  Index Scan using reports_by_location_report_time on reports r2
(cost=3.62 size=13 width=8)

EXPLAIN

host=> explain select distinct on location * from reports where location ~~
'Lond%' order by location, report_time desc;
NOTICE:  QUERY PLAN:

Unique  (cost=186.24 size=0 width=0)
  ->  Sort  (cost=186.24 size=0 width=0)
        ->  Index Scan using reports_by_location_issuetime on reports
(cost=186.24 size=2 width=334)

I'm surprise that the "reports_by_location_issuetime" index got used, since
it involves the issuetime field which is not the same as the report_time
field. I edited it and numerous other fields from the quoted 'create table'
for simplicity. There's also a "reports_by_location_report_time" which
indexes on, obviously, (location, report_time). Comments?

Julian Scarfe, learning...





view thread (36+ messages)  latest in thread

Message-ID: <B4B3546E.5A80%jscarfe@callnetuk.com>
Permalink:  ../B4B3546E.5A80%25jscarfe@callnetuk.com/
Also on:    postgresql.org/message-id/B4B3546E.5A80%jscarfe@callnetuk.com

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients from your mail client; the link fills in
  the headers below: reply via email
  Some clients, webmail especially, drop In-Reply-To and References from
  a link, and the reply then starts a new thread: use the mbox below.

  To: pgsql-sql@postgresql.org
  Cc: jscarfe@callnetuk.com, peter_e@gmx.net, tgl@sss.pgh.pa.us
  Subject: Re: [SQL] DISTINCT ON: speak now or forever hold your peace
  In-Reply-To: <B4B3546E.5A80%jscarfe@callnetuk.com>
  References: <Pine.GSO.4.02A.10001251157120.11899-100000@Val.DoCS.UU.SE> <B4B3546E.5A80%jscarfe@callnetuk.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox