pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Mischa Sandberg <mischa.sandberg@telus.net>
To: Markus Schaber <schabi@logix-tt.com>
Cc: pgsql-perform <pgsql-performance@postgresql.org>
Cc: pgsql-hackers@postgresql.org
Subject: Re: [PERFORM] Bad n_distinct estimation; hacks suggested?
Date: Tue,  3 May 2005 14:33:10 -0700
Message-ID: <1115155990.4277ee16aba34@webmail.telus.net> (raw)
In-Reply-To: <4277774F.7040205@logix-tt.com>
References: <200504191209.05181.josh@agliodbs.com>
	<1114580284.426f253cc0087@webmail.telus.net>
	<426F9703.4010108@dunslane.net>
	<200504270825.17550.josh@agliodbs.com>
	<4277774F.7040205@logix-tt.com>

Quoting Markus Schaber <schabi@logix-tt.com>:

> Hi, Josh,
> 
> Josh Berkus wrote:
> 
> > Yes, actually.   We need 3 different estimation methods:
> > 1 for tables where we can sample a large % of pages (say, >= 0.1)
> > 1 for tables where we sample a small % of pages but are "easily
> estimated"
> > 1 for tables which are not easily estimated by we can't afford to
> sample a 
> > large % of pages.
> > 
> > If we're doing sampling-based estimation, I really don't want
> people to lose 
> > sight of the fact that page-based random sampling is much less
> expensive than 
> > row-based random sampling.   We should really be focusing on
> methods which 
> > are page-based.

Okay, although given the track record of page-based sampling for
n-distinct, it's a bit like looking for your keys under the streetlight,
rather than in the alley where you dropped them :-)

How about applying the distinct-sampling filter on a small extra data
stream to the stats collector? 

-- 
Engineers think equations approximate reality.
Physicists think reality approximates the equations.
Mathematicians never make the connection.




view thread (53+ messages)  latest in thread

Message-ID: <1115155990.4277ee16aba34@webmail.telus.net>
Permalink:  ../1115155990.4277ee16aba34@webmail.telus.net/
Also on:    postgresql.org/message-id/1115155990.4277ee16aba34@webmail.telus.net

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: mischa.sandberg@telus.net, schabi@logix-tt.com, pgsql-hackers@postgresql.org
  Subject: Re: [PERFORM] Bad n_distinct estimation; hacks suggested?
  In-Reply-To: <1115155990.4277ee16aba34@webmail.telus.net>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox