From: Mischa Sandberg <mischa.sandberg@telus.net>
To: Markus Schaber <schabi@logix-tt.com>
Cc: pgsql-perform <pgsql-performance@postgresql.org>
Cc: pgsql-hackers@postgresql.org
Subject: Re: [PERFORM] Bad n_distinct estimation; hacks suggested?
Date: Tue, 3 May 2005 14:33:10 -0700
Message-ID: <1115155990.4277ee16aba34@webmail.telus.net> (raw)
In-Reply-To: <4277774F.7040205@logix-tt.com>
References: <200504191209.05181.josh@agliodbs.com>
<1114580284.426f253cc0087@webmail.telus.net>
<426F9703.4010108@dunslane.net>
<200504270825.17550.josh@agliodbs.com>
<4277774F.7040205@logix-tt.com>
Quoting Markus Schaber <schabi@logix-tt.com>:
> Hi, Josh,
>
> Josh Berkus wrote:
>
> > Yes, actually. We need 3 different estimation methods:
> > 1 for tables where we can sample a large % of pages (say, >= 0.1)
> > 1 for tables where we sample a small % of pages but are "easily
> estimated"
> > 1 for tables which are not easily estimated by we can't afford to
> sample a
> > large % of pages.
> >
> > If we're doing sampling-based estimation, I really don't want
> people to lose
> > sight of the fact that page-based random sampling is much less
> expensive than
> > row-based random sampling. We should really be focusing on
> methods which
> > are page-based.
Okay, although given the track record of page-based sampling for
n-distinct, it's a bit like looking for your keys under the streetlight,
rather than in the alley where you dropped them :-)
How about applying the distinct-sampling filter on a small extra data
stream to the stats collector?
--
Engineers think equations approximate reality.
Physicists think reality approximates the equations.
Mathematicians never make the connection.
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-performance@postgresql.org
Cc: mischa.sandberg@telus.net, schabi@logix-tt.com, pgsql-hackers@postgresql.org
Subject: Re: [PERFORM] Bad n_distinct estimation; hacks suggested?
In-Reply-To: <1115155990.4277ee16aba34@webmail.telus.net>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox