public inbox for [email protected]  

help / color / mirror / Atom feed

From: Bykov Ivan <[email protected]>
To: Andy Fan <[email protected]>
Cc: [email protected] <[email protected]>
Subject: RE: [PoC] Partition path cache
Date: Tue, 29 Oct 2024 06:27:25 +0000
Message-ID: <[email protected]> (raw)
In-Reply-To: <[email protected]>
References: <[email protected]>
	<[email protected]>

Hello

> This sounds like an interesting idea, I like it because it omit the needs for "global statistics" effort for partitioned table since it just use the first partition it knows. Of couse it has its drawback that "first"
> partition can't represent other partitions.

This method uses global statistics for all partitions. 
The cache uses standard path building functions (it calculates selectivity for path), but it avoids calling all of them for the second and later partitions in a group.

The concept is similar to the GEQO method used for joins.
We skip creating some path variants if building all paths would take too long.

> One of the Arguments of this patch might be "What if other partitions have a pretty different statistics from the first partition?". If I were you, I might check all the used statistics on this stage and try to find out a similar algorithms to > prove that the best path would be similar too. This can happens once when the statistics is gathered. However this might be not easy.

Yes, maybe we can split partitions by groups not only by available index lists but also by some statistical property ranges.

--
Best Regards
Ivan Bykov

view thread (4+ messages)

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: [email protected]
  Cc: [email protected], [email protected]
  Subject: RE: [PoC] Partition path cache
  In-Reply-To: <[email protected]>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox