public inbox for [email protected]  
help / color / mirror / Atom feed
From: [email protected] <[email protected]>
To: Bruce Momjian <[email protected]>
To: Robert Haas <[email protected]>
To: Alexander Pyhalov <[email protected]>
To: Tom Lane <[email protected]>
To: PostgreSQL-development <[email protected]>
Cc: Stephen Frost <[email protected]>
Cc: Andres Freund <[email protected]>
Cc: Tomas Vondra <[email protected]>
Cc: Julien Rouhaud <[email protected]>
Cc: Daniel Gustafsson <[email protected]>
Cc: vignesh C <[email protected]>
Cc: [email protected] <[email protected]>
Subject: RE: Partial aggregates pushdown
Date: Wed, 5 Jun 2024 00:14:45 +0000
Message-ID: <TYAPR01MB3088755F2281D41F5EEF06D495F92@TYAPR01MB3088.jpnprd01.prod.outlook.com> (raw)
In-Reply-To: <[email protected]>
References: <CA+TgmoYCrtOvk2f32qQKZV=jNL35tandf2A2Dp_2F5ASuiG1BA@mail.gmail.com>
	<TYAPR01MB5514C939F39F97BC171F58FD958BA@TYAPR01MB5514.jpnprd01.prod.outlook.com>
	<CALDaNm0S5fb_8o+TtR8bXf3zOpqabOBLy0EJ3+oVzHH_dzpXvw@mail.gmail.com>
	<TYAPR01MB5514F0CBD9CD4F84A261198195562@TYAPR01MB5514.jpnprd01.prod.outlook.com>
	<[email protected]>
	<TYAPR01MB55141D18188AC86ADCE35FCB952F2@TYAPR01MB5514.jpnprd01.prod.outlook.com>
	<[email protected]>
	<[email protected]>
	<[email protected]>
	<TYAPR01MB30884F8E4D94038CD661FFEF95F02@TYAPR01MB3088.jpnprd01.prod.outlook.com>
	<[email protected]>

Hi. Bruce, Robert, Tom, Alexander, hackers.

Apologies for the late response. 
Thanks to Bruce, I had the opportunity to have individual discussions with Robert and Tom at PGConf.dev 2024.
I'm truly grateful to Bruce, Robert, and Tom for their time. 
I've attached the presentation slides used during our discussions. 
Below is a summary of our conversations. 
As my English is not perfect, there may be some misunderstandings. 
If so, I apologize and would appreciate any corrections or comments.

[Summary]
Basically, I will make the prototype as the presentation slides.
In specialty, the prototype has the following two limits.
  Limit1. The server versions of the coordinator and the worker match.
  Limit2. Supported built-in aggregate functions are a few subset
    (Ex. avg, sum, count).
    However, there are many build-in aggregate functions in which import and export functions are not necessary.
    (See p.18 in the presentation slides).
    I will support these aggregate functions.

In this prototype, It is necessary for the following requirements.
  Requirement1. Ensure the compatibility even if the server setting(Ex. encodings) of the coordinator and the worker are different. (with Tom)
  Requirement2. Consider appropriate position of the new keyword "PARTIAL_AGGREGATE". (with Robert)
    Existing patch: Before the target expression. Ex. avg(PARTIAL_AGGREGATE c1)
    Ideal: Before the aggregate function. Ex. PARTIAL_AGGREGATE avg(c1)
  Requirement3. Consider to avoid to make the new keyword "PARTIAL_AGGREGATE" become a reserved word. (with Robert)
    In the existing patch, "PARTIAL_AGGREGATE" is a reserved word.

In addition to the summary, 
I will add sufficient document and comments to the next patch as Bruce and Robert said.
And, I will fix the problem as Alexander pointed in the last week.

Sincerely yours,
Yuuki Fujii

--
Yuuki Fujii
Information Technology R&D Center Mitsubishi Electric Corporation





Attachments:

  [application/pdf] PGConfDev2024_Presentation_Aggregation_Scaleout_FDW_Sharding_20240531.pdf (305.2K, ../TYAPR01MB3088755F2281D41F5EEF06D495F92@TYAPR01MB3088.jpnprd01.prod.outlook.com/2-PGConfDev2024_Presentation_Aggregation_Scaleout_FDW_Sharding_20240531.pdf)
  download

view thread (45+ messages)  latest in thread

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: [email protected]
  Cc: [email protected], [email protected], [email protected], [email protected], [email protected], [email protected], [email protected], [email protected], [email protected], [email protected], [email protected]
  Subject: RE: Partial aggregates pushdown
  In-Reply-To: <TYAPR01MB3088755F2281D41F5EEF06D495F92@TYAPR01MB3088.jpnprd01.prod.outlook.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox