MIME-Version: 1.0
From: Sushrut Shivaswamy <sushrut.shivaswamy@gmail.com>
Date: Sat, 8 Jun 2024 20:29:16 +0530
Message-ID: <CAH5mb98zLdXV2wbizeaW2FgckqciMct4DVRAz+V96ctqXimYZg@mail.gmail.com>
Subject: Columnar Format Export in Postgres
To: pgsql-general@lists.postgresql.org
Content-Type: multipart/alternative; boundary="0000000000009c07fc061a622926"
Archived-At: <https://www.postgresql.org/message-id/CAH5mb98zLdXV2wbizeaW2FgckqciMct4DVRAz%2BV96ctqXimYZg%40mail.gmail.com>
Precedence: bulk

--0000000000009c07fc061a622926
Content-Type: text/plain; charset="UTF-8"

Hey Postgres team,

I have been working on adding support for columnar format export to
Postgres to speed up analytics queries.
I've created an extension that achieves this functionality here
<https://github.com/sushrut141/pg_analytica>.

I"m looking to improve the performance of this extension to enable drop-in
analytics support for Postgres. Some immediate improvements I have in mind
are:
 - Reduce memory consumption when exporting table data to columnar format
 - Create a native planner / execution hook that can read columnar data.

It would be very helpful if you could take a look and suggest improvements
to the extension.
Hopefully, this extension can be shipped by default with postgres at some
point in the future.

Thanks,
Sushrut

--0000000000009c07fc061a622926
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Hey Postgres team,<div><br></div><div>I have been working =
on adding support for columnar format export to Postgres to speed up analyt=
ics queries.</div><div>I&#39;ve created an extension that achieves this fun=
ctionality <a href=3D"https://github.com/sushrut141/pg_analytica">here</a>.=
</div><div><br></div><div>I&quot;m looking to improve the performance=C2=A0=
of this extension to enable drop-in analytics support for Postgres. Some im=
mediate improvements I have in mind are:</div><div>=C2=A0- Reduce memory co=
nsumption when exporting table data to columnar format</div><div>=C2=A0- Cr=
eate a native planner / execution hook that can read columnar data.</div><d=
iv><br></div><div>It would be very helpful if you could take a look and sug=
gest improvements to the extension.</div><div>Hopefully, this extension can=
 be shipped by default with postgres at some point in the future.</div><div=
><br></div><div>Thanks,</div><div>Sushrut</div></div>

--0000000000009c07fc061a622926--