public inbox for [email protected]
help / color / mirror / Atom feedFrom: Sutou Kouhei <[email protected]>
To: [email protected]
Cc: [email protected]
Subject: Re: Columnar format export in Postgres
Date: Thu, 13 Jun 2024 09:21:34 +0900 (JST)
Message-ID: <[email protected]> (raw)
In-Reply-To: <CAH5mb9_YW76_0xBU2T4C7HF33b+b2w3QBtV50_ZZMy8SA8ChjA@mail.gmail.com>
References: <CAH5mb9_YW76_0xBU2T4C7HF33b+b2w3QBtV50_ZZMy8SA8ChjA@mail.gmail.com>
Hi,
In <CAH5mb9_YW76_0xBU2T4C7HF33b+b2w3QBtV50_ZZMy8SA8ChjA@mail.gmail.com>
"Columnar format export in Postgres" on Wed, 12 Jun 2024 22:26:30 +0530,
Sushrut Shivaswamy <[email protected]> wrote:
> I have been working on adding support for columnar format export to
> Postgres to speed up analytics queries.
FYI: I'm proposing making COPY format extendable:
* https://www.postgresql.org/message-id/flat/[email protected]
* https://commitfest.postgresql.org/48/4681/
If it's accepted, we can implement extensions for COPY
FORMAT arrow and COPY FORMAT parquet. With these extensions,
we can use file_fdw to read Apache Arrow and Apache Parquet
file because file_fdw is based on COPY FROM:
https://www.postgresql.org/docs/current/file-fdw.html
If you're interested in this proposal, you can review the
latest proposed patch set to proceed this proposal.
> - Reduce memory consumption when exporting table data to columnar format
The above COPY support will help this.
Thanks,
--
kou
view thread (3+ messages)
reply
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: [email protected]
Cc: [email protected], [email protected], [email protected]
Subject: Re: Columnar format export in Postgres
In-Reply-To: <[email protected]>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox