public inbox for [email protected]  

help / color / mirror / Atom feed

From: Daniele Varrazzo <[email protected]>
To: Vladimir Ryabtsev <[email protected]>
Cc: Christopher Bader <[email protected]>
Cc: [email protected]
Subject: Re: Parquet support
Date: Wed, 23 Nov 2022 21:00:35 +0100
Message-ID: <CA+mi_8b-c8Q4zpkd=X+mqRivscEoFmn_f1UUh-wr3UjEdD+sXg@mail.gmail.com> (raw)
In-Reply-To: <CAMqTPqnvLxiUcfOXLwBP3NsKo1OfEE8E-YhSHFUJV0GX2M9eEw@mail.gmail.com>
References: <CAKvpR7MaATqwiDYG1YyixGnUrqyjjq1z2aO3T-a6Rh82vTvcWg@mail.gmail.com>
	<CA+mi_8buxHRjeabOPWfPpg1RKvRpC2tm1Ass7uttgFvLRoRH7Q@mail.gmail.com>
	<CAMqTPqnvLxiUcfOXLwBP3NsKo1OfEE8E-YhSHFUJV0GX2M9eEw@mail.gmail.com>

On Wed, 23 Nov 2022 at 20:56, Vladimir Ryabtsev <[email protected]> wrote:
>
> Just curious folks, what are your thoughts about the scope of that potential support? What is the use case? Is it loading data from Parquet to Postgres (and back)? Why is the combination with Python modules like pyarrow not enough?

I am not an expert, but I understand that Python-Postgres roundtrip
goes via generating and parsing CSV files, whereas there is some
performance gain to be had by creating native arrow data.

-- Daniele

view thread (5+ messages)  latest in thread

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: [email protected]
  Cc: [email protected], [email protected], [email protected], [email protected]
  Subject: Re: Parquet support
  In-Reply-To: <CA+mi_8b-c8Q4zpkd=X+mqRivscEoFmn_f1UUh-wr3UjEdD+sXg@mail.gmail.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox