Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1oxvr5-0001dh-Ok for psycopg@arkaria.postgresql.org; Wed, 23 Nov 2022 19:56:23 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1oxvr4-0004qN-3u for psycopg@arkaria.postgresql.org; Wed, 23 Nov 2022 19:56:22 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1oxvr3-0004qE-Rn for psycopg@lists.postgresql.org; Wed, 23 Nov 2022 19:56:21 +0000 Received: from mail-vs1-xe29.google.com ([2607:f8b0:4864:20::e29]) by makus.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.92) (envelope-from ) id 1oxvr1-00008R-5Y for psycopg@lists.postgresql.org; Wed, 23 Nov 2022 19:56:20 +0000 Received: by mail-vs1-xe29.google.com with SMTP id p4so18482160vsa.11 for ; Wed, 23 Nov 2022 11:56:19 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=Ztj+DYK+fCnC1IsoXh5iKIcO0kJwBPhkwj8o9LHMuRY=; b=fY1G5sRAbX/Sjc8NlQ3m6+TV/p+0lIfzz0b5FZFNvzt6W4fp4ZkTw/psFEHNB0uFFo l1RTtgsIzUSNwLEUx/jTaDnywR8GDRlY9uqGqngDUA+DD9yfQWU51YJlVTwsFAM7hbs8 MMoJk1TUKfNTu8wV8BemjQXFdRMOb9BTUs+ppKmANJzarOvT3AoGwQ0a+skNk9Vn97iU oeQS6Un+opTzeGuJ++k1Kd66doxQf9KdKr2DPG6hzrAMZhRexw0Oyzbwd/wi63GsfGfs kdP+6h1y6XMLnefF+5Mak/oqe9Zi4l+A3ZAfVGljiHvjSoANV4CVdPRQ8J5Js+xUeRfB tJfw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=Ztj+DYK+fCnC1IsoXh5iKIcO0kJwBPhkwj8o9LHMuRY=; b=CZDsuG2XpEqI2e/1wbikrXG2x8BXsw2UmCf+2JgMdjtPWLmhkxtmet5uee9yybUX1b 1vaBtm0iKiW0SE9OPcMfXR6NzeTO1dPyddWwfeP/8bwn7UBd4WssxIYOW5mMQF9KZ4LM Yp9dU/9VtEbi42XgGIJPzr/U6IYc28JYcULC2r8cYPpW3gEiiNiVH/0uljXJLpEtl97A zNuV0EPdFs78/s/GACme4i/OqmYULeTvvVQ18BeEwfsg2za5vo7Djw2bsaXO1N/ShY+Z EKbC8F3H9oMQOmtjdim11ttH6+kEbdQ6N+cSgoZdslYlAaIGHvPxPZ++K0CEs6MjxcdB 4uEw== X-Gm-Message-State: ANoB5pl1BUCLoUXijOAxQApIbfu736leuWTkFp1njmeZOai2cDEzWIdQ 0e1poFk8qAfjb9qYF7LXDAysHV0O4ytvwoSxOnw= X-Google-Smtp-Source: AA0mqf6cRLpQxRl19RnLzE4POsoODxsjBPT7G5xsN/PeFcZPrS/azsMWXYxUwCyF2RFBRMV9JV/hnmU1GYZTFwcSAic= X-Received: by 2002:a67:e3d3:0:b0:3aa:1ba6:cbb1 with SMTP id k19-20020a67e3d3000000b003aa1ba6cbb1mr5866911vsm.75.1669233378030; Wed, 23 Nov 2022 11:56:18 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Vladimir Ryabtsev Date: Wed, 23 Nov 2022 11:56:07 -0800 Message-ID: Subject: Re: Parquet support To: Daniele Varrazzo Cc: Christopher Bader , psycopg@lists.postgresql.org Content-Type: multipart/alternative; boundary="0000000000008b79dd05ee28ae44" List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk --0000000000008b79dd05ee28ae44 Content-Type: text/plain; charset="UTF-8" Just curious folks, what are your thoughts about the scope of that potential support? What is the use case? Is it loading data from Parquet to Postgres (and back)? Why is the combination with Python modules like pyarrow not enough? Regards, --VR On Wed, 23 Nov 2022 at 10:56, Daniele Varrazzo wrote: > On Wed, 23 Nov 2022 at 19:49, Christopher Bader > wrote: > > > > Does psycopg support parquet as an input format? > > No, not yet. > > I had some conversation in the past around parquet input/output: it is > a major project which I would like to either develop or see developed, > but at the moment I don't have the several months required to do the > former, and nobody has volunteered for the latter. > > Cheers > > -- Daniele > > > --0000000000008b79dd05ee28ae44 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Just curious folks, what are your thoughts about the scope= of that potential support? What is the use case? Is it loading data from P= arquet to Postgres (and back)?=C2=A0Why is the combination with Python modu= les like pyarrow not enough?

Regards,
--VR

On Wed, 23 Nov 2022 at 10:56, Daniele Varrazzo <daniele.varrazzo@gmail.com> wrote:
=
On Wed, 23 Nov 2022 at 19= :49, Christopher Bader <cbader@zscaler.com> wrote:
>
> Does psycopg support parquet as an input format?

No, not yet.

I had some conversation in the past around parquet input/output: it is
a major project which I would like to either develop or see developed,
but at the moment I don't have the several months required to do the former, and nobody has volunteered for the latter.

Cheers

-- Daniele


--0000000000008b79dd05ee28ae44--