Re: Additional options for COPY from

public inbox for [email protected]  
help / color / mirror / Atom feed

From: Ron Johnson <[email protected]>
To: [email protected] <[email protected]>
Subject: Re: Additional options for COPY from
Date: Thu, 25 Sep 2025 16:08:34 -0400
Message-ID: <CANzqJaABFc15uQp=ORSw066izoe8+v9PpE4HuCUu7wtKryjiuw@mail.gmail.com> (raw)
In-Reply-To: <[email protected]>
References: <[email protected]>

On Thu, Sep 25, 2025 at 3:49 PM Bryan Sayer <[email protected]> wrote:

> Hi,
>
> I'm not sure if this is the best list to ask this (and I am very new to
> PostgreSQL) but I think more options are needed in the COPY from command,
> in order to better deal with exceptions. By exceptions I mean data not
> consistent with the format, empty rows, extra delimiters at the end of
> rows, etc.
>

PG 17 COPY has ON_ERROR.


> Is there someone or a party that deals with the details of the COPY
> command that I could discuss this with?
>
> Just for context, I am dealing with delimited data of millions of rows and
> perhaps 60 columns or so that I wish to read into tables in a Postgres 17
> database under Windows 11, with everything on local drives.
>
COPY is pretty simplistic.  3rd party CSV loaders like pgloader and
pg_bulkload exist for that reason. And there's always Python & Perl for
when your data is really dirty.

-- 
Death to <Redacted>, and butter sauce.
Don't boil me, I'm still alive.
<Redacted> lobster!

view thread (3+ messages)  latest in thread

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: [email protected]
  Cc: [email protected], [email protected]
  Subject: Re: Additional options for COPY from
  In-Reply-To: <CANzqJaABFc15uQp=ORSw066izoe8+v9PpE4HuCUu7wtKryjiuw@mail.gmail.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox