pg.ddx.io  pgsql-sql@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Aaron Bono <postgresql@aranya.com>
To: Steve Midgley <public@misuse.org>
Cc: pgsql-sql@postgresql.org
Subject: Re: "Copy from" omit source columns?
Date: Tue, 21 Nov 2006 17:42:15 -0600
Message-ID: <bf05e51c0611211542i22c80681n4513ff2fd6fd5412@mail.gmail.com> (raw)
In-Reply-To: <20061121221911.C10D09FB26E@postgresql.org>
References: <20061121221911.C10D09FB26E@postgresql.org>

On 11/21/06, Steve Midgley <public@misuse.org> wrote:
>
> Hello,
>
> (I already fear the answer to my question is "no..") :)
>
> I am using the 'COPY FROM' SQL command (not psql \copy) to move data
> into a table from a CSV file. The source data are suitable for import
> EXCEPT there are extraneous columns of data in the source file. In
> essence, my table schema is:
>
> id, col1, col2, col4
>
> My source file schema is:
>
> col1,col2,col3,col4
>
> I'm curious if there is any way to tell "COPY" to ignore the third
> column of data? Basically I'd like to write something along the lines
> of:
>
> copy import (col1,col2,\n,col4)
> from 'c:/dev/import/source/test.csv'
> with CSV HEADER
>
> Note "\n" would indicate there there is a column in the source that
> should simply be ignored during the import. Of course, I tried this
> syntax and it didn't work. Perhaps there is another way of indicating
> that there is a "null column" in the source file that should be skipped
> during import?
>
> Any assistance in solving this problem (without having to change the
> source file) would be greatly appreciated. If I have to change the
> source file, I will, but it would greatly simplify things if I didn't
> have to..
>
> Best regards and thanks for any ideas,
>

If you are using Linux/Unix or a Mac, you could run the file through sed
first and remove the unwanted column:

cat original.csv | sed 's/^\(.*\),\(.*\),\(.*\),\(.*\)$/\1,\2,\4/' > new.csv

Of course if you have commas in the data you will have to play with the sed
command a little but this will get you started.

-- 
==================================================================
   Aaron Bono
   Aranya Software Technologies, Inc.
   http://www.aranya.com
   http://codeelixir.com
==================================================================

view thread (3+ messages)

Message-ID: <bf05e51c0611211542i22c80681n4513ff2fd6fd5412@mail.gmail.com>
Permalink:  ../bf05e51c0611211542i22c80681n4513ff2fd6fd5412@mail.gmail.com/
Also on:    postgresql.org/message-id/bf05e51c0611211542i22c80681n4513ff2fd6fd5412@mail.gmail.com

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-sql@postgresql.org
  Cc: postgresql@aranya.com, public@misuse.org
  Subject: Re: "Copy from" omit source columns?
  In-Reply-To: <bf05e51c0611211542i22c80681n4513ff2fd6fd5412@mail.gmail.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox