pg.ddx.io  pgsql-sql@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Mark Fenbers <Mark.Fenbers@noaa.gov>
To: pgsql-sql@postgresql.org
Subject: import ignoring duplicates
Date: Sun, 16 May 2010 14:38:01 -0400
Message-ID: <4BF03B89.9020908@noaa.gov> (raw)

I am using psql's \copy command to add records to a database from a 
file.  The file has over 100,000 lines.  Occasionally, there is a 
duplicate, and the import ceases and an internal rollback is performed.  
In other words, no data is imported even if the first error occurs near 
the end of the file.

I am looking for an option/switch to tell psql (or the \copy command) to 
skip over any duplicate key constraint viloations and continue to load 
any data that doesn't violate a duplicate key constraint.  Is there such 
an option?

Mark

Attachments:

Mark_Fenbers.vcf (text/x-vcard, 400B) download begin:vcard fn:Mark Fenbers n:Fenbers;Mark org:National Weather Service;Ohio River Forecast Center adr:;;1901 South OH-134;Wilmington;OH;45177-1908;USA email;internet:Mark.Fenbers@noaa.gov title:Sr. HAS Meteorologist tel;work:937-383-0430 tel;fax:937-383-0033 note:"HAS" is an acronym for Hydrometeorological Analysis and Support x-mozilla-html:TRUE url:http://weather.gov/ohrfc version:2.1 end:vcard

view thread (3+ messages)  latest in thread

Message-ID: <4BF03B89.9020908@noaa.gov>
Permalink:  ../4BF03B89.9020908@noaa.gov/
Also on:    postgresql.org/message-id/4BF03B89.9020908@noaa.gov

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-sql@postgresql.org
  Cc: Mark.Fenbers@noaa.gov
  Subject: Re: import ignoring duplicates
  In-Reply-To: <4BF03B89.9020908@noaa.gov>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox