Received: from localhost (unknown [200.46.204.183])
	by postgresql.org (Postfix) with ESMTP id 92ACF2E0358
	for <pgsql-hackers-postgresql.org@postgresql.org>;
	Sun, 16 Dec 2007 02:07:54 -0400 (AST)
Received: from postgresql.org ([200.46.204.71])
	by localhost (mx1.hub.org [200.46.204.183]) (amavisd-maia, port 10024)
	with ESMTP id 23808-03 for
	<pgsql-hackers-postgresql.org@postgresql.org>;
	Sun, 16 Dec 2007 02:07:51 -0400 (AST)
Received: from mailbox.samurai.com (mailbox.samurai.com [205.207.28.82])
	by postgresql.org (Postfix) with ESMTP id EC1D42E0150
	for <pgsql-hackers@postgresql.org>;
	Sun, 16 Dec 2007 02:07:50 -0400 (AST)
Received: from localhost (mailbox.samurai.com [205.207.28.82])
	by mailbox.samurai.com (Postfix) with ESMTP id 3515C61D68;
	Sun, 16 Dec 2007 01:07:50 -0500 (EST)
X-Virus-Scanned: by amavisd-new at mailbox.samurai.com
Received: from mailbox.samurai.com ([205.207.28.82])
	by localhost (mailbox.samurai.com [205.207.28.82]) (amavisd-new,
	port 10024)
	with LMTP id i9A1CN0+xoQl; Sun, 16 Dec 2007 01:07:47 -0500 (EST)
Received: from [192.168.1.132] (adsl-75-61-107-201.dsl.pltn13.sbcglobal.net
	[75.61.107.201])
	(using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits))
	(No client certificate requested)
	by mailbox.samurai.com (Postfix) with ESMTP id 78E7E61D5B;
	Sun, 16 Dec 2007 01:07:47 -0500 (EST)
Subject: Re: VLDB Features
From: Neil Conway <neilc@samurai.com>
To: Greg Smith <gsmith@gregsmith.com>
Cc: Josh Berkus <josh@agliodbs.com>, pgsql-hackers@postgresql.org
In-Reply-To: <Pine.GSO.4.64.0712111845220.21402@westnet.com>
References: <1197371508.4255.1327.camel@ebony.site>
	<200712111053.11178.josh@agliodbs.com>
	<Pine.GSO.4.64.0712111845220.21402@westnet.com>
Content-Type: text/plain
Date: Sat, 15 Dec 2007 22:07:46 -0800
Message-Id: <1197785266.6164.7.camel@goldbach>
Mime-Version: 1.0
X-Mailer: Evolution 2.12.1 
Content-Transfer-Encoding: 7bit
X-Virus-Scanned: Maia Mailguard 1.0.1
X-Archive-Number: 200712/604
X-Sequence-Number: 111893

On Tue, 2007-12-11 at 19:11 -0500, Greg Smith wrote:
> I'm curious what you feel is missing that pgloader doesn't fill that 
> requirement:  http://pgfoundry.org/projects/pgloader/

For complicated ETL, I agree that using an external tool makes the most
sense. But I think there is still merit in adding support to COPY for
the simple case of trying to load a data file that has some corrupted,
invalid or duplicate records.

-Neil