Received: from localhost (unknown [200.46.204.182]) by postgresql.org (Postfix) with ESMTP id 7F37B2E2E6E for ; Sat, 15 Dec 2007 00:34:45 -0400 (AST) Received: from postgresql.org ([200.46.204.71]) by localhost (mx1.hub.org [200.46.204.182]) (amavisd-maia, port 10024) with ESMTP id 11009-03 for ; Sat, 15 Dec 2007 00:34:40 -0400 (AST) Received: from davinci.ethosmedia.com (unknown [209.128.84.226]) by postgresql.org (Postfix) with ESMTP id 959072E0127 for ; Sat, 15 Dec 2007 00:34:40 -0400 (AST) X-EthosMedia-Virus-Scanned: no infections found Received: from [63.195.55.98] (account josh@agliodbs.com HELO [192.168.2.3]) by davinci.ethosmedia.com (CommuniGate Pro SMTP 4.1.8) with ESMTP id 14331424; Fri, 14 Dec 2007 20:39:19 -0800 From: Josh Berkus Organization: PostgreSQL @ Sun To: Tom Lane Subject: Re: VLDB Features Date: Fri, 14 Dec 2007 20:34:57 -0800 User-Agent: KMail/1.8.2 Cc: Neil Conway , Hannu Krosing , pgsql-hackers@postgresql.org, Simon Riggs References: <1197371508.4255.1327.camel@ebony.site> <1197677930.1536.18.camel@dell.linuxdev.us.dell.com> <16876.1197680636@sss.pgh.pa.us> In-Reply-To: <16876.1197680636@sss.pgh.pa.us> MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200712142034.57808.josh@agliodbs.com> X-Virus-Scanned: Maia Mailguard 1.0.1 X-Archive-Number: 200712/580 X-Sequence-Number: 111869 Tom, > I think such an approach is doomed to hopeless unreliability. There is > no concept of an error that doesn't require a transaction abort in the > system now, and that doesn't seem to me like something that can be > successfully bolted on after the fact. Also, there's a lot of > bookkeeping (eg buffer pins) that has to be cleaned up regardless of the > exact nature of the error, and all those mechanisms are hung off > transactions. There's no way we can do a transactionless load, then? I'm thinking of the load-into-new-partition which is a single pass/fail operation. Would ignoring individual row errors in for this case still cause these kinds of problems? -- Josh Berkus PostgreSQL @ Sun San Francisco