Received: from localhost.localdomain (postgresql.org [64.49.215.8]) by localhost (Postfix) with ESMTP id 27521476C72 for ; Thu, 13 Jun 2002 09:24:51 -0400 (EDT) Received: from ashtonwoodshomes.com (unknown [216.94.125.242]) by postgresql.org (Postfix) with ESMTP id A4182476C58 for ; Thu, 13 Jun 2002 09:21:17 -0400 (EDT) Received: from greatgulfhomes.com. (IDENT:root@[216.191.203.109]) by ashtonwoodshomes.com (8.11.6/8.11.6) with ESMTP id g5DDIfj31095 for ; Thu, 13 Jun 2002 09:18:41 -0400 Received: from terrynew2 (firewall.development.greatgulfhomes.com [216.191.203.106]) by greatgulfhomes.com. (8.11.6/8.11.6) with SMTP id g5DDIjo25333 for ; Thu, 13 Jun 2002 09:18:45 -0400 From: terry@greatgulfhomes.com To: "Postgres (E-mail)" Subject: COPY optimization issue Date: Thu, 13 Jun 2002 09:15:26 -0400 Message-ID: <003901c212dc$627a9120$2766f30a@development.greatgulfhomes.com> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit X-Priority: 3 (Normal) X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook 8.5, Build 4.71.2173.0 Importance: Normal X-MimeOLE: Produced By Microsoft MimeOLE V5.00.2615.200 X-Archive-Number: 200206/16 X-Sequence-Number: 1391 My postgres database does a nightly sync with a Legacy database by clobbering a postgres table with data from a CSV. I currently just use the COPY command, but with over 800,000 records, this takes quite some time. Is there a faster way? eg I notice that any validation failure of ANY records causes the entire copy to roll back. Is this begin/commit action wrapped around the copy costing me CPU cycles? And if so, can I turn it off, or is there a better way then using copy? Note: I do nightly vacuum's so deleted tuples is not the issue, I don't think. Thanks Terry Fielder Network Engineer Great Gulf Homes / Ashton Woods Homes terry@greatgulfhomes.com