Received: from localhost (mx1.hub.org [200.46.208.251]) by postgresql.org (Postfix) with ESMTP id 772F59FB35B for ; Thu, 28 Sep 2006 15:46:06 -0300 (ADT) Received: from postgresql.org ([200.46.204.71]) by localhost (mx1.hub.org [200.46.208.251]) (amavisd-new, port 10024) with ESMTP id 86563-08 for ; Thu, 28 Sep 2006 15:45:40 -0300 (ADT) X-Greylist: from auto-whitelisted by SQLgrey- Received: from noel.decibel.org (noel.decibel.org [67.100.216.10]) by postgresql.org (Postfix) with ESMTP id AB7719FB35F for ; Thu, 28 Sep 2006 15:45:39 -0300 (ADT) Received: by noel.decibel.org (Postfix, from userid 1001) id BDB5E56440; Thu, 28 Sep 2006 13:45:38 -0500 (CDT) Received: (hashcash-sendmail, from uid 1001); Thu, 28 Sep 2006 13:45:38 -0500 Date: Thu, 28 Sep 2006 13:45:38 -0500 From: "Jim C. Nasby" To: Carlo Stonebanks Cc: pgsql-performance@postgresql.org Subject: Re: Performace Optimization for Dummies Message-ID: <20060928184538.GV34238@nasby.net> References: Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Operating-System: FreeBSD 6.0-RELEASE-p4 amd64 X-Distributed: Join the Effort! http://www.distributed.net User-Agent: Mutt/1.5.11 X-Hashcash: 1:20:060928:stonec.register@sympatico.ca::mENSjW8U8xORQSZw:000000000 0000000000000000000000001gNj X-Hashcash: 1:20:060928:pgsql-performance@postgresql.org::kO0efgkiTEtF1L7t:00000 0000000000000000000000002hlW X-Virus-Scanned: Maia Mailguard 1.0.1 X-Spam-Status: No, hits=0.044 tagged_above=0 required=5 tests=AWL X-Spam-Level: X-Archive-Number: 200609/396 X-Sequence-Number: 21082 On Thu, Sep 28, 2006 at 01:53:22PM -0400, Carlo Stonebanks wrote: > > are you using the 'copy' interface? > > Straightforward inserts - the import data has to transformed, normalised and > de-duped by the import program. I imagine the copy interface is for more > straightforward data importing. These are - buy necessity - single row > inserts. BTW, stuff like de-duping is something you really want the database - not an external program - to be doing. Think about loading the data into a temporary table and then working on it from there. -- Jim Nasby jim@nasby.net EnterpriseDB http://enterprisedb.com 512.569.9461 (cell)