Received: from localhost (unknown [200.46.204.184]) by postgresql.org (Postfix) with ESMTP id 275192E2E5B for ; Wed, 6 Feb 2008 11:40:27 -0400 (AST) Received: from postgresql.org ([200.46.204.71]) by localhost (mx1.hub.org [200.46.204.184]) (amavisd-maia, port 10024) with ESMTP id 16418-06 for ; Wed, 6 Feb 2008 11:40:13 -0400 (AST) Received: from westnet.com (westnet.com [216.187.52.2]) by postgresql.org (Postfix) with ESMTP id 655C02E3A97 for ; Wed, 6 Feb 2008 11:40:22 -0400 (AST) Received: from westnet.com (localhost [127.0.0.1]) by westnet.com (8.14.0/8.14.0) with ESMTP id m16FeKjv020705 for ; Wed, 6 Feb 2008 10:40:20 -0500 (EST) Received: from localhost (gsmith@localhost) by westnet.com (8.14.0/8.13.2/Submit) with ESMTP id m16FeKJX020700 for ; Wed, 6 Feb 2008 10:40:20 -0500 (EST) X-Authentication-Warning: westnet.com: gsmith owned process doing -bs Date: Wed, 6 Feb 2008 10:40:20 -0500 (EST) From: Greg Smith X-X-Sender: gsmith@westnet.com To: pgsql-performance@postgresql.org Subject: Re: Benchmark Data requested In-Reply-To: <200802061129.44482.dfontaine@hi-media.com> Message-ID: References: <1202150236.4252.521.camel@ebony.site> <1202248803.4252.895.camel@ebony.site> <200802061129.44482.dfontaine@hi-media.com> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed X-Virus-Scanned: Maia Mailguard 1.0.1 X-Archive-Number: 200802/71 X-Sequence-Number: 28613 On Wed, 6 Feb 2008, Dimitri Fontaine wrote: > Did you compare to COPY or \copy? COPY. If you're loading a TB, if you're smart it's going onto the server itself if it all possible and loading directly from there. Would probably get a closer comparision against psql \copy, but recognize you're always going to be compared against the best server-side copy method available. > Do you want to test pgloader again with Marko psycopgwrapper code to see if > this helps? Wouldn't have time myself for at least a month (probably not until after the East convention) so don't go making commits on my behalf. > Maybe at the end of this PostgreSQL backend code will be smarter than pgloader > (wrt error handling and data massaging) and we'll be able to drop the > project There are way too many data massaging cases I never expect the backend will handle that pgloader does a great job of right now, and I think there will always be a niche for a tool like this. -- * Greg Smith gsmith@gregsmith.com http://www.gregsmith.com Baltimore, MD