pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Greg Smith <gsmith@gregsmith.com>
To: pgsql-performance@postgresql.org
Subject: Re: Benchmark Data requested
Date: Wed, 6 Feb 2008 10:40:20 -0500 (EST)
Message-ID: <Pine.GSO.4.64.0802061031440.15780@westnet.com> (raw)
In-Reply-To: <200802061129.44482.dfontaine@hi-media.com>
References: <1202150236.4252.521.camel@ebony.site>
	<1202248803.4252.895.camel@ebony.site>
	<Pine.GSO.4.64.0802052211020.6216@westnet.com>
	<200802061129.44482.dfontaine@hi-media.com>

On Wed, 6 Feb 2008, Dimitri Fontaine wrote:

> Did you compare to COPY or \copy?

COPY.  If you're loading a TB, if you're smart it's going onto the server 
itself if it all possible and loading directly from there.  Would probably 
get a closer comparision against psql \copy, but recognize you're always 
going to be compared against the best server-side copy method available.

> Do you want to test pgloader again with Marko psycopgwrapper code to see if
> this helps?

Wouldn't have time myself for at least a month (probably not until after 
the East convention) so don't go making commits on my behalf.

> Maybe at the end of this PostgreSQL backend code will be smarter than pgloader
> (wrt error handling and data massaging) and we'll be able to drop the
> project

There are way too many data massaging cases I never expect the backend 
will handle that pgloader does a great job of right now, and I think there 
will always be a niche for a tool like this.

--
* Greg Smith gsmith@gregsmith.com http://www.gregsmith.com Baltimore, MD



view thread (51+ messages)  latest in thread

Message-ID: <Pine.GSO.4.64.0802061031440.15780@westnet.com>
Permalink:  ../Pine.GSO.4.64.0802061031440.15780@westnet.com/
Also on:    postgresql.org/message-id/Pine.GSO.4.64.0802061031440.15780@westnet.com

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: gsmith@gregsmith.com
  Subject: Re: Benchmark Data requested
  In-Reply-To: <Pine.GSO.4.64.0802061031440.15780@westnet.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox