DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta;
	h=received:message-id:date:from:sender:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references:x-google-sender-auth;
	b=o9l0S4aUt8hqVv3OxRttM/aIGEFnrwy0ECm3BxuHbBNxaSrEx9TkYwatIfRkHgxYxlxyzIR9XbA9HiFyacM0mG+3UR/+dIZ4RKDtfziPkuJFE3sSlE/yNRPKiwYRX5D75+ZcWMnsAY7OdYR2M/7LC0qQxcLCABc8dYncyNkneu8=
Message-ID: <c637d8bb0707080925u4cd0871dmced4458d19b10c1@mail.gmail.com>
Date: Sun, 8 Jul 2007 19:25:26 +0300
From: "Kalle Hallivuori" <kato@iki.fi>
To: "Thomas Finneid" <tfinneid@student.matnat.uio.no>
Subject: Re: improvement suggestions for performance design
Cc: pgsql-performance@postgresql.org
In-Reply-To: <4690B725.5070303@ifi.uio.no>
MIME-Version: 1.0
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
Content-Disposition: inline
References: <40362.134.32.140.234.1183637748.squirrel@webmail.uio.no>
	<468CEB32.30109@enterprisedb.com>
	<40891.134.32.140.234.1183642557.squirrel@webmail.uio.no>
	<468D3AF7.4070505@enterprisedb.com> <468D6F68.7090903@ifi.uio.no>
	<c637d8bb0707060430x1656a796y728c88e9e2103ea5@mail.gmail.com>
	<4690B725.5070303@ifi.uio.no>

Hi.

2007/7/8, Thomas Finneid <tfinneid@student.matnat.uio.no>:
>
> Kalle Hallivuori wrote:
>
>  > COPY is plentitudes faster than INSERT:
>  > http://www.postgresql.org/docs/8.1/interactive/sql-copy.html
>  >
>  > If you can't just push the data straight into the final table with
>  > COPY, push it into a temporary table that you go through with the
>  > database procedure.
>  >
>  > Shameless plug: If you use Java and miss COPY functionality in the
>  > driver, it's available at
>  >
>  > http://kato.iki.fi/sw/db/postgresql/jdbc/copy/
>  >
>  > I was able to practically nullify time spent inserting with that.
>
> Interresting, I will definately have a look at it.
> What is the maturity level of the code at this point? and what is
> potentially missing to bring it up to production quality? (stability is
> of the utmost importance in my usage scenario.)

It's my third implementation, based on earlier work by Kris Jurka, a
maintainer of the JDBC driver. (It is really quite short so it's easy
to keep it clear.) I consider it mature enough to have accommodated it
as part of an upcoming large application, but I'd really like to hear
others' opinions. Documentation I should add one of these days, maybe
even rewrite the javadoc.

You can use COPY as is on the server side without the patch, but then
you need to get the data as CSV or TSV files onto the database server
machine, and use db superuser privileges to import it. My patch just
adds the ability to feed data from client with normal user privileges.

-- 
Kalle Hallivuori +358-41-5053073 http://korpiq.iki.fi/