From: Jeroen T. Vermeulen <jtv@xs4all.nl>
To: Jeff Lynn <jmlynn@rogers.com>
Cc: Andrew McNamara <andrewm@object-craft.com.au>
Cc: pgsql-interfaces@postgresql.org
Subject: Re: PQgetvalue failed to return column value for non-text data in binary format
Date: Tue, 22 May 2007 13:10:25 +0700 (ICT)
Message-ID: <10260.125.24.233.43.1179814225.squirrel@webmail.xs4all.nl> (raw)
In-Reply-To: <4652133D.2080103@rogers.com>
References: <4651216B.2060707@rogers.com>
<20070521055759.848496006EA@longblack.object-craft.com.au>
<4652133D.2080103@rogers.com>
On Tue, May 22, 2007 04:46, Jeff Lynn wrote:
> This is interesting position to be taken by PostgreSQL. For simple
> query, particularly with regards to reporting, one can go about using
> text for all column. But a lot of time, I deal with large dataset
> ingestions and extracts that tends to take many hours to perform. So I
> usually prefer binary form data for performance reason. To that end, I
> found there is a significant different in the time it takes to ingest or
> extract data from one database to another database of totally different
> vendor. Most of our company's works are done in Java nowadays, but for
> large data ingestions/extract/conversion, a C program out performs Java
> program fair and square, no debate there (based on actual run-time
> data). For clarification, we deal with various business partners that
> we have to import/export large amount of data between heterogeneous
> databases that the wonderful technology of database replication does not
> apply for our use.
For that kind of thing, may I suggest you try using the COPY API? That
may buy you more speed than transferring data in binary form
would—particularly for insertions.
Jeroen
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-interfaces@postgresql.org
Cc: jtv@xs4all.nl, jmlynn@rogers.com, andrewm@object-craft.com.au
Subject: Re: PQgetvalue failed to return column value for non-text data in binary format
In-Reply-To: <10260.125.24.233.43.1179814225.squirrel@webmail.xs4all.nl>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox