From: Stephen Frost <sfrost@snowman.net>
To: Luke Lonergan <LLonergan@greenplum.com>
Cc: David Lang <dlang@invendra.net>
Cc: Steve Oualline <soualline@stbernard.com>
Cc: pgsql-performance@postgresql.org
Subject: Re: Database restore speed
Date: Fri, 2 Dec 2005 15:18:47 -0500
Message-ID: <20051202201847.GE6026@ns.snowman.net> (raw)
In-Reply-To: <3E37B936B592014B978C4415F90D662D01C48F01@MI8NYCMAIL06.Mi8.com>
References: <3E37B936B592014B978C4415F90D662D01C48F01@MI8NYCMAIL06.Mi8.com>
* Luke Lonergan (LLonergan@greenplum.com) wrote:
> > Luke, would it help to have one machine read the file and
> > have it connect to postgres on a different machine when doing
> > the copy? (I'm thinking that the first machine may be able to
> > do a lot of the parseing and conversion, leaving the second
> > machine to just worry about doing the writes)
>
> Unfortunately not - the parsing / conversion core is in the backend,
> where it should be IMO because of the need to do the attribute
> conversion there in the machine-native representation of the attributes
> (int4, float, etc) in addition to having the backend convert from client
> encoding (like LATIN1) to the backend encoding (like UNICODE aka UTF8).
Just a thought, but couldn't psql be made to use the binary mode of
libpq and do at least some of the conversion on the client side? Or
does binary mode not work with copy (that wouldn't suprise me, but
perhaps copy could be made to support it)?
The other thought, of course, is that you could use PITR for your
backups instead of pgdump...
Thanks,
Stephen
Attachments:
signature.asc (application/pgp-signature, 188B) download
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-performance@postgresql.org
Cc: sfrost@snowman.net, LLonergan@greenplum.com, dlang@invendra.net, soualline@stbernard.com
Subject: Re: Database restore speed
In-Reply-To: <20051202201847.GE6026@ns.snowman.net>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox