Date: Fri, 2 Dec 2005 15:18:47 -0500
From: Stephen Frost <sfrost@snowman.net>
To: Luke Lonergan <LLonergan@greenplum.com>
Cc: David Lang <dlang@invendra.net>, Steve Oualline <soualline@stbernard.com>,
	pgsql-performance@postgresql.org
Subject: Re: Database restore speed
Message-ID: <20051202201847.GE6026@ns.snowman.net>
Mail-Followup-To: Luke Lonergan <LLonergan@greenplum.com>,
	David Lang <dlang@invendra.net>,
	Steve Oualline <soualline@stbernard.com>,
	pgsql-performance@postgresql.org
References: <3E37B936B592014B978C4415F90D662D01C48F01@MI8NYCMAIL06.Mi8.com>
Mime-Version: 1.0
Content-Type: multipart/signed; micalg=pgp-sha1;
	protocol="application/pgp-signature"; boundary="IWoBo/ZLzY7SPqkS"
Content-Disposition: inline
In-Reply-To: <3E37B936B592014B978C4415F90D662D01C48F01@MI8NYCMAIL06.Mi8.com>
User-Agent: Mutt/1.5.9i


--IWoBo/ZLzY7SPqkS
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable

* Luke Lonergan (LLonergan@greenplum.com) wrote:
> > Luke, would it help to have one machine read the file and=20
> > have it connect to postgres on a different machine when doing=20
> > the copy? (I'm thinking that the first machine may be able to=20
> > do a lot of the parseing and conversion, leaving the second=20
> > machine to just worry about doing the writes)
>=20
> Unfortunately not - the parsing / conversion core is in the backend,
> where it should be IMO because of the need to do the attribute
> conversion there in the machine-native representation of the attributes
> (int4, float, etc) in addition to having the backend convert from client
> encoding (like LATIN1) to the backend encoding (like UNICODE aka UTF8).

Just a thought, but couldn't psql be made to use the binary mode of
libpq and do at least some of the conversion on the client side?  Or
does binary mode not work with copy (that wouldn't suprise me, but
perhaps copy could be made to support it)?

The other thought, of course, is that you could use PITR for your
backups instead of pgdump...

	Thanks,

		Stephen

--IWoBo/ZLzY7SPqkS
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: Digital signature
Content-Disposition: inline

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.2 (GNU/Linux)

iD8DBQFDkKwnrzgMPqB3kigRAl/AAJ41ewZ4NAWfthI0h/4XvxJc9Sc5ngCfZCyV
qvIuwO7f4QS/pR09NHdIyMs=
=xGeK
-----END PGP SIGNATURE-----

--IWoBo/ZLzY7SPqkS--