pg.ddx.io  pgsql-admin@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Jim Nasby <jnasby@pervasive.com>
To: Benjamin Krajmalnik <kraj@illumen.com>
Cc: pgsql admin <pgsql-admin@postgresql.org>
Subject: Re: Strange UTF8 issue with pg_dump/pg_restore
Date: Tue, 8 Aug 2006 11:48:37 -0500
Message-ID: <773783AD-1DEC-411E-9BF1-16293664A090@pervasive.com> (raw)
In-Reply-To: <BF337097BDD9D849A2F4B818DDB279872525AB@stash.stackdump.local>
References: <BF337097BDD9D849A2F4B818DDB279872525AB@stash.stackdump.local>

On Aug 7, 2006, at 9:08 PM, Benjamin Krajmalnik wrote:
> I have a database whose records are inserted via ODBC.
> I turned on logging, and the client is explicitly setting the  
> client encoding to UTF.
>
> Rows are inserted into the tables.  When I do a pg_dump, I do not  
> get any errors.  When I try tor restore, I am getting an error  
> regarding an invalid UTF-8 character sequence.
> Of course, this renders compressed backups useless, since I have no  
> way of manually fixing the file.  The process of fixing the file  
> is, of course, painful.
>
> Is this a known issue?  I am running PG 8.1.4.  The problem  
> happened on PG Windows.
> Tomorrow I will try to see if the problem exists in the FreeBSD  
> compile.  If I get it to reproduce, I will be able to send some  
> data dumps, but will need to know who to send it to.

Are the dumps from an older version? There's a known issue that older  
versions weren't doing proper checking, in which case you can have  
invalid UTF8 characters. The fix is to run the dump through iconv.
--
Jim C. Nasby, Sr. Engineering Consultant      jnasby@pervasive.com
Pervasive Software      http://pervasive.com    work: 512-231-6117
vcard: http://jim.nasby.net/pervasive.vcf       cell: 512-569-9461



view thread (4+ messages)  latest in thread

Message-ID: <773783AD-1DEC-411E-9BF1-16293664A090@pervasive.com>
Permalink:  ../773783AD-1DEC-411E-9BF1-16293664A090@pervasive.com/
Also on:    postgresql.org/message-id/773783AD-1DEC-411E-9BF1-16293664A090@pervasive.com

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients from your mail client; the link fills in
  the headers below: reply via email
  Some clients, webmail especially, drop In-Reply-To and References from
  a link, and the reply then starts a new thread: use the mbox below.

  To: pgsql-admin@postgresql.org
  Cc: jnasby@pervasive.com, kraj@illumen.com
  Subject: Re: Strange UTF8 issue with pg_dump/pg_restore
  In-Reply-To: <773783AD-1DEC-411E-9BF1-16293664A090@pervasive.com>
  References: <BF337097BDD9D849A2F4B818DDB279872525AB@stash.stackdump.local> <773783AD-1DEC-411E-9BF1-16293664A090@pervasive.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox