From: Ivo Rossacher <rossacher@bluewin.ch>
To: pgsql-admin@postgresql.org
Subject: Re: "UNICODE" error during restoration
Date: Wed, 21 Jun 2006 18:52:15 +0200
Message-ID: <200606211852.15456.rossacher@bluewin.ch> (raw)
In-Reply-To: <20060621105743.18480.qmail@web30402.mail.mud.yahoo.com>
References: <20060621105743.18480.qmail@web30402.mail.mud.yahoo.com>
In the HISTORY file comming with the source code there are several
modifications noted related to characterset handling in general and to
unicode more specificaly in the versions before and 7.4.13 it self. The
bottom line is that postgresql in earlier versions did allow incorrect
UNICODE sequences. The recent releases do handle UNICODE stricly according to
the rouls and will not allow incorrect sequences. When you now do have a
backup with incorrect sequences in, you will get this error messages. You can
fix this by fixing the wrong sequences within the dump manually or by a tool
like recode.
Best regards
Ivo Rossacher
Am Mittwoch, 21. Juni 2006 12.57 schrieb Thusitha Kodikara:
> Hello,
>
> We did some more testing and managed to get the dump restored on 7.4.10.
> Then took a backup and tried to restore on to 7.4.13, but if failed again
> giving the same errors.
>
> In addition to this we took a dump of an existing DB on 7.4.13 and tried to
> restore it onto 7.4.13 itself. This also failed.
>
> Could it be that our data contain some invalid characters (even though we
> never came across any problem before installing the patch 7.4.13) ? In all
> these instances our encoding was UNICODE.
>
> Does anyone have a clue how to solve this?
>
> Thanks.
> -Thusitha
>
> TK <kthusi@yahoo.com> wrote: Hi,
>
> We took a dump of a database running PostgreSQL 7.3.10 (on Gentoo Linux).
>
> We tried to restore it onto a server running PostgreSQL 7.4.13 (on Gentoo
> Linux). This resulted in the following errors:
>
> psql:<stdin>:13856: ERROR: invalid byte sequence for encoding "UNICODE":
> 0x85 ....
> psql:<stdin>:537916: ERROR: invalid byte sequence for encoding "UNICODE":
> 0xa0 ...
> psql:<stdin>:1009873: ERROR: invalid byte sequence for encoding "UNICODE":
> 0x92 ...
> etc.
>
> We tried to restore the same dump on a server running PostgreSQL 7.3.9 (on
> Gentoo Linux) and the restoration was successful. It also worked without
> any problem on a server running PostgreSQL 7.4.5 (on Gentoo Linux).
>
> All the databases in this scenario were of UNICODE encoding type.
>
> What could be the reson for this, and how can we avoid this?
>
> Thanks in advance,
>
> -Thusitha
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients from your mail client; the link fills in
the headers below: reply via email
Some clients, webmail especially, drop In-Reply-To and References from
a link, and the reply then starts a new thread: use the mbox below.
To: pgsql-admin@postgresql.org
Cc: rossacher@bluewin.ch
Subject: Re: "UNICODE" error during restoration
In-Reply-To: <200606211852.15456.rossacher@bluewin.ch>
References: <20060621105743.18480.qmail@web30402.mail.mud.yahoo.com> <200606211852.15456.rossacher@bluewin.ch>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox