From: Markus Bertheau <twanger@bluetwanger.de>
To: Tom Lane <tgl@sss.pgh.pa.us>
Cc: Christian Fowler <spider@viovio.com>
Cc: pgsql-admin list <pgsql-admin@postgresql.org>
Subject: Re: evil characters #bfef cause dump failure
Date: Tue, 16 Nov 2004 00:13:21 +0100
Message-ID: <1100560402.7458.3.camel@fc3> (raw)
In-Reply-To: <10656.1100552422@sss.pgh.pa.us>
References: <Pine.LNX.4.61.0411150335350.10091@leda.steelsun.com>
<9996.1100547889@sss.pgh.pa.us>
<Pine.LNX.4.61.0411151527550.12980@leda.steelsun.com>
<10478.1100550946@sss.pgh.pa.us>
<Pine.LNX.4.61.0411151539540.12980@leda.steelsun.com>
<10656.1100552422@sss.pgh.pa.us>
В Пнд, 15/11/2004 в 16:00 -0500, Tom Lane пишет:
> The real problem is that you've got invalid unicode data in the database
> (I'm not an expert, but I think that #bf is a 1-byte UTF8 sequence and
> then #ef starts a 3-byte sequence, so if this comes within 2 characters
> of end-of-line that would explain your dump problem).
FWIW, 1-byte UTF-8 sequences are always < 128. BF can only appear
inside, not at the beginning of, a UTF-8 byte sequence with more than 1
byte.
Compare
http://www.cl.cam.ac.uk/~mgk25/unicode.html#utf-8
It has a table that gives anyone who can tell bits from bytes a quick
understanding of how the UTF-8 encoding works.
--
Markus Bertheau <twanger@bluetwanger.de>
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients from your mail client; the link fills in
the headers below: reply via email
Some clients, webmail especially, drop In-Reply-To and References from
a link, and the reply then starts a new thread: use the mbox below.
To: pgsql-admin@postgresql.org
Cc: twanger@bluetwanger.de, tgl@sss.pgh.pa.us, spider@viovio.com
Subject: Re: evil characters #bfef cause dump failure
In-Reply-To: <1100560402.7458.3.camel@fc3>
References: <Pine.LNX.4.61.0411150335350.10091@leda.steelsun.com> <9996.1100547889@sss.pgh.pa.us> <Pine.LNX.4.61.0411151527550.12980@leda.steelsun.com> <10478.1100550946@sss.pgh.pa.us> <Pine.LNX.4.61.0411151539540.12980@leda.steelsun.com> <10656.1100552422@sss.pgh.pa.us> <1100560402.7458.3.camel@fc3>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox