X-Original-To: pgsql-admin-postgresql.org@localhost.postgresql.org Received: from localhost (unknown [200.46.204.144]) by svr1.postgresql.org (Postfix) with ESMTP id 8962C3A4BDE for ; Mon, 15 Nov 2004 23:13:34 +0000 (GMT) Received: from svr1.postgresql.org ([200.46.204.71]) by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024) with ESMTP id 85377-02 for ; Mon, 15 Nov 2004 23:13:30 +0000 (GMT) Received: from web11.manitu.net (web11.manitu.net [217.11.48.111]) by svr1.postgresql.org (Postfix) with ESMTP id 8C1923A4B90 for ; Mon, 15 Nov 2004 23:13:31 +0000 (GMT) Received: from localhost (dsl-082-082-210-021.arcor-ip.net [82.82.210.21]) by web11.manitu.net (8.10.2-SOL3/8.10.2) with ESMTP id iAFNDLX07060; Tue, 16 Nov 2004 00:13:21 +0100 Subject: Re: evil characters #bfef cause dump failure From: Markus Bertheau To: Tom Lane Cc: Christian Fowler , pgsql-admin list In-Reply-To: <10656.1100552422@sss.pgh.pa.us> References: <9996.1100547889@sss.pgh.pa.us> <10478.1100550946@sss.pgh.pa.us> <10656.1100552422@sss.pgh.pa.us> Content-Type: text/plain; charset=utf-8 Date: Tue, 16 Nov 2004 00:13:21 +0100 Message-Id: <1100560402.7458.3.camel@fc3> Mime-Version: 1.0 X-Mailer: Evolution 2.0.2 (2.0.2-3) Content-Transfer-Encoding: 8bit X-Virus-Scanned: by amavisd-new at hub.org X-Spam-Status: No, hits=0.0 tagged_above=0.0 required=5.0 tests= X-Spam-Level: X-Archive-Number: 200411/123 X-Sequence-Number: 15507 В Пнд, 15/11/2004 в 16:00 -0500, Tom Lane пишет: > The real problem is that you've got invalid unicode data in the database > (I'm not an expert, but I think that #bf is a 1-byte UTF8 sequence and > then #ef starts a 3-byte sequence, so if this comes within 2 characters > of end-of-line that would explain your dump problem). FWIW, 1-byte UTF-8 sequences are always < 128. BF can only appear inside, not at the beginning of, a UTF-8 byte sequence with more than 1 byte. Compare http://www.cl.cam.ac.uk/~mgk25/unicode.html#utf-8 It has a table that gives anyone who can tell bits from bytes a quick understanding of how the UTF-8 encoding works. -- Markus Bertheau