X-Original-To: pgsql-admin-postgresql.org@localhost.postgresql.org Received: from localhost (av.hub.org [200.46.204.144]) by postgresql.org (Postfix) with ESMTP id 2D2F19DC884 for ; Fri, 10 Feb 2006 04:51:01 -0400 (AST) Received: from postgresql.org ([200.46.204.71]) by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024) with ESMTP id 30646-06 for ; Fri, 10 Feb 2006 04:51:01 -0400 (AST) X-Greylist: delayed 00:12:31.98402 by SQLgrey- Received: from ctb-mesg9.saix.net (ctb-mesg9.saix.net [196.25.240.89]) by postgresql.org (Postfix) with ESMTP id 905159DC81A for ; Fri, 10 Feb 2006 04:50:58 -0400 (AST) Received: from mygus (dsl-146-121-181.telkomadsl.co.za [165.146.121.181]) by ctb-mesg9.saix.net (Postfix) with ESMTP id AE4BE31DB; Fri, 10 Feb 2006 10:50:56 +0200 (SAST) From: "James Dey" To: "'Devrim GUNDUZ'" Cc: Subject: Re: Migration Date: Fri, 10 Feb 2006 10:50:52 +0200 MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Office Outlook, Build 11.0.6353 In-Reply-To: <1139561095.16736.18.camel@evim.gunduz.org> X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.2180 Thread-Index: AcYuHkd+05dMwKfZRw2LGC3P+SCwNAAALzVA Message-Id: <20060210085056.AE4BE31DB@ctb-mesg9.saix.net> X-Virus-Scanned: by amavisd-new at hub.org X-Spam-Status: No, score=0.12 required=5 tests=[AWL=0.120] X-Spam-Score: 0.12 X-Spam-Level: X-Archive-Number: 200602/97 X-Sequence-Number: 20518 Thank you Devrim, Am I correct in saying then that UTF-8 and UNICODE are the same thing as far as PostgreSQL is concerned? Best regards, James Dey tel +27 11 704-1945 cell +27 82 785-5102 fax +27 11 388-8907 mail james@mygus.com -----Original Message----- From: Devrim GUNDUZ [mailto:devrim@commandprompt.com] Sent: 10 February 2006 10:45 AM To: James Dey Cc: pgsql-admin@postgresql.org Subject: Re: [ADMIN] Migration Hi, On Fri, 2006-02-10 at 10:38 +0200, James Dey wrote: > I have installed PostgreSQL 8.1 onto a new box, and when trying to > create a new database, even when specifiying -encoding=UNICODE I > cannot create UNICODE dbs, it makes them all UTF-8. > > > Then when I try and restore a DB dump, but keep on getting invalid > "UTF-8 byte sequence detected near byte xxx" and although the restore > continues, a lot of data is missing. http://developer.postgresql.org/docs/postgres/release-8-1.html "Some users are having problems loading UTF-8 data into 8.1.X. This is because previous versions allowed invalid UTF-8 byte sequences to be entered into the database, and this release properly accepts only valid UTF-8 sequences. One way to correct a dumpfile is to run the command iconv -c -f UTF-8 -t UTF-8 -o cleanfile.sql dumpfile.sql. The -c option removes invalid character sequences. A diff of the two files will show the sequences that are invalid. iconv reads the entire input file into memory so it might be necessary to use split to break up the dump into multiple smaller files for processing." Regards, -- The PostgreSQL Company - Command Prompt, Inc. 1.503.667.4564 PostgreSQL Replication, Consulting, Custom Development, 24x7 support Managed Services, Shared and Dedicated Hosting Co-Authors: PL/php, plPerlNG - http://www.commandprompt.com/