pg.ddx.io  pgsql-sql@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Andreas <maps.on@gmx.net>
To: pgsql-sql@postgresql.org
Subject: How to find broken UTF-8 characters ?
Date: Mon, 26 Apr 2010 02:12:43 +0200
Message-ID: <4BD4DA7B.3000603@gmx.net> (raw)

Hi,

I regularly have to import from Excel files, that hold rather simple 
text and number columns.
That works.

Occasionally there are unwanted special characters at the end of 
text-columns that Exel and pgAdmin either show as a upward arrow with a 
short leg on top 90° to the right or others are invisible with UTF-8 
aware programs or get dispayed as ? by Access.
A text viewer shows "ÔÇÄ" or E2 80 8E in Hex for the invisible thingy.

My database is unicode so it doesn't mind those freak-chars.
The problem rises when I need to export those records to CSV with 
pgAdmin. pgAdmin complains about not beeing able to store those lines in 
the local charset.

How can I find those broken UTF-8 characters?
How can I get rid of them?




Message-ID: <4BD4DA7B.3000603@gmx.net>
Permalink:  ../4BD4DA7B.3000603@gmx.net/
Also on:    postgresql.org/message-id/4BD4DA7B.3000603@gmx.net

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-sql@postgresql.org
  Cc: maps.on@gmx.net
  Subject: Re: How to find broken UTF-8 characters ?
  In-Reply-To: <4BD4DA7B.3000603@gmx.net>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox