Received: from maia.hub.org (unknown [200.46.208.211])
	by mail.postgresql.org (Postfix) with ESMTP id 6AB236334C9
	for <pgsql-sql-postgresql.org@mail.postgresql.org>;
	Sun, 25 Apr 2010 21:13:02 -0300 (ADT)
Received: from mail.postgresql.org ([200.46.204.86])
	by maia.hub.org (mx1.hub.org [200.46.208.211]) (amavisd-maia,
	port 10024) with ESMTP id 26844-01-6 for
	<pgsql-sql-postgresql.org@mail.postgresql.org>;
	Mon, 26 Apr 2010 00:12:35 +0000 (UTC)
X-Greylist: domain auto-whitelisted by SQLgrey-1.7.6
Received: from mail.gmx.net (mail.gmx.net [213.165.64.20])
	by mail.postgresql.org (Postfix) with SMTP id 23F1E634E8F
	for <pgsql-sql@postgresql.org>; Sun, 25 Apr 2010 21:12:45 -0300 (ADT)
Received: (qmail invoked by alias); 26 Apr 2010 00:12:43 -0000
Received: from p5481E4D1.dip.t-dialin.net (EHLO [192.168.1.203])
	[84.129.228.209]
	by mail.gmx.net (mp061) with SMTP; 26 Apr 2010 02:12:43 +0200
X-Authenticated: #14269776
X-Provags-ID: V01U2FsdGVkX18Dt0Ul1vQDwyQkOFDd4HSJXkvAaxJ3ywCz95XGQT
	MOTe+pVSX9eXgH
Message-ID: <4BD4DA7B.3000603@gmx.net>
Date: Mon, 26 Apr 2010 02:12:43 +0200
From: Andreas <maps.on@gmx.net>
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; de;
	rv:1.9.1.9) Gecko/20100317 Thunderbird/3.0.4
MIME-Version: 1.0
To: pgsql-sql@postgresql.org
Subject: How to find broken UTF-8 characters ?
Content-Type: text/plain; charset=ISO-8859-15; format=flowed
Content-Transfer-Encoding: 8bit
X-Y-GMX-Trusted: 0
X-FuHaFi: 0.66000000000000003
X-Virus-Scanned: Maia Mailguard 1.0.1
X-Spam-Status: No, hits=0.79 tagged_above=-10 required=5 tests=BAYES_50=0.8,
	T_RP_MATCHES_RCVD=-0.01
X-Spam-Level: 
X-Archive-Number: 201004/90
X-Sequence-Number: 34017

Hi,

I regularly have to import from Excel files, that hold rather simple 
text and number columns.
That works.

Occasionally there are unwanted special characters at the end of 
text-columns that Exel and pgAdmin either show as a upward arrow with a 
short leg on top 90° to the right or others are invisible with UTF-8 
aware programs or get dispayed as ? by Access.
A text viewer shows "ÔÇÄ" or E2 80 8E in Hex for the invisible thingy.

My database is unicode so it doesn't mind those freak-chars.
The problem rises when I need to export those records to CSV with 
pgAdmin. pgAdmin complains about not beeing able to store those lines in 
the local charset.

How can I find those broken UTF-8 characters?
How can I get rid of them?