pg.ddx.io  pgsql-sql@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Craig Ringer <craig@postnewspapers.com.au>
To: Andreas <maps.on@gmx.net>
Cc: pgsql-sql@postgresql.org
Subject: Re: How to find double entries
Date: Wed, 16 Apr 2008 12:22:57 +0800
Message-ID: <48057F21.30607@postnewspapers.com.au> (raw)
In-Reply-To: <48056F5F.30507@gmx.net>
References: <48056F5F.30507@gmx.net>

Andreas wrote:
> Hi,
> 
> how can I find double entries in varchar columns where the content is
> not 100% identical because of a spelling error or the person considered
> it "looked nicer" that way?

When doing some near-duplicate elimination as part of converting a
legacy data set to PostgreSQL I found the `fuzzystrmatch' contrib module
immensely helpful.

http://www.postgresql.org/docs/current/static/fuzzystrmatch.html

--
Craig Ringer



view thread (8+ messages)  latest in thread

Message-ID: <48057F21.30607@postnewspapers.com.au>
Permalink:  ../48057F21.30607@postnewspapers.com.au/
Also on:    postgresql.org/message-id/48057F21.30607@postnewspapers.com.au

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-sql@postgresql.org
  Cc: craig@postnewspapers.com.au, maps.on@gmx.net
  Subject: Re: How to find double entries
  In-Reply-To: <48057F21.30607@postnewspapers.com.au>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox