From: Tom Lane <tgl@sss.pgh.pa.us>
To: Andreas <maps.on@gmx.net>
Cc: pgsql-sql@postgresql.org
Subject: Re: How to find double entries
Date: Tue, 15 Apr 2008 23:23:32 -0400
Message-ID: <21481.1208316212@sss.pgh.pa.us> (raw)
In-Reply-To: <48056F5F.30507@gmx.net>
References: <48056F5F.30507@gmx.net>
Andreas <maps.on@gmx.net> writes:
> I'd like to identify and then merge records of e.g. 'google', 'gogle',
> 'guugle'
> Then I want to match abbrevations like 'A-Company Ltd.', 'a company
> ltd.', 'A-Company Limited'
> Is there a way to do this?
> It would be OK just to list candidats up to be manually checked afterwards.
There are some functions in contrib/fuzzystrmatch that seem like they'd
help you find candidate duplicates. contrib/pg_trgm and text search
might also offer promising tools.
What's really a duplicate sounds like a judgment call here, so you
probably shouldn't even think of automating it completely.
regards, tom lane
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-sql@postgresql.org
Cc: tgl@sss.pgh.pa.us, maps.on@gmx.net
Subject: Re: How to find double entries
In-Reply-To: <21481.1208316212@sss.pgh.pa.us>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox