pg.ddx.io  pgsql-sql@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Matthew Hagerty <matthew@brwholesale.com>
To: Josh Berkus <josh@agliodbs.com>
To: pgsql-sql@postgresql.org
Subject: Re: Removing duplicates
Date: Tue, 26 Feb 2002 12:16:39 -0500
Message-ID: <5.1.0.14.2.20020226114626.00b2f650@imap.brwholesale.com> (raw)
In-Reply-To: <web-810507@davinci.ethosmedia.com>
References: <5.1.0.14.2.20020226095955.00b17f10@imap.brwholesale.com>

At 08:39 AM 2/26/2002 -0800, Josh Berkus wrote:
>Matt,
>
> > I have a customer database (name, address1, address2, city, state,
> >  zip) and I need a query (or two) that will give me a mailing list
> >  with the least amount of duplicates possible.  I know that precise
> >  matching is not possible, i.e. "P.O. Box 123" will never match "PO
> >  Box 123" without some data massaging, but if I can isolate even 50%
> >  of any duplicates, that would help greatly.
>
> From the sound of things, you are trying to get out a mailing with the
>  least number of duplicates you can in a limited time, rather than
>  trying to clean up the list for permanent storage.  Chances are, you
>  bought or traded this list from an outside source, yes?

Actually the database is a collection of customers collected over the past 
8 years.  The sales people are "supposed" to try to find customers when 
they call in to place an order, but that does not always happen and 
customers have undoubtedly been added more than once.  Of course, over 8 
years and various computer systems, punctuation, case, spelling, different 
employees, etc. the data is less than perfect.  It is amazing how easily a 
user can enter a duplicate no matter how tricky or smart you think your 
code is! :-)

I will certainly look into the address standardization information that has 
been posted.  Thank you everyone for your input!

Matthew

<snip>




view thread (8+ messages)  latest in thread

Message-ID: <5.1.0.14.2.20020226114626.00b2f650@imap.brwholesale.com>
Permalink:  ../5.1.0.14.2.20020226114626.00b2f650@imap.brwholesale.com/
Also on:    postgresql.org/message-id/5.1.0.14.2.20020226114626.00b2f650@imap.brwholesale.com

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-sql@postgresql.org
  Cc: matthew@brwholesale.com, josh@agliodbs.com
  Subject: Re: Removing duplicates
  In-Reply-To: <5.1.0.14.2.20020226114626.00b2f650@imap.brwholesale.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox