From: Tarlika Elisabeth Schmitz <postgresql3@numerixtechnology.de>
To: pgsql-sql@postgresql.org
Subject: Re: extracting location info from string
Date: Thu, 26 May 2011 21:40:12 +0100
Message-ID: <20110526214012.24213f0c@dick.coachhouse> (raw)
In-Reply-To: <BANLkTimBKGkhdzYCZqBR=pxa9bNhUBXWLg@mail.gmail.com>
References: <20110522210526.0f8b66fa@dick.coachhouse>
<20110522230041.28d1bc35@dick.coachhouse>
<BANLkTikGzsrvXprLXeN3TxZwA=M8fzkn=g@mail.gmail.com>
<4DD9BB87.7070000@postnewspapers.com.au>
<ircnj2$cpt$1@news.albasani.net>
<20110523163341.56edb1aa@dick.coachhouse>
<irgo1v$dbv$1@news.albasani.net>
<4DDD1F7C.5040008@gmail.com>
<20110525221342.14e34046@dick.coachhouse>
<BANLkTimBKGkhdzYCZqBR=pxa9bNhUBXWLg@mail.gmail.com>
On Thu, 26 May 2011 10:15:50 +1200
Andrej <andrej.groups@gmail.com> wrote:
>On 26 May 2011 09:13, Tarlika Elisabeth Schmitz
><postgresql3@numerixtechnology.de> wrote:
>> On Wed, 25 May 2011 09:25:48 -0600
>> Rob Sargent <robjsargent@gmail.com> wrote:
>>
>>>
>>>
>>>On 05/24/2011 10:57 AM, Lew wrote:
>>>> Tarlika Elisabeth Schmitz wrote:
>>>>
>>>>> CREATE TABLE person
>>>>> (
>>>>> id integer NOT NULL,
>>>>> "name" character varying(256) NOT NULL,
>>>>> "location" character varying(256),
>>>>> CONSTRAINT person_pkey PRIMARY KEY (id)
>>>>> );
>>>>>
>>>>> this was just a TEMPORARY table I created for quick analysis
>>>>> of my CSV data (now renamed to temp_person).
>>
>> CREATE TABLE country
>> (
>> id character varying(3) NOT NULL, -- alpha-3 code
>> "name" character varying(50) NOT NULL,
>> CONSTRAINT country_pkey PRIMARY KEY (id)
>> );
>>
>>
>>>To minimize the ultimately quite necessary human adjudication, one
>>>might make good use of what is often termed "crowd sourcing": Keep
>>>all the distinct "hand entered" values and a map to the final human
>>>assessment.
>>[...]
>> I could do with a concept for this problem, which applies to a lot of
>> string-type info.
>
>I'd start w/ downloading a list as mentioned here:
>http://answers.google.com/answers/threadview?id=596822
>
>And run it through a wee perl script using
>http://search.cpan.org/~maurice/Text-DoubleMetaphone-0.07/DoubleMetaphone.pm
>to make phonetic matches ...
>
>Then I'd run your own data through DoubleMetaphone, and clean up
>matches if not too many false positives show up.
Many thanks for all your suggestions. It will take me a while to work
my way through these as I have several open ends.
In a similar vein, the PERSONs names are
1) <firstname> <surname>
2) <initials> <surname> (more common)
3) <title> <initials>|<firstname> <surname>
Where I have firstname and or title I'd be quite keen to determine sex
as it would be interesting from a statistics point of view to
distinguish.
I am basically just interested in people from two countries, names
mainly English.
--
Best Regards,
Tarlika Elisabeth Schmitz
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-sql@postgresql.org
Cc: postgresql3@numerixtechnology.de
Subject: Re: extracting location info from string
In-Reply-To: <20110526214012.24213f0c@dick.coachhouse>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox