pg.ddx.io  pgsql-sql@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Paul Lambert <paul.lambert@autoledgers.com.au>
To: sql pgsql <pgsql-sql@postgresql.org>
Subject: Re: Extracting hostname from URI column
Date: Mon, 17 Sep 2007 06:54:53 +0800
Message-ID: <46EDB43D.9060405@autoledgers.com.au> (raw)
In-Reply-To: <46E73D1C.4020009@autoledgers.com.au>
References: <335491.75226.qm@web54303.mail.re2.yahoo.com>
	<46E73D1C.4020009@autoledgers.com.au>

Paul Lambert wrote:
> chester c young wrote:
>>> I'm trying to use substr() and position() functions to extract the
>>> full host name (and later a domain) from a column that holds URLs.
>>
>> substring( href from '.*://\([^/]*)' );
>>
> 
> Ok, your solution looks better than mine... but I have no idea how to 
> interpret that, time to consult some manuals.
> 

OK - following on from this, I'm doing a similar thing to the OP to 
analyze my proxy's traffic (never occured to me to do it in a db until 
that post)

I've done the above regex to pull out the domain part of the URL and am 
left with results such as:
"acvs.mediaonenetwork.net"
"profile.ak.facebook.com"
"www.bankwest.com.au"

What I want to do next is pull out the major domain part of the URL
I.e. for the above three records I should end up with
"mediaonenetwork.net"
"facebook.com"
"bankwest.com.au"

What would be the best way to do something like that? I assume it won't 
be a simple regex like the above due to the country codes on the end of 
some domains. My thought is look at the last portion of the domain, if 
it's 2 characters long then assume it's a country code and grab the last 
three sections, if it's not three characters long then assume it's an 
international domain and grab the last two... but that sounds a bit dodgy.

-- 
Paul Lambert
Database Administrator
AutoLedgers




view thread (17+ messages)  latest in thread

Message-ID: <46EDB43D.9060405@autoledgers.com.au>
Permalink:  ../46EDB43D.9060405@autoledgers.com.au/
Also on:    postgresql.org/message-id/46EDB43D.9060405@autoledgers.com.au

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-sql@postgresql.org
  Cc: paul.lambert@autoledgers.com.au
  Subject: Re: Extracting hostname from URI column
  In-Reply-To: <46EDB43D.9060405@autoledgers.com.au>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox