pg.ddx.io  pgsql-sql@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Søren Vainio <sva@Netpointers.com>
To: Tom Lane <tgl@sss.pgh.pa.us>
Cc: 'pgsql-sql@postgresql.org' <pgsql-sql@postgresql.org>
Subject: Re: Scadinavian characters in regular expressions
Date: Tue, 9 Apr 2002 16:21:43 +0200
Message-ID: <910513A5A944D5118BE900C04F67CB5A1F82C7@MAIL> (raw)

There is obviously a problem with the scecial characters.
The query SELECT 'oneå two three' ~ '^[^ ]+[ ][^ ]+$';
produced FALSE on a database with ENCODING = 'LATIN1' and TRUE on a database
with ENCODING = 'UNICODE'.

Do you have a suggestion to how I can find the count of two-word strings
with ENCODING = 'UNICODE'?

Thank you
Søren Vainio

> -----Oprindelig meddelelse-----
> Fra: Tom Lane [mailto:tgl@sss.pgh.pa.us]
> Sendt: 9. april 2002 15:34
> Til: Søren Vainio
> Cc: 'Andreas Joseph Krogh'; 'pgsql-sql@postgresql.org'
> Emne: Re: [SQL] Scadinavian characters in regular expressions 
> 
> 
> =?iso-8859-1?Q?S=F8ren_Vainio?= <sva@Netpointers.com> writes:
> > Using \s does produce FALSE for SELECT 'oneå two three' ~
> > '^[^\s]+[\s][^\s]+$';
> > But it also produces FALSE for any two-word string ex:
> > SELECT 'one two' ~ '^[^\s]+[\s][^\s]+$'; where I would 
> expect TRUE???
> > (I am using PostgreSQL 7.1.3)
> 
> I do not believe that Postgres' regular expression engine 
> recognizes \s
> as meaning anything except "s".  See
> http://www.ca.postgresql.org/users-lounge/docs/7.2/postgres/fu
nctions-matching.html

In the above, it's even worse: the backslashes were eaten by the
string-literal parser, so what arrived at the RE engine was just
^[^s]+[s][^s]+$ ... not likely to produce what you wanted.

As for the original issue, I wonder whether you are storing the string
as UTF-8 or Latin1 encoding.  I have a suspicion that the å (&#229
&aring a-ring) is actually a multibyte sequence inside the database
and for some reason Postgres isn't configured to recognize it as a
single logical character.

			regards, tom lane



view thread (7+ messages)  latest in thread

Message-ID: <910513A5A944D5118BE900C04F67CB5A1F82C7@MAIL>
Permalink:  ../910513A5A944D5118BE900C04F67CB5A1F82C7@MAIL/
Also on:    postgresql.org/message-id/910513A5A944D5118BE900C04F67CB5A1F82C7@MAIL

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-sql@postgresql.org
  Cc: sva@Netpointers.com, tgl@sss.pgh.pa.us
  Subject: Re: Scadinavian characters in regular expressions
  In-Reply-To: <910513A5A944D5118BE900C04F67CB5A1F82C7@MAIL>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox