pg.ddx.io  pgsql-hackers@postgresql.org mailing list archive  

help / color / mirror / Atom feed
From: Nico Williams <nico@cryptonector.com>
To: Tom Lane <tgl@sss.pgh.pa.us>
Cc: Robert Haas <robertmhaas@gmail.com>
Cc: Isaac Morland <isaac.morland@gmail.com>
Cc: Jeff Davis <pgsql@j-davis.com>
Cc: Chapman Flack <chap@anastigmatix.net>
Cc: pgsql-hackers@postgresql.org
Subject: Re: Pre-proposal: unicode normalized text
Date: Thu, 5 Oct 2023 14:52:37 -0500
Message-ID: <ZR8UBTZcywbhK4JI@ubby21> (raw)
In-Reply-To: <2816608.1696535377@sss.pgh.pa.us>
References: <f30b58657ceb71d5be032decf4058d454cc1df74.camel@j-davis.com>
	<ZR2fnTPDwPb0IamC@ubby21>
	<CA+TgmoY6vNbDoBugDT=3rdJ-diyLw-kQ9sxB2JXenv48xV_tVQ@mail.gmail.com>
	<43864caecd65d02081d623d05ccc1683@anastigmatix.net>
	<CAMsGm5eyegAkb2Eq+8d2j+BxDnSZXH0AUciwi6rA60V_ft=1dw@mail.gmail.com>
	<94a0e631b787d56fec1b17e03fe045b5e14907c1.camel@j-davis.com>
	<CAMsGm5f8k4_C6VuerSbF2gXeVwD9kMZQk43kO85Oi4oGVL7EMA@mail.gmail.com>
	<CA+TgmobAxizsgjxvZdEQxjEs6RA3qu7JLti_LdXtaXODJoWzNw@mail.gmail.com>
	<ZR8LLrk9AJVxEFbX@ubby21>
	<2816608.1696535377@sss.pgh.pa.us>

On Thu, Oct 05, 2023 at 03:49:37PM -0400, Tom Lane wrote:
> Nico Williams <nico@cryptonector.com> writes:
> > Text+encoding can be just like bytea with a one- or two-byte prefix
> > indicating what codeset+encoding it's in.  That'd be how to encode
> > such text values on the wire, though on disk the column's type should
> > indicate the codeset+encoding, so no need to add a prefix to the value.
> 
> The precedent of BOMs (byte order marks) suggests strongly that
> such a solution would be horrible to use.

This is just how you encode the type of the string.  You have any number
of options.  The point is that already PG can encode binary data, so if
how to encode text of disparate encodings on the wire, building on top
of the encoding of bytea is an option.





view thread (77+ messages)  latest in thread

Message-ID: <ZR8UBTZcywbhK4JI@ubby21>
Permalink:  ../ZR8UBTZcywbhK4JI@ubby21/
Also on:    postgresql.org/message-id/ZR8UBTZcywbhK4JI@ubby21

 · 

reply
Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-hackers@postgresql.org
  Cc: nico@cryptonector.com, tgl@sss.pgh.pa.us, robertmhaas@gmail.com, isaac.morland@gmail.com, pgsql@j-davis.com, chap@anastigmatix.net
  Subject: Re: Pre-proposal: unicode normalized text
  In-Reply-To: <ZR8UBTZcywbhK4JI@ubby21>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox