From: Tom Lane <tgl@sss.pgh.pa.us>
To: "James Pang (chaolpan)" <chaolpan@cisco.com>
cc: "pgsql-admin@lists.postgresql.org" <pgsql-admin@lists.postgresql.org>
Subject: Re: inserts bypass encoding conversion
In-reply-to: 
 <PH0PR11MB51912A70CBC6FF376F8B106CD61AA@PH0PR11MB5191.namprd11.prod.outlook.com>
References: 
 <PH0PR11MB5191EB32087DE307374EB2C4D615A@PH0PR11MB5191.namprd11.prod.outlook.com>
 <1320633.1692194575@sss.pgh.pa.us>
 <PH0PR11MB51913D89862FDA866FACCC8CD61AA@PH0PR11MB5191.namprd11.prod.outlook.com>
 <1717988.1692235980@sss.pgh.pa.us>
 <PH0PR11MB51912A70CBC6FF376F8B106CD61AA@PH0PR11MB5191.namprd11.prod.outlook.com>
Comments: In-reply-to "James Pang (chaolpan)" <chaolpan@cisco.com>
	message dated "Thu, 17 Aug 2023 02:25:57 -0000"
MIME-Version: 1.0
Content-Type: text/plain; charset="us-ascii"
Content-ID: <1727534.1692240032.1@sss.pgh.pa.us>
Content-Transfer-Encoding: quoted-printable
Date: Wed, 16 Aug 2023 22:40:32 -0400
Message-ID: <1727535.1692240032@sss.pgh.pa.us>
Archived-At: 
 <https://www.postgresql.org/message-id/1727535.1692240032%40sss.pgh.pa.us>
Precedence: bulk

"James Pang (chaolpan)" <chaolpan@cisco.com> writes:
> So,  insert into values(chr(226)||chr(128)||chr(166)) actually got store=
d in database with LATIN1 with single byte sequence, but when query select=
 * from testutf8, it got converted to UTF8 three byte sequence first ? =


There are no LATIN1 characters that have longer than 2-byte UTF8
representations, so no.

I think your fundamental misunderstanding is supposing that this:

	chr(226)||chr(128)||chr(166)

produces something equivalent to the UTF8 sequence 0xe2 0x80 0xa6.
It will not, no matter which server encoding you are dealing with.
It will produce something that is three separate characters
according to the server encoding.  In LATIN1, that could well be
the byte sequence 0xe2 0x80 0xa6, but *that byte sequence does not
mean the same thing that it would mean in UTF8 encoding*.

You also seem not to grasp the fact that an encoding conversion
will happen between your client and the server if client_encoding
is different from server_encoding.  Because of that, the output of
a SELECT command doesn't prove much of anything here.

			regards, tom lane