public inbox for [email protected]  

help / color / mirror / Atom feed

From: Jaime Casanova <[email protected]>
To: Adrian Klaver <[email protected]>
Cc: Postgres General <[email protected]>
Subject: Re: encoding problem while inictial copy in logical replication
Date: Tue, 30 Sep 2025 08:39:24 -0500
Message-ID: <CAJKUy5j3ZQSC4h3sa8sSDOvNTGu7v5TnV2t9gLfKR2DRTp6PDQ@mail.gmail.com> (raw)
In-Reply-To: <[email protected]>
References: <CAJKUy5gJ-MCaZ4KGnhz4SLDZ2fecYxpvDHfgSgCm5n3f9OHx+A@mail.gmail.com>
	<[email protected]>

On Tue, Sep 16, 2025 at 12:44 PM Adrian Klaver
<[email protected]> wrote:
>
> On 9/16/25 04:01, Jaime Casanova wrote:
> > Hi,
> >
> > I have a database with UTF8 encoding. This database seems to be
> > receiving data in WIN1252 encoding from some client.
> >
[...]
> >
> > Some time ago I tried to create a logical replication, for a speed up
> > I used I created a physical replica and converted it in a logical one
> > and it works fine.
> > But the I tried to add a new table to the replica, so I added it to
> > the publication and when I "ALTER SUBSCRIPTION .... REFRESH
> > PUBLICATION" got this error.
> >
> > 2025-09-16 08:20:24.971 UTC [1535715] LOG:  logical replication table
> > synchronization worker for subscription "sub1", table "new_table" has
> > started
> > 2025-09-16 09:20:23.037 UTC [1535715] ERROR:  character with byte
> > sequence 0x8d in encoding "WIN1252" has no equivalent in encoding
> > "UTF8"
> > 2025-09-16 09:20:23.037 UTC [1535715] CONTEXT:  COPY new_table, line 2489
> > 2025-09-16 09:20:23.041 UTC [1463234] LOG:  background worker "logical
> > replication worker" (PID 1535715) exited with exit code 1
> >
[...]
> >
> > Any idea? Currently my process is to manually copy the data.
>
> Read this?:
>
> https://www.i18nqa.com/debug/bug-double-conversion.html
> https://www.i18nqa.com/debug/utf8-debug.html
>
> Bottom line 0x8d is unassigned in WIN1252 and there is no UTF8
> equivalent for it and four other code points.
>
> The solution would seem to be determining what is using this code point
> and stopping it's use if possible.
>

But then, why pg_dump works if it's also using COPY?

--
Jaime Casanova
SYSTEMGUARDS
Director de servicios profesionales

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: [email protected]
  Cc: [email protected], [email protected]
  Subject: Re: encoding problem while inictial copy in logical replication
  In-Reply-To: <CAJKUy5j3ZQSC4h3sa8sSDOvNTGu7v5TnV2t9gLfKR2DRTp6PDQ@mail.gmail.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox