pg.ddx.io  pgsql-bugs@postgresql.org mailing list archive  

help / color / mirror / Atom feed
From: Tomas Vondra <tomas.vondra@enterprisedb.com>
To: Hayato Kuroda (Fujitsu) <kuroda.hayato@fujitsu.com>
To: 'depesz@depesz.com' <depesz@depesz.com>
Cc: Amit Kapila <amit.kapila16@gmail.com>
Cc: Kyotaro Horiguchi <horikyota.ntt@gmail.com>
Cc: pgsql-bugs@lists.postgresql.org <pgsql-bugs@lists.postgresql.org>
Subject: Re: Logical replication is missing block of rows when sending initial sync?
Date: Fri, 17 Nov 2023 15:40:35 +0100
Message-ID: <dd5c48d4-8962-d1c9-e71a-6bda23b86401@enterprisedb.com> (raw)
In-Reply-To: <TYAPR01MB5866C96DDABDB0D7F2850972F5B1A@TYAPR01MB5866.jpnprd01.prod.outlook.com>
References: <TYAPR01MB5866C2BE11AD4FBDC0AB46F0F5A1A@TYAPR01MB5866.jpnprd01.prod.outlook.com>
	<20231102.101713.170587046871054404.horikyota.ntt@gmail.com>
	<ZUOGohG9DArmXNvV@depesz.com>
	<CAA4eK1KDMp_hCFZo=KsbRUOn+JX70Te5BJcTKwfRrt2x++aXXA@mail.gmail.com>
	<ZUTh6bnNFHo35/Go@depesz.com>
	<a266b461-e340-10c6-d511-40f9edb37d28@enterprisedb.com>
	<ZUTmEi8mEoDl93Vm@depesz.com>
	<ZUt9FOueePOl2ZUp@depesz.com>
	<ZUuU2uKd4fW+8Ctp@depesz.com>
	<2a638962-7a62-abd6-d9a4-3c322ec2a06d@enterprisedb.com>
	<ZU4XkdOPCthiyN7L@depesz.com>
	<TYAPR01MB5866C96DDABDB0D7F2850972F5B1A@TYAPR01MB5866.jpnprd01.prod.outlook.com>

On 11/15/23 02:41, Hayato Kuroda (Fujitsu) wrote:
> Dear Tomas, Depesz,
> 
>>
>>> I'll try reproducing this locally over the weekend. Should I use the
>>> test_1030.sh script that you shared a week ago, or do I need to do
>>> something more?
>>
>> That question is probably not to me, but to Hayato Kuroda
> 
> Just FYI - As I posted, this script could not reproduce the issue. We may use the same table definition
> but I have not tried yet. I will let you know if I succeeded to reproduce.
> 

FYI I think I've reproduced the issue (with a different script), I've
started a thread on pgsql-hackers:

https://www.postgresql.org/message-id/de52b282-1166-1180-45a2-8d8917ca74c6%40enterprisedb.com

Obviously, I can't be sure it's exactly the same issue, but the symptoms
seem to match what Depesz reported (gaps in data etc.). I don't know
what the root cause is, or fix. But there's more info (and scripts) in
the hackers thread.

regards

-- 
Tomas Vondra
EnterpriseDB: http://www.enterprisedb.com
The Enterprise PostgreSQL Company





view thread (19+ messages)  latest in thread

Message-ID: <dd5c48d4-8962-d1c9-e71a-6bda23b86401@enterprisedb.com>
Permalink:  ../dd5c48d4-8962-d1c9-e71a-6bda23b86401@enterprisedb.com/
Also on:    postgresql.org/message-id/dd5c48d4-8962-d1c9-e71a-6bda23b86401@enterprisedb.com

 · 

reply
Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-bugs@postgresql.org
  Cc: tomas.vondra@enterprisedb.com, kuroda.hayato@fujitsu.com, depesz@depesz.com, amit.kapila16@gmail.com, horikyota.ntt@gmail.com, pgsql-bugs@lists.postgresql.org
  Subject: Re: Logical replication is missing block of rows when sending initial sync?
  In-Reply-To: <dd5c48d4-8962-d1c9-e71a-6bda23b86401@enterprisedb.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox