pg.ddx.io pgsql-bugs@postgresql.org mailing list archive
help / color / mirror / Atom feedLogical Replication not working for few Tables
6+ messages / 4 participants
[nested] [flat]
* Logical Replication not working for few Tables
@ 2021-11-12 14:36 Padmakumar Kadayaprth <padmakumark26@gmail.com>
2021-11-12 19:00 ` Re: Logical Replication not working for few Tables Euler Taveira <euler@eulerto.com>
2021-11-16 03:42 ` Re: Logical Replication not working for few Tables Amit Kapila <amit.kapila16@gmail.com>
0 siblings, 2 replies; 6+ messages in thread
From: Padmakumar Kadayaprth @ 2021-11-12 14:36 UTC (permalink / raw)
To: pgsql-bugs@lists.postgresql.org
Hi All,
I configured logical replication some time back .Now except for 4 table
replication is happening.Few weeks back replication got stopped because of
some conflict and these 4 tables were part of that conflict. Someone
resolved the conflict but replication has not started for these four tables
.I dropped these tables from publication and added it back and refreshed
the subscription but still replication is not happening for these four .
For testing I created a new table and added it to publication and refreshed
subscription , that was sussues.
Is there any system table where these 4 tables are marked as conflict and
not to be replicated?
Why is replication not happening only to those four tables.is this a bug?
Thanks,
Padmakkumar
^ permalink raw reply [nested|flat] 6+ messages in thread
* Re: Logical Replication not working for few Tables
2021-11-12 14:36 Logical Replication not working for few Tables Padmakumar Kadayaprth <padmakumark26@gmail.com>
@ 2021-11-12 19:00 ` Euler Taveira <euler@eulerto.com>
2021-11-13 08:28 ` Re: Logical Replication not working for few Tables Padmakumar Kadayaprth <padmakumark26@gmail.com>
1 sibling, 1 reply; 6+ messages in thread
From: Euler Taveira @ 2021-11-12 19:00 UTC (permalink / raw)
To: Padmakumar Kadayaprth <padmakumark26@gmail.com>; pgsql-bugs@lists.postgresql.org
On Fri, Nov 12, 2021, at 11:36 AM, Padmakumar Kadayaprth wrote:
> I configured logical replication some time back .Now except for 4 table replication is happening.Few weeks back replication got stopped because of some conflict and these 4 tables were part of that conflict. Someone resolved the conflict but replication has not started for these four tables .I dropped these tables from publication and added it back and refreshed the subscription but still replication is not happening for these four . For testing I created a new table and added it to publication and refreshed subscription , that was sussues.
You didn't provide enough information. Is it native logical replication or
another tool (pglogical, Slony, etc)? What's the exact version?
> Is there any system table where these 4 tables are marked as conflict and not to be replicated?
There is no system table/view that shows the conflicts. You have to inspect your
log files.
> Why is replication not happening only to those four tables.is this a bug?
It is hard to guess without at least the error messages.
--
Euler Taveira
EDB https://www.enterprisedb.com/
^ permalink raw reply [nested|flat] 6+ messages in thread
* Re: Logical Replication not working for few Tables
2021-11-12 14:36 Logical Replication not working for few Tables Padmakumar Kadayaprth <padmakumark26@gmail.com>
2021-11-12 19:00 ` Re: Logical Replication not working for few Tables Euler Taveira <euler@eulerto.com>
@ 2021-11-13 08:28 ` Padmakumar Kadayaprth <padmakumark26@gmail.com>
0 siblings, 0 replies; 6+ messages in thread
From: Padmakumar Kadayaprth @ 2021-11-13 08:28 UTC (permalink / raw)
To: Euler Taveira <euler@eulerto.com>; +Cc: pgsql-bugs@lists.postgresql.org
I am using postgresql 11 on windows.it is native logical replication.
Unfortunately I deleted old logs before seeing this issue . Now replication
is happening without any issue for all the tables without any issue other
than these four table.So there is no error in the log.
I am really stuck .
I am thinking of doing a work around.
After dropping four tables from publication,
if i am creating four new tables ,import data from old tables to new tables
,drop old tables and rename newly created tables to the actual table name
which i dropped and add it back to publication and refresh subscription .
Does this step help me in fixing this issue because the id of the relation
will change even though I have the same table name.
Any thoughts?
Thanks,
Padmakumar
On Fri, Nov 12, 2021 at 11:00 PM Euler Taveira <euler@eulerto.com> wrote:
> On Fri, Nov 12, 2021, at 11:36 AM, Padmakumar Kadayaprth wrote:
>
> I configured logical replication some time back .Now except for 4
> table replication is happening.Few weeks back replication got stopped
> because of some conflict and these 4 tables were part of that conflict.
> Someone resolved the conflict but replication has not started for these
> four tables .I dropped these tables from publication and added it back and
> refreshed the subscription but still replication is not happening for these
> four . For testing I created a new table and added it to publication and
> refreshed subscription , that was sussues.
>
> You didn't provide enough information. Is it native logical replication or
> another tool (pglogical, Slony, etc)? What's the exact version?
>
> Is there any system table where these 4 tables are marked as conflict and
> not to be replicated?
>
> There is no system table/view that shows the conflicts. You have to
> inspect your
> log files.
>
> Why is replication not happening only to those four tables.is this a bug?
>
> It is hard to guess without at least the error messages.
>
>
> --
> Euler Taveira
> EDB https://www.enterprisedb.com/
>
>
^ permalink raw reply [nested|flat] 6+ messages in thread
* Re: Logical Replication not working for few Tables
2021-11-12 14:36 Logical Replication not working for few Tables Padmakumar Kadayaprth <padmakumark26@gmail.com>
@ 2021-11-16 03:42 ` Amit Kapila <amit.kapila16@gmail.com>
2021-11-16 15:02 ` Re: Logical Replication not working for few Tables Padmakumar Kadayaprth <padmakumark26@gmail.com>
1 sibling, 1 reply; 6+ messages in thread
From: Amit Kapila @ 2021-11-16 03:42 UTC (permalink / raw)
To: Padmakumar Kadayaprth <padmakumark26@gmail.com>; +Cc: PostgreSQL mailing lists <pgsql-bugs@lists.postgresql.org>
On Fri, Nov 12, 2021 at 8:06 PM Padmakumar Kadayaprth
<padmakumark26@gmail.com> wrote:
>
> Hi All,
> I configured logical replication some time back .Now except for 4 table replication is happening.Few weeks back replication got stopped because of some conflict and these 4 tables were part of that conflict. Someone resolved the conflict but replication has not started for these four tables .I dropped these tables from publication and added it back and refreshed the subscription but still replication is not happening for these four .
>
The refresh won't do anything if the tables have already been
replicated previously.
> For testing I created a new table and added it to publication and refreshed subscription , that was sussues.
>
> Is there any system table where these 4 tables are marked as conflict and not to be replicated?
>
No.
> Why is replication not happening only to those four tables.is this a bug?
>
It is quite surprising that replication changes for a few tables is
getting skipped whereas it is successful for others. One guess is that
new changes are updates and deletes of rows that didn't exist in the
tables on subscriber-side, as one might have removed/changed those
rows while resolving conflicts. If that happens then we log the
message at DEBUG1 log level.
I think you can try to construct an independent test on the same lines
and resolve conflict in a similar way and then see what is happening?
--
With Regards,
Amit Kapila.
^ permalink raw reply [nested|flat] 6+ messages in thread
* Re: Logical Replication not working for few Tables
2021-11-12 14:36 Logical Replication not working for few Tables Padmakumar Kadayaprth <padmakumark26@gmail.com>
2021-11-16 03:42 ` Re: Logical Replication not working for few Tables Amit Kapila <amit.kapila16@gmail.com>
@ 2021-11-16 15:02 ` Padmakumar Kadayaprth <padmakumark26@gmail.com>
2021-11-16 15:19 ` Re: Logical Replication not working for few Tables Tom Lane <tgl@sss.pgh.pa.us>
0 siblings, 1 reply; 6+ messages in thread
From: Padmakumar Kadayaprth @ 2021-11-16 15:02 UTC (permalink / raw)
To: Amit Kapila <amit.kapila16@gmail.com>; +Cc: PostgreSQL mailing lists <pgsql-bugs@lists.postgresql.org>
I created new tables and renamed the old tables like table_old .
ex: Table Node to node_old and node_new to node
But still replication is not happening with the four tables .I added
node_old to publication and subscribed to it .It worked fine .
What I am seeing is a table with a specific name is not getting replicated
. I am not sure why .
On Tue, Nov 16, 2021 at 7:42 AM Amit Kapila <amit.kapila16@gmail.com> wrote:
> On Fri, Nov 12, 2021 at 8:06 PM Padmakumar Kadayaprth
> <padmakumark26@gmail.com> wrote:
> >
> > Hi All,
> > I configured logical replication some time back .Now except for 4
> table replication is happening.Few weeks back replication got stopped
> because of some conflict and these 4 tables were part of that conflict.
> Someone resolved the conflict but replication has not started for these
> four tables .I dropped these tables from publication and added it back and
> refreshed the subscription but still replication is not happening for these
> four .
> >
>
> The refresh won't do anything if the tables have already been
> replicated previously.
>
> > For testing I created a new table and added it to publication and
> refreshed subscription , that was sussues.
> >
> > Is there any system table where these 4 tables are marked as conflict
> and not to be replicated?
> >
>
> No.
>
> > Why is replication not happening only to those four tables.is this a
> bug?
> >
>
> It is quite surprising that replication changes for a few tables is
> getting skipped whereas it is successful for others. One guess is that
> new changes are updates and deletes of rows that didn't exist in the
> tables on subscriber-side, as one might have removed/changed those
> rows while resolving conflicts. If that happens then we log the
> message at DEBUG1 log level.
>
> I think you can try to construct an independent test on the same lines
> and resolve conflict in a similar way and then see what is happening?
>
>
> --
> With Regards,
> Amit Kapila.
>
^ permalink raw reply [nested|flat] 6+ messages in thread
* Re: Logical Replication not working for few Tables
2021-11-12 14:36 Logical Replication not working for few Tables Padmakumar Kadayaprth <padmakumark26@gmail.com>
2021-11-16 03:42 ` Re: Logical Replication not working for few Tables Amit Kapila <amit.kapila16@gmail.com>
2021-11-16 15:02 ` Re: Logical Replication not working for few Tables Padmakumar Kadayaprth <padmakumark26@gmail.com>
@ 2021-11-16 15:19 ` Tom Lane <tgl@sss.pgh.pa.us>
0 siblings, 0 replies; 6+ messages in thread
From: Tom Lane @ 2021-11-16 15:19 UTC (permalink / raw)
To: Padmakumar Kadayaprth <padmakumark26@gmail.com>; +Cc: Amit Kapila <amit.kapila16@gmail.com>; PostgreSQL mailing lists <pgsql-bugs@lists.postgresql.org>
Padmakumar Kadayaprth <padmakumark26@gmail.com> writes:
> What I am seeing is a table with a specific name is not getting replicated
> . I am not sure why .
What's the problematic name exactly? If it involves upper-case letters,
maybe you were sloppy about double-quoting it on one or both ends of the
setup?
regards, tom lane
^ permalink raw reply [nested|flat] 6+ messages in thread
end of thread, other threads:[~2021-11-16 15:19 UTC | newest]
Thread overview: 6+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2021-11-12 14:36 Logical Replication not working for few Tables Padmakumar Kadayaprth <padmakumark26@gmail.com>
2021-11-12 19:00 ` Euler Taveira <euler@eulerto.com>
2021-11-13 08:28 ` Padmakumar Kadayaprth <padmakumark26@gmail.com>
2021-11-16 03:42 ` Amit Kapila <amit.kapila16@gmail.com>
2021-11-16 15:02 ` Padmakumar Kadayaprth <padmakumark26@gmail.com>
2021-11-16 15:19 ` Tom Lane <tgl@sss.pgh.pa.us>
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox