public inbox for [email protected]
help / color / mirror / Atom feedFrom: Durgamahesh Manne <[email protected]>
To: Adrian Klaver <[email protected]>
Cc: pgsql-general <[email protected]>
Subject: Re: Records count mismatch with logical replication
Date: Thu, 23 Jan 2025 08:23:18 +0530
Message-ID: <CAJCZkoLatfwsQ-puesPfjrYtUmaAwokWQvqShoTGfJ56QzLfQw@mail.gmail.com> (raw)
In-Reply-To: <[email protected]>
References: <CAJCZko+gYNGiixGcqKAhjhLhUZ3QQg2rGs6nH7ZUNwTtjYLfGw@mail.gmail.com>
<[email protected]>
<CAJCZko+HhLFkiDLDPg3fscUEO4uWyEFT4_e6GBMeywnnwRC-rg@mail.gmail.com>
<[email protected]>
<CAJCZkoLZb5ON_T-YecS3-1sQjiGUVLdgKjS93thQyzZKiaWuFQ@mail.gmail.com>
<[email protected]>
<CAJCZkoJgAh_T_NJU5Jn3mzJJQE4LE-tDEjEyP37gKNR1X0cDWQ@mail.gmail.com>
<[email protected]>
On Wed, 22 Jan, 2025, 03:11 Adrian Klaver, <[email protected]>
wrote:
> On 1/21/25 11:40, Durgamahesh Manne wrote:
> >
> >
> > On Wed, 22 Jan, 2025, 00:22 Adrian Klaver, <[email protected]
> > <mailto:[email protected]>> wrote:
> >
> >
> >
> > On 1/21/25 10:06 AM, Durgamahesh Manne wrote:
> >
> > >
> > > Hi Adrian Klaver
> > >
> > > 22,906,216 bytes/10,846 rows works out to 2112 bytes per row.
> > >
> > > Is that a reasonable per row estimate?
> > >
> > > Yes sometimes would be vary
> >
> > If I am following the lag went from 350GB behind to 22MB.
> >
> > Is the issue that the lag has stalled at 22MB?
> >
> > >
> > > Regards,
> > > Durga Mahesh
> > >
> >
> > --
> > Adrian Klaver
> > [email protected] <mailto:[email protected]>
> >
> >
> > Hi Adrian Klaver
> >
> > Is the issue that the lag has stalled at 22MB?
> >
> > Depends on load of source
> > The lag would be either decrease or increase in Kb 's and Mb's (not Gb's)
> > It s not constant as Data being replicated to target
>
> Previously you stated:
>
> "Both are under same vpc security groups"
>
> Does this refer to AWS?
>
> If so per:
>
> https://docs.aws.amazon.com/vpc/latest/userguide/what-is-amazon-vpc.html
>
> "The following diagram shows an example VPC. The VPC has one subnet in
> each of the Availability Zones in the Region, EC2 instances in each
> subnet, and an internet gateway to allow communication between the
> resources in your VPC and the internet."
>
> So where are the two Postgres instances physically located relative to
> each other?
>
> >
> > But records count varies with difference of more than 10 thousand
>
> Have you looked at the I/0 statistics between the Postgres instances?
>
> >
> > How to mitigate this issue in simplest way ?
>
> Until it is determined what is causing the lag there is no way to deal
> with it.
>
> >
> > Regards
> > Durga Mahesh
>
> --
> Adrian Klaver
> [email protected]
>
>
>
> Hi
Hi
⁹So where are the two Postgres instances physically located relative to
each other?
Both in lreland under same vpc security groups
>
> But records count varies with difference of more than 10 thousand
Have you looked at the I/0 statistics between the Postgres instances?
Seems everything looks good with pg replication slots
Does this pg logical slot get changes function help to pull pending changes
to subscription that can be sync with publication server for real time sync
?
Regards,
Durgamahesh
view thread (13+ messages) latest in thread
reply
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: [email protected]
Cc: [email protected], [email protected], [email protected]
Subject: Re: Records count mismatch with logical replication
In-Reply-To: <CAJCZkoLatfwsQ-puesPfjrYtUmaAwokWQvqShoTGfJ56QzLfQw@mail.gmail.com>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox