public inbox for [email protected]
help / color / mirror / Atom feedFrom: Amit Kapila <[email protected]>
To: Fabrice Chapuis <[email protected]>
Cc: Tang, Haiying/唐 海英 <[email protected]>
Cc: PostgreSQL Hackers <[email protected]>
Subject: Re: Logical replication timeout problem
Date: Thu, 23 Dec 2021 16:21:58 +0530
Message-ID: <CAA4eK1K0O27c7qbXE5V__LXZHi24jfR+B=JubHx2_a5gfiq+Pg@mail.gmail.com> (raw)
In-Reply-To: <CAA5-nLDPCCRS71Y78nTd47VgAqY16WuhoPCPTHbXi_rTyzXOXg@mail.gmail.com>
References: <CAA5-nLARN7-3SLU_QUxfy510pmrYK6JJb=bk3hcgemAM_pAv+w@mail.gmail.com>
<CAA4eK1JLerufRV4Zr4h-vW4Fjz6LJjd-QZxVywpFrtfvZhXVWg@mail.gmail.com>
<CAA5-nLC0NKo1VsKgf+jEEH=5jGAN2pyCivyG59yX3bQcLSL4tg@mail.gmail.com>
<CAA4eK1KHQfnhmdnLZQrRoAW3dYOPqXKtT5C54HoBno3MCtH4wA@mail.gmail.com>
<CAA5-nLCH-XbCknSx2nVMtCByj8pv3jyRFQxL0qj4FLwby4TyNg@mail.gmail.com>
<CAA4eK1KrJP=oMOu5VJKn1uZjn+Xq110AGUxJpBrp3jN7vWXVPg@mail.gmail.com>
<CAA5-nLA8C0LZdVDdPDNeWcJYGzGVV3nJ7Ni0PdSyHJNxi628ww@mail.gmail.com>
<CAA4eK1LeN1V85i2ZfU2cOj5vJjpEVSvJ6LOfAu-u7mfQrW=v1Q@mail.gmail.com>
<CAA5-nLDhnKRwsPF8z5+ej4D9P9WTfVuMeVsigxuO=+sjf0ruyQ@mail.gmail.com>
<CAA4eK1JYB2eLNTs48szQ8oJXW9GLcrxT0yWETQS0gF2sVBxMYA@mail.gmail.com>
<CAA5-nLCs+XwLma7KPo_GJTKnhXU2YcTD9igMC8uDJV76xk72zQ@mail.gmail.com>
<CAA4eK1JxqfG3v3+E3i=iO5eNK9R8qH_XjZe=POEnW1pRkJ287Q@mail.gmail.com>
<CAA5-nLBPuCJuzAFWnp9ogLT769GsZgH4zTdnXaiUXZh4E3LHSg@mail.gmail.com>
<CAA4eK1Ji-1xCBhwK_obYNmsp5Jv0eCyzeuOqPbOMmkm0Y4K4fw@mail.gmail.com>
<CAA5-nLCw26ih437yHnwg7NJxQ5LULVCXzF7_PwF3a0E2OYz58Q@mail.gmail.com>
<OS0PR01MB6113B93996BBA24F3B066474FBAA9@OS0PR01MB6113.jpnprd01.prod.outlook.com>
<CAA5-nLAVrBZtZ_o-tzbyizFOP3d9mAiG3XUOskShDW01ewfMgw@mail.gmail.com>
<CAA5-nLABf97QKAR8K8NiQs2s6_323dvd7kpAdJ3GZ+p2iR5K7A@mail.gmail.com>
<CAA4eK1LBN3vqjo=6LVO_FXPJJzEMaNGRSf5E6USmVx4cpab=5w@mail.gmail.com>
<CAA5-nLA9rSPWEfewyqAFU4-oXJBFhMYWnq15gWGPdGP5J8n3Qg@mail.gmail.com>
<CAA5-nLDPCCRS71Y78nTd47VgAqY16WuhoPCPTHbXi_rTyzXOXg@mail.gmail.com>
On Wed, Dec 22, 2021 at 8:50 PM Fabrice Chapuis <[email protected]> wrote:
>
> Hello Amit,
>
> I was able to reproduce the timeout problem in the lab.
> After loading more than 20 millions of rows in a table which is not replicated (insert command ends without error), errors related to logical replication processes appear in the postgres log.
> Approximately every 5 minutes worker process is restarted. The snap files in the slot directory are still present. The replication system seems to be blocked. Why these snap files are not removed. What do they contain?
>
These contain changes of insert. I think these are not removed for
your case as your long transaction is never finished. As mentioned
earlier, for such cases, it is better to use 'streaming' feature
released as part of PG-14 but anyway here we are trying to debug
timeout problem.
> I will recompile postgres with your patch to debug.
>
Okay, that might help.
--
With Regards,
Amit Kapila.
view thread (56+ messages) latest in thread
reply
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: [email protected]
Cc: [email protected], [email protected], [email protected], [email protected]
Subject: Re: Logical replication timeout problem
In-Reply-To: <CAA4eK1K0O27c7qbXE5V__LXZHi24jfR+B=JubHx2_a5gfiq+Pg@mail.gmail.com>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox