Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1oxlf4-0004Kk-NQ for pgsql-hackers@arkaria.postgresql.org; Wed, 23 Nov 2022 09:03:19 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1oxlf3-0007yl-I7 for pgsql-hackers@arkaria.postgresql.org; Wed, 23 Nov 2022 09:03:17 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1oxlf2-0007yc-LR for pgsql-hackers@lists.postgresql.org; Wed, 23 Nov 2022 09:03:17 +0000 Received: from sonic319-25.consmr.mail.gq1.yahoo.com ([98.137.66.206]) by makus.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.92) (envelope-from ) id 1oxlez-0002ma-Cy for pgsql-hackers@lists.postgresql.org; Wed, 23 Nov 2022 09:03:15 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1669194190; bh=NdxfGnJ+H/pJXvbbfcAtmj3JoxQxDshNw73ATqM/e7U=; h=Date:From:Reply-To:To:In-Reply-To:References:Subject:From:Subject:Reply-To; b=g3kJ6pYLEL6bEHzZ+HFloyzDduVxoE0azvZ/t+5rIrg1sxlb10HGxjkAYkE/qQROjcdOccS1dXX7fpZbggQsEHptna+V90dLR+3ynUwUIbUIMa2hDO5WoFljLhEtspj1tkZ/3UUdvLBsrXyID6kfoj/OZ92hNJk7kEz14jBc2rrqyABoOIFRb3hHz2w1BXnPjsBAbTo1rXqgJsvOAM35aDaXu7EBkEnyl18x1lyvuf+hjYmJpMl4jp5HhC2DToSjNGQVzsM5Y3HsFx/w2GpR0K4z0+7lImmWEz9hl1dMVB5D449vh9k7OW+OvobN/gLKillLDn5gAQQ1H2bGNtSwXQ== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1669194190; bh=G4fEOBBLRcZqVYnljzStQKWAEQC1Sz7Rm/jEmFxyz0U=; h=X-Sonic-MF:Date:From:To:Subject:From:Subject; b=hNos4lnHkWoJNZyhASlkZJjO8l6z8HVkPKWdJPQYaJAqkVjDcpDvTVDflQJrmMCEHHDJoQkDNcxUqglr0d3b0+BIePR5W/ijVm2J9n+rCihsT5z5BwbMAr35nLVe+P65f/hKgGfIqBQvtJeabKHKHOeXfCeINhgrU8/ACDkk5aNNNfiYf2XM4ccGgfXcSluWcl/lLql8+qjANDQVekynvnOncFjni38Wx+bTNd03nTXhRZKFnyF3d5ZPMwKq/0nDWHu+aA8HkuCsfdYsqJ49QFEiVRQ6z5BDX96qVYNdOYHerEMMSS3JWvyGRdArg6VGhx4oH7GLwu3qcizyWV0iEw== X-YMail-OSG: cmp3s8UVM1lnxUPWnz3TQBBXD1vODG3xKSnbjb4aIFRHbw33avrcXImjf80vwWd kPXyVoywAOR_kqZAn_zejM_oHZ3v4whIualQ4x1oOvymU9.ySJXMxag.dn0mmDQ5NOLtcoFnyKP5 072AaG8pbACG23cIVvkdRmZL0pVJzf75tOh31HNL8OeHAERt7cPq.YLsaUP3if9PgDJ2Dv6mFUpn aXmJn9VY18ufOCJJ41AdXKaDU7vgFzQDYCt3lLn2t4w86VlPA7pCTMCFs0IXqUdKixAEEM3N80bv x5q2HgIxBZixWYMhDSRFApNxjrQ3WSSDk2vRa9cRryhosNdoYzwMzwZI66juERkT_8QgQGL8Jx5v mvrRrSao.AXXidUMhBER10dG3t0YDANSXEpOzGMpWfsbKQwHz5a.u3aqPhsDXz0DNtJkrf1gWdyx KdA_ImcNCAEBlGghB4mktIdhj_xwEbsZplh7tSSim9WgU9Ne0xUSzRTQXyLPsgNudpYn_ucHtdQ8 lihbB_44tZpVd_mvmTsKQzcKK4rCXn.AwPYjkInq3ElN6DcwPXcyybFwFQasqufg6cqE7kKsXh7X AcHjaSGQHbSFDOGgfT7VfDaH0COYRhRdIHujXISAwG7_ee2dl1TB2knD28cSXEawC98eHysCFFBd eGimDc_Co.XzGsL0rxugyoXtbaXFTvrnlkABPpCY0BdCBsYydPgIqlTcapfjuel7eK6WXhnEs4IP KeT2M5oUcLzRIC.MC5dvuv_QAtXC.u1.j0gXKnIDEuaQxewwOLYtWpOqSP9z78YqMyUUB4IjViQV W1Q2tEb7n1f9eL6nDSkA0JoGyd8DQoqnsa0iDFrIIKuMk0drF7QMPmg4BduhMWVTbtcj4GNDM8zg nOAQQjDIcqA2m4.1X8.FBm76P2emk8hkHJp2PCGFBgFEJ3wl4U1h5TQ.5uKHkhUXyQPhNPAfSvxc nOmT.U9ETxWzK6SKUaDgupWzQqiFlgc0skTOhsRYZuJXlZXOpMUCJWmVWCUYdAFStkXrdRA3pZg5 cgTHV9U.U_jrHndYeE0b4s7_Yxo49utHrOGD74aBjlDvezM2jXK7bYosYtxdW3DWHzmYqtLPLEgl wQC6Bb63FtdOrqEaHI6mEKMxXrIMOO6UYadYqqMPJqaTn0iNh.LNF_CNZdol0DlKDN.swR.azfgB nHqDnhu9sY2g.OjXl7.ujfanOQtU78TLKy9bhc61Ej.3mGDaGubherU8BY3Qab.TzOf7tYq9NGrg sdVzm6DS2iM_JJY5q3Tvk5.EDaSLmAJmfKwGklBmOnsqMJcY.TKpYMoHJWVyl6f9q8b58GlfJvlh 6.uAiA9xR84fPE0xXR6aNe5LP9wQZ.2tAFFTZWqL4o6qTNwpzCp4ly9_2DbnRtXcVt14OULBIa0A VT3AUum8PhSgnybGTppQI0WGt42ynJ9OO6ExAAbo6tHBEYIeOm6qB8uX3QyqBMePiyPHmbu1t_h0 bm62Sfn_VxlSsSPbZJXGE_WFuV3xwViep._ZFEnKlNx7vHXAwFBChUoU_TI21EgoXOurj05XyHpR bxNdzP7RYAAgzU_Y1re2joS2dvZJgXaCZT8dExaCuy0T.E9U0PFnIy1vAuORKBqiwchRZch3Ith. beOskY3txxR41.WZHN2bseTt_IEb2VHctzZ3d6gbh_p8NOkFoOSv_Hglg.JUmY7tLDZJ6aK0hwn9 TU4.8s7BZHGhiShWzUaTbkiBXJxjMugBbY5jk.2oN0CLZuHIsXrbkQNo5ha7KKfeKhFvUaFdTkOx k_BQ66WYPka567VyY6ia27gE.MwK9.Fl9XawboF_PNtj2yO.WOB6q0YOc0.B93mMJDMILGtpNJaC zfBUETI_51e.dNryvu7RvGS3Ad3iJkmu3Qxuzh7aI.WuQWJEv8ifuthqrR1Rsr7faCXP8q24T6jN sq0tDUMMfyZdLz8V0KmjoheOjgqs74W58VfSzxgJa3CnHrp5riwl1ME1syt3ariBPobLFFcaiv3L m1evbhjm6fyIWjBDZtdgAEPJoOlGJMIW5njMc0IqMOvE.nHBMixkTgcp1YAD4qGPHkdFw8k2sa6K NxKjk_LGPuRPF8towfIyhl3FnhL4EBaFJbbMO2JgOlEa5NFmJ65tV.BFHoh6ZavZYrt82slYw98V KRa8LjukQpetknA_MpbbbuQTRbeesFaH0BYlQBWZo2YF_8raYFZ1M1IwW2UDDtriQkgTM0sWcmWP YOaD.ZFAZggkS5uV8JWG6hhyRkAE6OpLimcqCGf.oz_W8STY- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic319.consmr.mail.gq1.yahoo.com with HTTP; Wed, 23 Nov 2022 09:03:10 +0000 Date: Wed, 23 Nov 2022 09:03:05 +0000 (UTC) From: Boboc Cristi Reply-To: Boboc Cristi To: PostgreSQL Hackers , Peter Smith Message-ID: <89363341.1728627.1669194185204@mail.yahoo.com> In-Reply-To: References: <166870632180.632.14582512493527657072@wrigleys.postgresql.org> Subject: Re: Logical replication missing information MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_1728626_936620228.1669194185201" X-Mailer: WebService/1.1.20863 YMailNorrin Content-Length: 19741 List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk ------=_Part_1728626_936620228.1669194185201 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hello!Thank you very much, the information you just sent to me is very, ver= y valuable! Best regards, Cristi Boboc=20 On Wednesday, November 23, 2022 at 04:45:09 AM GMT+2, Peter Smith wrote: =20 =20 On Fri, Nov 18, 2022 at 4:50 AM PG Doc comments form wrote: > > The following documentation comment has been logged on the website: > > Page: https://www.postgresql.org/docs/15/logical-replication-row-filter.h= tml > Description: Hi, FYI - I have forwarded this post to the hacker's list, where I think it will receive more attention. I am not sure why that (above) page was cited -- the section "31.3 Row Filters" is specifically about row filtering, whereas the items you reported seem unrelated to row filters, but are generic for all Logical Replication. > > There are several things missing here and some of them I found to be high= ly > important: > 1. How can I find why a logical replication failed. Currently I only can = see > it "does nothing" in pg_stat_subscriptions. There should be logs reporting any replication conflicts etc. See [1] for example logs. See also the answer for #2 below. > 2. In case of copying the existing data: how can I find which tables or > partitions were processed and which are on the processing queue (while > monitoring I have observed no specific order or rule). There is no predictable processing queue or order - The initial tablesyncs might be happening in multiple asynchronous processes according to the GUC max_sync_workers_per_subscription [2]. Below I show examples of replicating two tables (tab1 and tab2). ~~