Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1kARZB-0005lA-8Z for pgsql-admin@arkaria.postgresql.org; Tue, 25 Aug 2020 05:32:17 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1kARZ9-0005ya-TL for pgsql-admin@arkaria.postgresql.org; Tue, 25 Aug 2020 05:32:15 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1kARZ9-0005yS-K0 for pgsql-admin@lists.postgresql.org; Tue, 25 Aug 2020 05:32:15 +0000 Received: from mout.gmx.net ([212.227.15.15]) by magus.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1kARZ7-00024z-E6 for pgsql-admin@lists.postgresql.org; Tue, 25 Aug 2020 05:32:15 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.net; s=badeba3b8450; t=1598333531; bh=lORO/zI9OAR/S6wLiQ/6T6cwuVpgi3Eh41Ds/w3AMJY=; h=X-UI-Sender-Class:From:Subject:To:Date; b=LYdTAjsI9kZzfffw5HmmMXZ4CXkRyBMgnMPmfX85AAchteqYkr6XryAPrzvrFCdi3 mU9eiPYsupQ3GVxp87bmW/85nDG1qf1Ks64bV2EszypOeXm8G9WFpfPDHDtiJk+mdX 7dvz9eI3MeD6dLK6asf9EKn560Q58ksfWtgnrb9M= X-UI-Sender-Class: 01bb95c1-4bf8-414a-932a-4f6e2808ef9c Received: from [10.1.35.214] ([185.40.248.10]) by mail.gmx.com (mrgmx004 [212.227.17.190]) with ESMTPSA (Nemesis) id 1M9FnZ-1kEaYm0a2B-006MQg for ; Tue, 25 Aug 2020 07:32:11 +0200 From: Thomas Kellerer Subject: How to debug logical replication error "columns are missing" if they are not To: pgsql-admin@lists.postgresql.org Message-ID: <6d2d142f-58b4-d2db-b271-700182b68b55@gmx.net> Date: Tue, 25 Aug 2020 07:32:09 +0200 User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.23) Gecko/20090812 Thunderbird/2.0.0.23 Mnenhy/0.7.6.666 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Language: de-DE Content-Transfer-Encoding: quoted-printable X-Provags-ID: V03:K1:05qya/jjiabkvtvLmsCI6YcVUSua2AAgIJyFHuCXbmRZLZm2ee1 twOHj/KrtC/xL0hYD8Js7yaLIFd64nrQhp6L2ov127e7LFozv7Hs2nViqnixBOQohiQ7av0 ETDx+uwXTbW5FAZM6NpgFyuUtXznkXS7XQ4h+HAzk3s7iQ6OaDkcC30mkLolR5JU2uQ291B 668mhiIoz+ItBYarwV1Ow== X-Spam-Flag: NO X-UI-Out-Filterresults: notjunk:1;V03:K0:+JVTq5FeXGY=:MljyEE+z/Iy6AY/T5Hl8iP rszMldsuxf2cRQWcw4AgU1jKuTdo+Uo6Cb8WkEduLHoT14uDkSha611Uq2FFVbzmM5uhRhOsm 8I2v1jbM5+vTTvmh9kkGJB+lyjCc6iq6aWfO/r2KZdSSP1HUL1rqe7jG5SDfoPTMvwIlVlTee 3TGBxToIQlUVZYwoEwkI7b+UXu+RpN9OGVwpW7jbFF0eH6PnwJR/oyvja44n/ycVrjFl9gfNc 6G+jB+M3i6x+Idkj6E5ar6iVvyrCyq5J88IO/8uvyYogWGIkYiBuLs0qRjQzY4GKrJNqu098w rq2okubM+Lj/sz9IPwuRAmcDRBLtN1OeAUYxoHEgqurcVulZe7Ah7NjvtREM1nAhqiC7H8rt0 O+KpawVVX56gbegjBQe99PPoIXUI/2tBp940Rb3UPPc1x8Gl2UgH8AVzgQk2sjLdQsLMwt4V4 fJTz1jrAA1o/VUVkiarTanlNhFwsXhnGQM5tJGklaFpPJLAFl+AP9QIOnZZgSyG2dK5Z8EFUj npTdBkkkY4mPbaxCJyGmAiM/pivsa2i1P/ZxbQGpH4EI4qyPitEN0wq2VGHzCpALjUbePYoF5 KbE6tsGAUnUROVhgvqch7i5mJ1yDvqisfaLHNXqgLRLxp9DOHI8Znvtfo2UWTkgymbBoLWUdW iJlYaI/Naj3ACI/G+EAQSUu9mQ+MDwvTsibYI/S7U3d7mk3ZSj5gV0U+qfqeowp0pMYw9b3GU pYj2hZ7r0VmpQLGG/DPJW0xhwGyfOon0FIFUz7rjh88EJr1dkn5vjaFMab4JFwVk2gmIDKDGD lvMqgH9LBrakD7C2rvjxd/q/qwRfF9R+pcdww+L47cv80OeIgFWr8Ov7iO3QlCAod0L/zrVHK 7FIavpBD6irLS4rsAucyAjYL2URQVDlmzedPx41edaImCuu2fAwDRCJm6+DrbtxatEHsKQQb+ Odz5kiDcj/dKITYbHmZOe3SQQPLDJUSIi7SfxdYyGbwVl5tq1wRdQM1rQ9CLz8WYFbj8aDL15 4NjJ7qyTnczLinIR2zKBuH0kzwaUieTQzVz7nyE0WnY0u/t9dY35ASpqc/pArtP2/iG7DcRLT hpL4mAAKj3zx88q9zRalqj0iNMgO7IsU/h5msC9hcmB22f/zAoZYrQYawoSO0yjUkC+hN6AsS GjG0pR9bTFyjcTvCgqzcR63f7KT4bGhwzbHz9PlwyHg9tDdldQf1+F8SqIRHwLk2rd83EPlo2 vElKAZlZ+FWRKxNAC List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Precedence: bulk Hello, we have a a logical replication from Postgres 11 to Postgres 12. We did some structural changes to the published tables. The changes to the= subscriber where applied about 60 minutes later then those on the publish= er. Obviously before the subscriber's tables where synced the replication = failed. But even though the tables are now completely identical, the subscriber st= ill claims: logical replication target relation "public.employee" is missing some = replicated columns I double checked multiple times that the tables are now identical by doing= a diff of the "pg_dump -s" outputs - they are identical in the CREATE TAB= LE part. The table is listed with state "r" (ready) in pg_subscription_rel How can I find out which columns it thinks are missing? And how do I convi= nce the subscriber that the tables *are* identical? Thanks in advance Thomas