Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1nK8GO-0000CU-3e for pgsql-hackers@arkaria.postgresql.org; Wed, 16 Feb 2022 00:33:44 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1nK8GN-0002c2-0U for pgsql-hackers@arkaria.postgresql.org; Wed, 16 Feb 2022 00:33:43 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1nK8GM-0002bs-NE for pgsql-hackers@lists.postgresql.org; Wed, 16 Feb 2022 00:33:42 +0000 Received: from wout1-smtp.messagingengine.com ([64.147.123.24]) by magus.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1nK8GJ-0001KE-UG for pgsql-hackers@postgresql.org; Wed, 16 Feb 2022 00:33:42 +0000 Received: from compute3.internal (compute3.nyi.internal [10.202.2.43]) by mailout.west.internal (Postfix) with ESMTP id D38783200EAD; Tue, 15 Feb 2022 19:33:36 -0500 (EST) Received: from mailfrontend2 ([10.202.2.163]) by compute3.internal (MEProxy); Tue, 15 Feb 2022 19:33:37 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:cc:content-transfer-encoding :content-type:date:date:from:from:in-reply-to:in-reply-to :message-id:mime-version:reply-to:sender:subject:subject:to:to :x-me-proxy:x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s= fm2; bh=HYlWTUlwxjCirmMgbnFr1ivgS5ilqMjulKgj65mWKII=; b=i3liaDHM B0xT2aXfScI3ZqhMVz8vd1c6ulVKn+mbP19Xpm+qeOcJbOoEdKIzTRyiIZW/JKXx NybcLa4GxGb3ZfBnSQ3tqrIMlgHb9CI2NYPlW4PwMqaW1wdocfyXLhbxMEMuTBD4 7SDgzUvBMlx4MmtpiIE8ueTCp3a/VsLLx1+v1StMjaJny29dXHJ6/ISV8QJv4Qyi Yp+p4gnAj/ncQIU+oxAksuETF5ti3nKVnxdjudiVuHksTb5USkQIKLgBPppBfU61 Vi3TwyTHY9Zq4+S6hSl2LZpXllf3jQK2Mp3AlYVqVPYLYVf/zeRGsLqIdhrfsMa1 3KgDJwT2CJzGzQ== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvvddrjeehgddvvdcutefuodetggdotefrodftvf curfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfghnecu uegrihhlohhuthemuceftddtnecusecvtfgvtghiphhivghnthhsucdlqddutddtmdenuc fjughrpeffhffvuffkgggtugfgjgesthekredttddtjeenucfhrhhomheptehlvhgrrhho ucfjvghrrhgvrhgruceorghlvhhhvghrrhgvsegrlhhvhhdrnhhoqdhiphdrohhrgheqne cuggftrfgrthhtvghrnhepudejveejffejveduudetvdekieeuiedtvdeileefkeevjedu feeguedvjefhueelnecuffhomhgrihhnpegvnhhtvghrphhrihhsvggusgdrtghomhenuc evlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhmpegrlhhvhhgv rhhrvgesrghlvhhhrdhnohdqihhprdhorhhg X-ME-Proxy: Received: by mail.messagingengine.com (Postfix) with ESMTPA; Tue, 15 Feb 2022 19:33:35 -0500 (EST) Received: by perhan.alvh.no-ip.org (Postfix, from userid 1000) id A291F2A0A85; Tue, 15 Feb 2022 21:33:32 -0300 (-03) Date: Tue, 15 Feb 2022 21:33:32 -0300 From: Alvaro Herrera To: Tomas Vondra Cc: Peter Eisentraut , Justin Pryzby , Amit Kapila , "houzj.fnst@fujitsu.com" , Rahila Syed , Peter Smith , pgsql-hackers@postgresql.org Subject: Re: Column Filtering in Logical Replication Message-ID: <202202160033.suwczmeq7mjf@alvherre.pgsql> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk On 2022-Feb-16, Tomas Vondra wrote: > Here's an updated version of the patch, rebased to current master. Parts > 0002 and 0003 include various improvements based on review by me and another > one by Peter Smith [1]. Thanks for doing this! > 1) partitioning with pubviaroot=true I agree that preventing the inconsistencies from happening is probably the best. > 2) merging multiple column filters > > When the table has multiple column filters (in different publications), we > need to merge them. Which works, except that FOR ALL TABLES [IN SCHEMA] > needs to be handled as "has no column filter" (and replicates everything). Agreed. > 3) partitioning with pubivaroot=false > > When a partitioned table is added with (pubviaroot=false), it should not be > subject to column filter on the parent relation, which is the same behavior > used by the row filtering patch. You mean each partition should define its own filter, or lack of filter? That sounds reasonable. -- Álvaro Herrera 39°49'30"S 73°17'W — https://www.EnterpriseDB.com/ "Pensar que el espectro que vemos es ilusorio no lo despoja de espanto, sólo le suma el nuevo terror de la locura" (Perelandra, C.S. Lewis)