Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1a936n-00050p-9K for pgsql-hackers@arkaria.postgresql.org; Wed, 16 Dec 2015 03:50:33 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.84) (envelope-from ) id 1a936m-0005oM-K0 for pgsql-hackers@arkaria.postgresql.org; Wed, 16 Dec 2015 03:50:32 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84) (envelope-from ) id 1a935S-0004IK-N0 for pgsql-hackers@postgresql.org; Wed, 16 Dec 2015 03:49:10 +0000 Received: from mail-bl2on0065.outbound.protection.outlook.com ([65.55.169.65] helo=na01-bl2-obe.outbound.protection.outlook.com) by magus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84) (envelope-from ) id 1a935N-0002Vd-7a for pgsql-hackers@postgresql.org; Wed, 16 Dec 2015 03:49:09 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=BlueTreble.onmicrosoft.com; s=selector1-bluetreble-com; h=From:To:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=fkDa/EXyZGTezAVbYuY8RV9d1HuQ6iVo/9ycg9ZUdw0=; b=ClAVweMDeqe92RNPEYoYFRscaCmWIP5HkcPXqmbNBhYZUOMGOxjcW0qkuYPREZU1u91/f1T0LjAQathavTyFvQTb9HMnOYn7xIEO7gyPgLhoeFajwsuto6Ls8OM3vMI+DZrtHOi2brRJy/3ar2N8uGrnk+icrg24BwkTYo/cEWI= Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=Jim.Nasby@bluetreble.com; Received: from [192.168.1.10] (97.77.122.57) by BLUPR11MB0675.namprd11.prod.outlook.com (10.163.216.145) with Microsoft SMTP Server (TLS) id 15.1.355.16; Wed, 16 Dec 2015 03:48:59 +0000 Subject: Re: Logical replication and multimaster To: David Fetter , Craig Ringer , Jon Erdman References: <565C7756.9070604@postgrespro.ru> <20151211101608.GN14789@awork2.anarazel.de> <20151213133737.GA28490@fetter.org> CC: Robert Haas , Andres Freund , Simon Riggs , Konstantin Knizhnik , pgsql-hackers From: Jim Nasby Message-ID: <5670DF24.7090101@BlueTreble.com> Date: Tue, 15 Dec 2015 21:48:52 -0600 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9; rv:38.0) Gecko/20100101 Thunderbird/38.4.0 MIME-Version: 1.0 In-Reply-To: <20151213133737.GA28490@fetter.org> Content-Type: text/plain; charset="windows-1252"; format=flowed Content-Transfer-Encoding: 7bit X-Originating-IP: [97.77.122.57] X-ClientProxiedBy: BY2PR1001CA0073.namprd10.prod.outlook.com (25.164.163.41) To BLUPR11MB0675.namprd11.prod.outlook.com (25.163.216.145) X-Microsoft-Exchange-Diagnostics: 1; BLUPR11MB0675; 2:a85tjLnL6bJvNdtFNOaakNEV3rx5+GrLHmBDZLpuWDY3GeNcw/oX4R/wmVXFkH8ozqaSOtLOW3Hv92h2jb9uCDXXQh4OqA4SXECnWQK1ZD8/XFBo4lLkTKZkfrksYfTAK8FeLdzP7qIwQqgaEYOm5A==; 3:f3iK27Zppphff4DX6GCBY2V5W1FUc+CGD22o0PM3MFkU8ZYL8dRVQ7hvV+ubtSaWhMbwD5neYLtlH0D/03QgBz2iSOQkJEvTIRn59MtYOOGCuG+lVfwUtsMc6c1YxdNh; 25:3yAC/5hvj1D/vDVbrl/+udGqSJkSwwecdSF/NPihF1qPsDXCp5t+eM9CYLq5ytxaus2jihiA2T0A8uf5G4k55Te57nP5t246V+YYkJaQ5X7j2haVUIMHWIR08M8W2mM5DSppMvaLmvV0XZ618V/pBa11BmQUG9z2U1brtHwZXLCWk+q6vTIXuU8duzB8EiDCrFJqc9N5CYpSC/rGM3e5gB45UShpqJqTxQZytIAlB7RdRZ84SyNi8e1odbGBlRVTGb0doDX5UMTSTVolcuMSIA==; 20:5ICiZ8/tUGOMLyZPoW8Ji5Ll7mopkuSvKptBUOqnqAugKHf/ThDpG5z8Zzmsk+gJDhacs5k2Q6Y6VQ74aQfJYs4fUsDUz8T9og2C2LTz3g6oOW5Y8Baf4GbfcRKllqAfB4o708VpFNQydHZOO00reJnRlPmuONQhExaDLF5ya0I= X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:BLUPR11MB0675; X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:; X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(601004)(2401047)(8121501046)(520078)(5005006)(3002001)(10201501046); SRVR:BLUPR11MB0675; BCL:0; PCL:0; RULEID:; SRVR:BLUPR11MB0675; X-Microsoft-Exchange-Diagnostics: 1; BLUPR11MB0675; 4:pQYwxiZ/vWQ1fLF2MClgkgUGpdFKsZGHNwcKx5FxfEM9yzgsXuFclBZ7zaLuBjnVxDfJEan5e8QdwAP0jNh3S3U1/SZQJ4U1aAtXmrGmpaP5nTxx8ulB7NVJ75xl9CluPlmiIwccN88KjMzmEt6UpE5nFBxbYt4EIvePLb3r84iOrU+JF7L+0oAM4lzA3rWpNv8MvQ+LcfbrBwX9kihhF/OLAU2Vbd/4SCMgbcMUWSQB0SzJvycP+wcYY0OfCfk8zZoQFXKbUuDBADWLiL8zY6I8QXF4TLF0cqe/2o9AOtPo1h84J2WqHjgSy8KDAARx2HaUKSK86+9+EQyF6s6s0+YcxHitg69PG37I38EFm0CaGQLMVnAKWMsbKGlAjDwJ X-Forefront-PRVS: 0792DBEAD0 X-Forefront-Antispam-Report: SFV:NSPM; SFS:(10009020)(6049001)(6009001)(24454002)(377454003)(479174004)(189002)(199003)(92566002)(66066001)(87266999)(47776003)(54356999)(86362001)(230700001)(2950100001)(77096005)(65956001)(87976001)(1096002)(6116002)(586003)(40100003)(3846002)(5008740100001)(122386002)(65806001)(64126003)(36756003)(4001350100001)(33656002)(106356001)(50986999)(81156007)(15975445007)(50466002)(189998001)(23746002)(105586002)(101416001)(65816999)(97736004)(117156001)(5001770100001)(5001960100002)(83506001)(80316001)(76176999)(59896002)(19580395003)(42186005)(5004730100002)(93886004)(85282002)(336755003)(18886065003); DIR:OUT; SFP:1101; SCL:1; SRVR:BLUPR11MB0675; H:[192.168.1.10]; FPR:; SPF:None; PTR:InfoNoRecords; MX:1; A:1; LANG:en; Received-SPF: None (protection.outlook.com: bluetreble.com does not designate permitted sender hosts) X-Microsoft-Exchange-Diagnostics: =?Windows-1252?Q?1; BLUPR11MB0675; 23:sF7KSlTmLjeAYdjQfKwL6GH0TGpbdHrn3Pe5N?= =?Windows-1252?Q?XvTzA/Q5aiGQVwGJ9UvA7l6BZTbyP7kIBP787sbmpbiMArgYUwu/FCWZ?= =?Windows-1252?Q?p80vGh+IHw+QNcn58+ZPBaqRDwdk6yFL6GN7QGa/8ZPehKlLvoMpE+2N?= =?Windows-1252?Q?GmtEXD/JxJTKlD08N+xru07LJZ0NrP9xXnixrgUiu4xcjKQ4so/lvrZe?= =?Windows-1252?Q?zr32EJY/RrCnrHZh2ST1i8zcj5ywx6XN/5BYRFSpgxoIruQNkWuoAyW6?= =?Windows-1252?Q?6bUyySTphE+t2wuDffFwKaBO8XzlnO5Vh6r7x5e8fxjsheBJ2M4Xk8j3?= =?Windows-1252?Q?dmPVKMH+dJ0iszK5rH6CfG5ynUqT4j24bV82EwLUSNKyTgffd9RZ9GRN?= =?Windows-1252?Q?2s5wEN/WVEfJObcmamS9oW3/jNXxc2/e/gvDi+IyRXGlBcfJw95xAPgZ?= =?Windows-1252?Q?6Oau7LJPlrGahJLndt3y3NhMTyUqFRjowtjSoBJQ2ukgGLwVFynyBlel?= =?Windows-1252?Q?ahI8JgcBGJe9eSValhPTdoKbe3+h/EACjBC5lX2EwuPytWww/skmHIc/?= =?Windows-1252?Q?99qifLLerTTDoyhwhQY3IFGhM7zpqaIh27MBxVN+Txr8GTl4SQhGIZp4?= =?Windows-1252?Q?w9u+BV3WWRcvTwSy2Q+1oj/GXNoswQS/vG7WAIXlAO/4KxQkwm6Sa18l?= =?Windows-1252?Q?B8Ka5XN/Xexq+DRZ0kooyT9n9z1r+I/Bgw4IzPIVD+OJ45JrWZxFpgLf?= =?Windows-1252?Q?oceC2B1RrnJig/yW8abGYZ/886W3TTPoKDp/qq00Q7p1+W8KkT+SCUfv?= =?Windows-1252?Q?sAh78uoYRQ0sl3pBVjvx5arNbl3T3Wr6ratwFpNABqDfalXWF4ysjv0i?= =?Windows-1252?Q?lJG71RmuT5KtWeHf5t4H+RN+QCvY/6RINi8JP1OuXj1vfWqfYsNlo0AW?= =?Windows-1252?Q?cC021XSgMCG3gcmDDSf05+FPA0WQlZ6IsYV2Ci71umz/+zr+b96hCLp6?= =?Windows-1252?Q?imTij9evlr2Lah1mO7am3i9rxcrKu1VQJBiEtn91yaJgNbAa1TC0nuaI?= =?Windows-1252?Q?nc79sSG0lyqKdKyuaDBV3olJ2oTMeXE/30EcLiNiLka3kitlxYU6y93j?= =?Windows-1252?Q?RN/UnRBdEuZULbP7/ZRNszkux4TdYujPmOS3kK5tvx25ZolbSWfq3MNw?= =?Windows-1252?Q?PXZzjwUqrbe/8fWVWHw22SQAxs6/xRZC933B1455IUz2enn6ZzeNKpsS?= =?Windows-1252?Q?RRI5UJABuqOmSGqnwBYp+QTnWadBnNHLXr/bAhxOm4M1+wMQYPgxI1fO?= =?Windows-1252?Q?0wXsUDDaoxwMnu5ur09lUp0TMKMCNeihL/sdx4R2s49zIWaiTEXRGoP5?= =?Windows-1252?Q?pDxPWPqXvkH+VE6fFiXl1kmn47kjWJKgkbHkWR/8djpboOqx8JNB3uo/?= =?Windows-1252?Q?0boJb26KXqD7SVah9PEK0WE5I7AmT7ZKOjXC4Jch1xB8edGj0JkmqVkj?= =?Windows-1252?Q?6XR/5FPlJKU+HevwOPBNSbmZt0UkIJ7bvm9yMARluxLBlUCjw=3D=3D?= X-Microsoft-Exchange-Diagnostics: 1; BLUPR11MB0675; 5:yckkUJ1vhaS3Cu/ga6QYv5JWrd5G8Xkmwoi+hNK2P7PfLFnVx0euNOrEEsqdKu+Sico+s8FYTHl7yFTcQzykCBmBnaYJMdVgfnaLRPsy4WS2lOOTcKLRARrjBTQTSg2W6bSSa3wRQQIzB9qpPPPfRw==; 24:rUgw2acU10/O3fEHQ/xkPXVLcMSF4X8/LDDnW/edOzEVpB+8IzoBL4DtjJA085n4rGjgaxgY+X1714H+i5zxeMl8uZX/Nus/7St0T2ht0Wk= SpamDiagnosticOutput: 1:23 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: bluetreble.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 16 Dec 2015 03:48:59.6621 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: BLUPR11MB0675 X-Pg-Spam-Score: -1.9 (-) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-hackers Precedence: bulk Sender: pgsql-hackers-owner@postgresql.org On 12/13/15 7:37 AM, David Fetter wrote: > As I understand it, pushing these into a library has been proposed but > not rejected. That it hasn't happened yet is mostly about the lack of > tuits (the round ones) to rewrite the functionality as libraries and > refactor pg_dump/pg_restore to use only calls to same. As usual, it's > less about writing the code and more about the enormous amount of > testing any such a refactor would entail. My understanding as well. IIRC Jon Erdman brought this question up a couple years ago and the response was "It'd probably be accepted, it's just that no one has done the work." > I believe that refactoring much of pg_dump's functionality for the > current version of the server into SQL-accessible functions and making > pg_dump use only those functions is achievable with available > resources. > > Such a refactor need not be all-or-nothing. For example, the > dependency resolution stuff is a first step that appears to be worth > doing by itself even if the effort then pauses, possibly for some > time. If someone wanted to spend time on this, I suspect it'd be worth looking at how bad some of the backward compatibility issues would be if done in the server. Maybe they wouldn't be that bad. I suspect the audience for this code would be much larger if it was in the server as opposed to a C library. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers