Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.89) (envelope-from ) id 1gPxDF-0004hV-7v for pgsql-hackers@arkaria.postgresql.org; Thu, 22 Nov 2018 22:12:41 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.89) (envelope-from ) id 1gPxDC-0000oR-Ao for pgsql-hackers@arkaria.postgresql.org; Thu, 22 Nov 2018 22:12:38 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.89) (envelope-from ) id 1gPxDC-0000oK-3X for pgsql-hackers@lists.postgresql.org; Thu, 22 Nov 2018 22:12:38 +0000 Received: from mail-yw1-xc2c.google.com ([2607:f8b0:4864:20::c2c]) by magus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.89) (envelope-from ) id 1gPxD9-0002Hl-HG for pgsql-hackers@postgresql.org; Thu, 22 Nov 2018 22:12:37 +0000 Received: by mail-yw1-xc2c.google.com with SMTP id d190so4093459ywd.12 for ; Thu, 22 Nov 2018 14:12:34 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=2ndquadrant-com.20150623.gappssmtp.com; s=20150623; h=from:subject:to:cc:references:message-id:date:user-agent :mime-version:in-reply-to:content-transfer-encoding:content-language; bh=I7CJ+14iLFjR7hTZTypShX3EQ27h7I20GQsQz2kk/HI=; b=FxSrjlCQqtLfarsDfdorkYtlNM/AENxKirLf9rflT9N6TGv1QeYz45lbWBsSWOAQlT Qwq8sCFq1fPzKs/myOchTzTkngo259NdIeV7Bbip8zA7H4TlYDlpB6mU9F6EIvOnaMTs D32GKGSYwFAQSKoQKBK6m9H1G97dPvCI2sA+8f01fI3gKOPHCoFraL7+8lqw0TwUf+4j t11fZMo2c+9uONTg5ASHPmAkDPYzrIVCRnISP+DBuZ20P5/qgvBpNEgbxnxyiLwtAq+T O6GyAeG9wJxBFU1E5t4Wm3cdpzIQzzY5dVIMZerT+2iVC6OdYgLw3r5fyXklTxfUjJN8 v+Kg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:subject:to:cc:references:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding :content-language; bh=I7CJ+14iLFjR7hTZTypShX3EQ27h7I20GQsQz2kk/HI=; b=pvojM1+4yGCVljVp2x9fryPPXTIDoq996faoWX26byey1MMACiR7G4NV9EfXPudL+7 SFGzKguC7popJtop7eVShlHBuQsbN3NN1WpXIAbRe9g2RbZl7DY4i0eezehJmUp9m1+M kKo+ZxnebR6l85bkC6iqfW9tPnQGUJci2+3lOMoSEDt/Gr16wWJlfo9kNlGOh0gOxYiw U2AYu9MX54JKL8PcbToe4hg368ylaTPBo5gnr2uj7MmSCh3m8Uf2smnaotO01jALBOkf W1hv+BK1UWGj1KgWxvBewWgFKAmhCkF/RD/ggdMMbZXk5mTGajPa/DkJ5apM6gHGY6zT RpcQ== X-Gm-Message-State: AGRZ1gKWZDtAjGocBLAOR7p/oe/6phhQe7xPuogtuOEH8/PYxBCyrnxA CLPsS8m7KAWy3TqVqImWNSJWofdnt69/dquFXJS6mm5xmRYM7S2nRlMGsJRMPccryrY/lrIoC62 lJBNPpmoacCyV79O4x2QmRZmiqJ2EfoPa3qXRtm/yZW3lUkMAJzCHg6y1SCxNvH34AHzHB5Krl7 5HJG+iYqGqgn12 X-Google-Smtp-Source: AJdET5dyl8VFmeUwGV3G1YB+ajuDCuXNKoowXUg20gA7LLceEq/JXjJDzzQksSqCpFSIEOXU5K3X1w== X-Received: by 2002:a81:f207:: with SMTP id i7-v6mr13485637ywm.499.1542924753288; Thu, 22 Nov 2018 14:12:33 -0800 (PST) Received: from [192.168.10.146] ([98.122.175.38]) by smtp.gmail.com with ESMTPSA id a71sm9503776ywe.66.2018.11.22.14.12.32 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 22 Nov 2018 14:12:32 -0800 (PST) From: Andrew Dunstan X-Google-Original-From: Andrew Dunstan Subject: Re: [RFC] Removing "magic" oids To: Andres Freund Cc: pgsql-hackers@postgresql.org References: <20180930034810.ywp2c7awz7opzcfr@alap3.anarazel.de> <20181114080152.xkk6coduvfrh4ntr@alap3.anarazel.de> <20181115014807.kqhndjzbvdmkbkhv@alap3.anarazel.de> <20181120095227.tgc5edxjqegobtkg@alap3.anarazel.de> <20181121000759.dgcbhr2nizkcfjhk@alap3.anarazel.de> <91a8a980-41bc-412b-fba2-2ba71a141c2b@2ndQuadrant.com> <02C51EE4-D0AE-4855-AF39-7EBC9D0CBB96@anarazel.de> <20181122001415.ef5bncxqin2y3esb@alap3.anarazel.de> <20181122211452.3bffatkaknmrvkdq@alap3.anarazel.de> Message-ID: <37786ace-8622-e4ba-43b5-50496f88b68d@2ndQuadrant.com> Date: Thu, 22 Nov 2018 17:12:31 -0500 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.3.0 MIME-Version: 1.0 In-Reply-To: <20181122211452.3bffatkaknmrvkdq@alap3.anarazel.de> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Content-Language: en-MW List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Precedence: bulk On 11/22/18 4:14 PM, Andres Freund wrote: > Hi, > > On 2018-11-21 23:32:07 -0500, Andrew Dunstan wrote: >> On 11/21/18 7:14 PM, Andres Freund wrote: >>> Could you check whether you >>> still encounter the issue after applying the attached fix? >>> >> >> This has largely fixed the problem, so I think this should be applied. > Cool, will do so tomorrow or such. Thanks for testing. > > >> With some adjustments to the tests to remove problematic cases (e.g. >> postgres_fdw's ft_pg_type) the tests pass. The exception is >> HEAD->HEAD. The change is that the LOs are not dumped in the same >> order pre and post upgrade. I can change the tests to allow for a >> greater fuzz factor - generally when the source and target are the >> same we don't allow any fuzz. Or if we care we could do a better job >> of dumping LOs in a consistent order. > So you'd want to dump large objects in oid order or such? Probably > comparatively not a huge overhead, but also not nothing? We don't really > force ordering in other places in pg_dump afaik. > Well, all other data is dumped in a consistent order, and the tests rely on this. If we don't care about that for LOs I can accommodate it. I don't have a terribly strong opinion about the desirability of making LOs keep the same behaviour. cheers andrew -- Andrew Dunstan https://www.2ndQuadrant.com PostgreSQL Development, 24x7 Support, Remote DBA, Training & Services