Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1r1ECu-00A6OR-RF for pgsql-hackers@arkaria.postgresql.org; Thu, 09 Nov 2023 23:13:05 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1r1ECt-00HQrB-Dy for pgsql-hackers@arkaria.postgresql.org; Thu, 09 Nov 2023 23:13:03 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1r1ECr-00HQr3-LG for pgsql-hackers@lists.postgresql.org; Thu, 09 Nov 2023 23:13:03 +0000 Received: from out3-smtp.messagingengine.com ([66.111.4.27]) by makus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1r1ECo-004oNb-JX for pgsql-hackers@postgresql.org; Thu, 09 Nov 2023 23:13:00 +0000 Received: from compute7.internal (compute7.nyi.internal [10.202.2.48]) by mailout.nyi.internal (Postfix) with ESMTP id 17B0F5C0304; Thu, 9 Nov 2023 18:12:57 -0500 (EST) Received: from mailfrontend2 ([10.202.2.163]) by compute7.internal (MEProxy); Thu, 09 Nov 2023 18:12:57 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=anarazel.de; h= cc:cc:content-transfer-encoding:content-type:content-type:date :date:from:from:in-reply-to:in-reply-to:message-id:mime-version :references:reply-to:sender:subject:subject:to:to; s=fm3; t= 1699571577; x=1699657977; bh=jI/9UwoP6DKHvMqI/Lg8qnEgDbeDknNdS/L UwwZNFJ8=; b=jFPdIlxSRk98atRg20IfslRJSxb01iQ6otxtgv8/FP8gky5u0jl lxHjxqjhXmtnbCkD/Pz54e0cRtJ8e/CkNGjk15MMn7r5jSnN/5UymkIbLJHl6xhl OaPI3zMZlCHuX25OsqXJ2RcYKXKoZVU1AIpGqf5ncWRoIAzIT/8B3jP/A6ngk/0q t7U3HLvXv5DtEwT13QE+bOTAxJcwscAQ5YkW9ZPm0S1EO8BAsjk2iJuS7alr+uxC 3jCXlJ+w78NwRE0TfvKcYD7xcLQAkmoRgGpXcTwEaGigm+yAZ8wXbwUCzF+foAIT W/MvQwZ4M9fb2ruN2c2swAJWTLLXosPk9oQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:cc:content-transfer-encoding :content-type:content-type:date:date:feedback-id:feedback-id :from:from:in-reply-to:in-reply-to:message-id:mime-version :references:reply-to:sender:subject:subject:to:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm3; t= 1699571577; x=1699657977; bh=jI/9UwoP6DKHvMqI/Lg8qnEgDbeDknNdS/L UwwZNFJ8=; b=MV5XHUORUnxIfQlOFDNtyVe0hanGibTe4F6w5Dd3hTPmTBfsPDE tUZIVHIF8K8NOyaWwfz9otZuZ4HpqzUZ5PJdODMqpcO0ngHy6VIYxEX3tyAN+c8S by3X5vTVLNTcXr2MIsSL7DrRFOGsKmEim99wUMkqijRPxop4qY068d70a4v+TI6N a0acp5fgsztuY9FrudxA+h2dmaOPgJkBqo6bm4NDXg/CnnP5zHP4VQ6jgrkPFVAQ nk5zIQXzg7mkRl4tdrr3ii9kKGFLEAc1SIk5V6jhenErYKDecYoPNPUdgWn74KBL yeQkI1Hk1UDlKNsbdpLm41OMV8JczxaX0MQ== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvkedruddvvddgtdeiucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne cujfgurhepfffhvfevufgfjghfkfggtgfgsehtqhhmtddtreejnecuhfhrohhmpeetnhgu rhgvshcuhfhrvghunhguuceorghnughrvghssegrnhgrrhgriigvlhdruggvqeenucggtf frrghtthgvrhhnpefhgfekheettdegveevtddthfelueehjedvteevfffhgfejudeigeej geekiedtffenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhroh hmpegrnhgurhgvshesrghnrghrrgiivghlrdguvg X-ME-Proxy: Feedback-ID: id4a34324:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA; Thu, 9 Nov 2023 18:12:55 -0500 (EST) Date: Thu, 09 Nov 2023 15:12:50 -0800 From: Andres Freund To: pgsql-hackers@lists.postgresql.org, Tom Lane , "Kumar, Sachin" CC: Jacob Champion , Nathan Bossart , Jan Wieck , Bruce Momjian , Zhihong Yu , Andrew Dunstan , Magnus Hagander , Robins Tharakan , Peter Eisentraut , "pgsql-hackers@postgresql.org" Subject: Re: pg_upgrade failing for 200+ million Large Objects User-Agent: K-9 Mail for Android In-Reply-To: <1152134.1699555261@sss.pgh.pa.us> References: <986904.1616525964@sss.pgh.pa.us> <6cccaa33-c263-b8a2-b064-985605d33d25@wi3ck.info> <988415.1616528159@sss.pgh.pa.us> <872315a8-99fc-da4e-463d-784cfb5a025d@wi3ck.info> <1010642.1616532950@sss.pgh.pa.us> <802b96e9-f5e1-015c-dfb9-8756974b11fc@wi3ck.info> <0263bf35-05d6-02a1-519b-b7895a918314@wi3ck.info> <20220825003227.GA1456581@nathanxps13> <663393ca-b2ff-26f0-2e2d-adc942aff4fd@timescale.com> <20220908231807.GA2242918@nathanxps13> <0643CC11-223A-4039-AC34-94E127462796@amazon.com> <1152134.1699555261@sss.pgh.pa.us> Message-ID: MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk Hi,=20 On November 9, 2023 10:41:01 AM PST, Tom Lane wr= ote: >Also, pg_upgrade is often invoked indirectly via scripts, so I do >not especially buy the idea that we're going to get useful control >input from some human somewhere=2E I think we'd be better off to >assume that pg_upgrade is on its own to manage the process, so that >if we need to switch strategies based on object count or whatever, >we should put in a heuristic to choose the strategy automatically=2E >It might not be perfect, but that will give better results for the >pretty large fraction of users who are not going to mess with >weird little switches=2E +1 - even leaving everything else aside, just about no user would know abo= ut the option=2E There are cases where we can't do better than giving the u= ser control, but we are certainly adding options at a rate that doesn't see= m sustainable=2E And here it doesn't seem that hard to do better=2E=20 Andres=20 --=20 Sent from my Android device with K-9 Mail=2E Please excuse my brevity=2E