Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1u2Yqr-002TvK-8e for pgsql-hackers@arkaria.postgresql.org; Wed, 09 Apr 2025 17:04:37 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1u2Yqp-005Ytw-MT for pgsql-hackers@arkaria.postgresql.org; Wed, 09 Apr 2025 17:04:36 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1u2Yqp-005Yt1-CR for pgsql-hackers@lists.postgresql.org; Wed, 09 Apr 2025 17:04:35 +0000 Received: from mail-yw1-x1134.google.com ([2607:f8b0:4864:20::1134]) by makus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.96) (envelope-from ) id 1u2Yqn-003ub4-1Z for pgsql-hackers@lists.postgresql.org; Wed, 09 Apr 2025 17:04:34 +0000 Received: by mail-yw1-x1134.google.com with SMTP id 00721157ae682-6ef60e500d7so58789707b3.0 for ; Wed, 09 Apr 2025 10:04:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1744218272; x=1744823072; darn=lists.postgresql.org; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:from:to:cc:subject:date:message-id:reply-to; bh=TrmVBvivkHHN1DnhLe1c375ZKRrMDx5mwF+/z6PVmwo=; b=Bbq4qGUHPJaTWpo69SF9q0wdhlVYHDKnEKgAylGdc5ArCYkrRVw1uxX6ECQzDSGDZY 2P1QGHRa3TVxxLNokcer4nZdg1iB/1Gv1aaAkpe0fQzGzngVAh8rZSHTf6vfrO7mIHuQ zfBGQflurnnSjoi5esDlThy7RLXTByIBOPmWPVJtT98Z9VZqzA04T7Fx6dWHRlMwkP5Y 8voPUtc+0j+7d3Pn8yacJ6afZ9TjwHUtFtfSW4WEvrLR7VaKmOXIApV9PBHn1aq12MYz Dh0aCUPJGl2mU9YRbDRlc8xkrQE8wk5nASzFZo42lnXBxPzL7dU4wmr3vhMhcvYnUPL8 RMmQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1744218272; x=1744823072; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=TrmVBvivkHHN1DnhLe1c375ZKRrMDx5mwF+/z6PVmwo=; b=ZXQxTNH/JRlEhGoIY4fw18nNwIsudKp/YkSDDGzhPzucA/QBvjG+c+Z8A6icrXbRG8 8v2DaT83s4yLQ1F2KpLyYYjlNBM+qLwSMtTdZFlvnpmV8B7Ii8nNS2F8TdbFc1OgBlJH 3hpo58b7eRhIuAE24cawfQb7rS5p1Ve/6SmGem9yz/sUBzD6gQhQ4bByINyUzOmXDzy4 mfZGJxPBDaPzzim+nICp2jJ45yMQT18b3kflGyBfHPXBcDDWoto5k26WZHhahRROcooV AXoOEkADVMWNE4xoQVefjI1A41qPZMeCQf/oOBly+65chlmotNnGczgvrEOo8pOrPUHk NIaw== X-Gm-Message-State: AOJu0YxZDjIgpuLsA15z9fzlyO4D6tjFN5uh3UEgwCX8v/fF+OnctBm2 PKw80ectRj2YIkZOF0TVM1AjCd/m0LqXUVDI6KFWbe4gMweXm+kBpFLKCA== X-Gm-Gg: ASbGncs83R68wWlpvzf3tdCkAGUaCVDvLlxTi30tUVhTaSC1PdxHK8QzR3lHgQy7Bk+ im/XzWgvQN63b7J8PhWDStJUrNumF30ro8GVEFZrwGUhj1/sK2DLzQe5svVg9R/ghXLTZnnJ1Up 3yf/LFEe5/7BzJ+qaOludRS9tOH91adF48HfU0TUXZvVi3TDHNqqAm1VI3pGR8fsR2IFiNXlZGa 0qWHfCGe0sx0EEG2Hf3kWeFP0LBQNkQBEk67uSon0iZiiUNEZNzWoLDevGlBq+BfwT7xE2QsQEj cmN5kzvkyDeN5nL8IGMwf6/LOI+6RdB9SBfZpD11n0UCqUKM5iye5nYc3ZeSYzmmzj34eTatQdP UChTYwTqQA2U3qC1hm0J6i+bktKfeqzk= X-Google-Smtp-Source: AGHT+IEhy+OkxWLnnFqx6XxK2w0snOCAswYb12qDxm8ME7J89OnSe2Q3eK4KS667VzhoRPEGYDfXbA== X-Received: by 2002:a05:690c:25c5:b0:6fd:22fb:f21b with SMTP id 00721157ae682-70538806d93mr63622157b3.18.1744218263859; Wed, 09 Apr 2025 10:04:23 -0700 (PDT) Received: from nathan (162-195-168-172.lightspeed.stlsmo.sbcglobal.net. [162.195.168.172]) by smtp.gmail.com with ESMTPSA id 00721157ae682-7053e372edcsm3457087b3.85.2025.04.09.10.04.22 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 09 Apr 2025 10:04:23 -0700 (PDT) Date: Wed, 9 Apr 2025 12:04:21 -0500 From: Nathan Bossart To: Jan Wieck Cc: pgsql-hackers@lists.postgresql.org Subject: Re: Horribly slow pg_upgrade performance with many Large Objects Message-ID: References: <4044567.1744128814@sss.pgh.pa.us> <4047312.1744130263@sss.pgh.pa.us> <4050387.1744132029@sss.pgh.pa.us> <4054965.1744134140@sss.pgh.pa.us> <287aef2b-36e8-446c-bd15-bfc8e8272c2f@wi3ck.info> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <287aef2b-36e8-446c-bd15-bfc8e8272c2f@wi3ck.info> List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk On Tue, Apr 08, 2025 at 05:37:50PM -0400, Jan Wieck wrote: > I remember an incident where large amounts of LOs ran pg_upgrade into a > transaction-ID wrap around because the restore part would create individual > single statement transactions per LO to create, then change permissions and > ownership and finally fill in the data. Could that be related here? I believe commits 74cf7d4 and 959b38d have largely fixed that problem. -- nathan