Message-ID: <287aef2b-36e8-446c-bd15-bfc8e8272c2f@wi3ck.info>
Date: Tue, 8 Apr 2025 17:37:50 -0400
MIME-Version: 1.0
User-Agent: Mozilla Thunderbird
Subject: Re: Horribly slow pg_upgrade performance with many Large Objects
To: pgsql-hackers@lists.postgresql.org
References: <Z_RO37whB1L2LbiD@nathan>
 <CAMT0RQRL08=Si+9V7RW7VKcbo2H7GO6ME3opkS_WHpE8qctBLg@mail.gmail.com>
 <Z_VE4Q4A2nNCX3Ny@nathan> <4044567.1744128814@sss.pgh.pa.us>
 <CAMT0RQSALxZ2DJbq0b5cy+cvmpVxkawmv7c+qTWYObubZVr+2g@mail.gmail.com>
 <4047312.1744130263@sss.pgh.pa.us> <Z_VTucTiS01p-d6z@nathan>
 <4050387.1744132029@sss.pgh.pa.us> <Z_VbON4DZn0wPvUN@nathan>
 <4054965.1744134140@sss.pgh.pa.us> <Z_VtcQxi_i78-yjg@nathan>
 <CAMT0RQQFZHZvftObnG9OAHE=bOhuVA_ymp6pG+dLfS66o-EGNA@mail.gmail.com>
Content-Language: en-US
From: Jan Wieck <jan@wi3ck.info>
In-Reply-To: <CAMT0RQQFZHZvftObnG9OAHE=bOhuVA_ymp6pG+dLfS66o-EGNA@mail.gmail.com>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
Archived-At: <https://www.postgresql.org/message-id/287aef2b-36e8-446c-bd15-bfc8e8272c2f%40wi3ck.info>
Precedence: bulk

On 4/8/25 15:41, Hannu Krosing wrote:
> On Tue, Apr 8, 2025 at 8:39 PM Nathan Bossart <nathandbossart@gmail.com> wrote:
>>
> ...
>>
>> I've also verified that the dependency information is carried over in
>> upgrades to later versions (AFAICT all the supported ones).
> 
> If I remember correctly the change to not copying
> pg_largeobject_metadata data file but instead moving LOs as part of
> schema was done in v12 when oid,, which had been a system column in
> v11, became a user column, so upgrade to v11 is likely also missing
> the dependencies
> 
> 

I remember an incident where large amounts of LOs ran pg_upgrade into a 
transaction-ID wrap around because the restore part would create 
individual single statement transactions per LO to create, then change 
permissions and ownership and finally fill in the data. Could that be 
related here?


Regards, Jan