Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.96) (envelope-from ) id 1vZkl6-00H0ti-1w for pgsql-hackers@arkaria.postgresql.org; Sun, 28 Dec 2025 07:00:09 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.96) (envelope-from ) id 1vZkl5-00ClWa-0M for pgsql-hackers@arkaria.postgresql.org; Sun, 28 Dec 2025 07:00:07 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.96) (envelope-from ) id 1vZkl4-00ClWS-2W for pgsql-hackers@lists.postgresql.org; Sun, 28 Dec 2025 07:00:07 +0000 Received: from mail-lf1-x12d.google.com ([2a00:1450:4864:20::12d]) by magus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.96) (envelope-from ) id 1vZkl2-003CQK-2J for pgsql-hackers@postgresql.org; Sun, 28 Dec 2025 07:00:06 +0000 Received: by mail-lf1-x12d.google.com with SMTP id 2adb3069b0e04-5958931c9c7so9382747e87.2 for ; Sat, 27 Dec 2025 23:00:04 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1766905203; x=1767510003; darn=postgresql.org; h=in-reply-to:from:content-language:references:cc:to:subject :user-agent:mime-version:date:message-id:from:to:cc:subject:date :message-id:reply-to; bh=opnHFrRgyH/zumuG0a5DpKC4gq3oNwDLyIoRT58gR5I=; b=TN31/Ulv4/2z7os+d5H6R1ZY9ZaCeauOGKrqiuYHhor07UeRDmtri+znrGu/oIrz8c dmmoOvDbmqnIya5l2ii4RTu31m9kZXE1MVJgjKMZQAe1jXyJ7VYVvYPhQYMAn/F3ikYi nY+3yTvduTKb9oaQNXyejSWPltxN01wnQkW1g3Z40HP2L80XXrkVl9EfHT3LEE4ySNqq boZHJnA4RPoDZws1dM1lFuEijz5TdZElGXh+WgCTl8lTtoULzG9aHjDH37LWrOBEaQjY hNLWB2gvYyhL9GIQmG2koHJykIeUfTpnhRKfBB9zq1neHY8giVZOtiI8PsJDelFBDrSY 92OA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1766905203; x=1767510003; h=in-reply-to:from:content-language:references:cc:to:subject :user-agent:mime-version:date:message-id:x-gm-gg:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=opnHFrRgyH/zumuG0a5DpKC4gq3oNwDLyIoRT58gR5I=; b=bj6aF+LXsfoRnhmHawFEbgs2izUVdsxK1bh2OhLmDJG2OOnPDD3r8m7Aadydl7OObC C7K2FXdkPMPENojw3SB0HFy9NLCcKJX43SZE41/iuiZwndfcWk/aw5oa0s5PbDkf8l5i Xy3awnOlG3fAR6gwfBYq477R913MsCmkTnB/AjooJysMOBvTcINisMwT9+YqYv36qk4B hFgWLJU+t0U/Cr5oXgQAhwz25YBHJrp8YvsUl4BfhlKF2HAKO98qNio8KiNWN02GK9BA GOXTvUNxy3rjZvv1sa/CEC+VBjbH6n3SN5F7Nob5N8jdLrK1uJm0s10LdA0K9I4mMueY RVAw== X-Forwarded-Encrypted: i=1; AJvYcCX0qdo1N+LV/KUlPo690rSdNG4D7aaVL0s4Qc8ZGFOXygSVEoGNRJ5A2OERN31e+LZZ3lwuN3nW2600/M1D@postgresql.org X-Gm-Message-State: AOJu0YzK6ogt7LlTKYysBZOCCG/oOGqgrTFFQzIS6/BLy/PZtzXSEsJE bCO3WUh6+m6flSBi5cz4O2UCFu719jV4Wrvoh/Fdi/qGpTvxo+tlzo63 X-Gm-Gg: AY/fxX6RNQz6U8M7lcql7BQNupr5qZ0kn3sOefkKN+xFvOOkzM+9ZrSi6DOcdnh78/y Te6kAF8k4AAAdsY1Mhp+9GOpDMZQv7Bz4tD3Y+MU9OMxBGeDZlXgJEtVaFc6+CRSQYNKZoDVTFb BC19dnpYNI9C82o6AcUNubLuDGVTg1xkScsxA7QbxnvtRLql6DP3o+oXko054pgvDXxlE/AYSGw R1i+L76AgiaVXL42hxrf2VRbXV3W7XJbjgD4K6n4gA3riwBLNshjAQpbjC2NOVJgY96YbI8EiU6 iVks/eOlUD2fVrHh79aGTYsDhMKv2UgAtNS2x1OU7T3kSapen0Wx8DwShOHwyCWBK7z1uMjfrB7 D2DghLAMKagNwtxYQS8BHbfd85Q7NoVDE69DEmYmbaSja0dpZyoRsZy+LWAzeYH9biWFYVriGpw y9OkrW/ImEUgRZ X-Google-Smtp-Source: AGHT+IHRlK+SHJ258n8BjHQ8aTDl2AC/u/iu+91XmSdXKOuGG7mFk0NbZXEKVgPDdCSOtQ4fvRdRCA== X-Received: by 2002:a05:6512:3050:b0:598:fb04:246 with SMTP id 2adb3069b0e04-59a17de2c32mr8472521e87.32.1766905203131; Sat, 27 Dec 2025 23:00:03 -0800 (PST) Received: from [192.168.0.50] ([89.149.93.129]) by smtp.gmail.com with ESMTPSA id 2adb3069b0e04-59b2958aa32sm3771743e87.19.2025.12.27.23.00.01 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sat, 27 Dec 2025 23:00:02 -0800 (PST) Content-Type: multipart/alternative; boundary="------------c1AbnsvS5aiWiC7yKI5sKo80" Message-ID: <61d3ce85-9c7b-4eea-bf83-81272cab00c3@gmail.com> Date: Sun, 28 Dec 2025 09:00:00 +0200 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: optimize file transfer in pg_upgrade To: Nathan Bossart Cc: Tom Lane , Robert Haas , Andres Freund , Greg Sabino Mullane , pgsql-hackers@postgresql.org, bruce@momjian.us References: <712605.1742401713@sss.pgh.pa.us> <7161562f-d00d-41a6-bd8a-d15684d3eaf2@gmail.com> <67e69649-30ff-4b72-9427-7978010701af@gmail.com> Content-Language: en-US From: Alexander Lakhin In-Reply-To: List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk This is a multi-part message in MIME format. --------------c1AbnsvS5aiWiC7yKI5sKo80 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Hello Nathan, 28.04.2025 21:26, Nathan Bossart wrote: > One other potential problem with this test is that we reuse the directory > names for each transfer mode. That seems easy enough to fix. FWIW, I've counted seven 006_transfer_modes failures happened during this year. Five are from Windows animals: https://buildfarm.postgresql.org/cgi-bin/show_log.pl?nm=drongo&dt=2025-04-08%2004%3A18%3A15 https://buildfarm.postgresql.org/cgi-bin/show_log.pl?nm=fairywren&dt=2025-04-21%2008%3A03%3A06 https://buildfarm.postgresql.org/cgi-bin/show_log.pl?nm=fairywren&dt=2025-07-21%2012%3A35%3A58 https://buildfarm.postgresql.org/cgi-bin/show_log.pl?nm=fairywren&dt=2025-08-22%2000%3A04%3A05 https://buildfarm.postgresql.org/cgi-bin/show_log.pl?nm=drongo&dt=2025-12-28%2003%3A43%3A24 And two from culicidae, which tests EXEC_BACKEND and thus suffers from [1] ([2]): https://buildfarm.postgresql.org/cgi-bin/show_log.pl?nm=culicidae&dt=2025-11-22%2012%3A31%3A23 https://buildfarm.postgresql.org/cgi-bin/show_log.pl?nm=culicidae&dt=2025-12-14%2018%3A24%3A48 Probably, this number could justify improving the test so that we can identify the failure reason for sure looking at the upgrade logs. As of now, we can only guess it, based on the animals' specifics... [1] https://wiki.postgresql.org/wiki/Known_Buildfarm_Test_Failures#culicidae_failed_to_restart_server_due_to_incorrect_checksum_in_control_file [2] https://www.postgresql.org/message-id/7ff9de7f-7203-cad9-76d9-45497cbedac7@gmail.com Best regards, Alexander --------------c1AbnsvS5aiWiC7yKI5sKo80 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 7bit
Hello Nathan,

28.04.2025 21:26, Nathan Bossart wrote: 
One other potential problem with this test is that we reuse the directory
names for each transfer mode.  That seems easy enough to fix.

FWIW, I've counted seven 006_transfer_modes failures happened during this
year. Five are from Windows animals:
https://buildfarm.postgresql.org/cgi-bin/show_log.pl?nm=drongo&dt=2025-04-08%2004%3A18%3A15
https://buildfarm.postgresql.org/cgi-bin/show_log.pl?nm=fairywren&dt=2025-04-21%2008%3A03%3A06
https://buildfarm.postgresql.org/cgi-bin/show_log.pl?nm=fairywren&dt=2025-07-21%2012%3A35%3A58
https://buildfarm.postgresql.org/cgi-bin/show_log.pl?nm=fairywren&dt=2025-08-22%2000%3A04%3A05
https://buildfarm.postgresql.org/cgi-bin/show_log.pl?nm=drongo&dt=2025-12-28%2003%3A43%3A24

And two from culicidae, which tests EXEC_BACKEND and thus suffers from [1]
([2]):
https://buildfarm.postgresql.org/cgi-bin/show_log.pl?nm=culicidae&dt=2025-11-22%2012%3A31%3A23
https://buildfarm.postgresql.org/cgi-bin/show_log.pl?nm=culicidae&dt=2025-12-14%2018%3A24%3A48

Probably, this number could justify improving the test so that we can
identify the failure reason for sure looking at the upgrade logs. As of
now, we can only guess it, based on the animals' specifics...

[1] https://wiki.postgresql.org/wiki/Known_Buildfarm_Test_Failures#culicidae_failed_to_restart_server_due_to_incorrect_checksum_in_control_file
[2] https://www.postgresql.org/message-id/7ff9de7f-7203-cad9-76d9-45497cbedac7@gmail.com

Best regards,
Alexander
--------------c1AbnsvS5aiWiC7yKI5sKo80--