Date: Tue, 14 Apr 2026 15:24:25 +0900
From: Yugo Nagata <nagata@sraoss.co.jp>
To: Dean Rasheed <dean.a.rasheed@gmail.com>
Cc: SATYANARAYANA NARLAPURAM <satyanarlapuram@gmail.com>, PostgreSQL Hackers
 <pgsql-hackers@lists.postgresql.org>
Subject: Re: Infinite Autovacuum loop caused by failing virtual generated
 column expression
Message-Id: <20260414152425.879493d6202956e23afeae03@sraoss.co.jp>
In-Reply-To: 
 <CAEZATCXWgYexeVm8yS6G8oFyyF=8ef9QwDt4Eyia-5hxBhjoVw@mail.gmail.com>
References: 
 <CAHg+QDcdkGQ4Q683Uq7ZJ0P6NcbB=F3Sh8thMSiFY9wwnSEoQQ@mail.gmail.com>
	<CAEZATCXWgYexeVm8yS6G8oFyyF=8ef9QwDt4Eyia-5hxBhjoVw@mail.gmail.com>
Content-Type: text/plain; charset=ISO-2022-JP
Content-Transfer-Encoding: 7bit
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 2
X-MS-Exchange-AntiSpam-MessageData-0: 
	=?iso-2022-jp?B?VWlPZCsyajVHeXRXYmd3ZGo1ajJPUmNDY1FKaDBxTmp6UWNOSldwdmFz?=
 =?iso-2022-jp?B?ZWZmRDBGQXhRT1pnR3lPeElBb0prcHlRNFpmTzdsTXJIMDNxeWxhemsw?=
 =?iso-2022-jp?B?b2xDN2V4bzFpaHd1RzJGdkw1ekFDOXMrUWFXQWFYMXI2bzlqSUl1bzNx?=
 =?iso-2022-jp?B?U1FscE5DZDB3cmZ2ejJpT2E4SlNpc29oeTB5TGdjTURBM2ZtMjBsNkhw?=
 =?iso-2022-jp?B?b1VUZ3dubEFRNUNmNm5LUXRCRFQzMlRrVzd3NUZER25VT3N3VW1XM2k1?=
 =?iso-2022-jp?B?NlQ0REhaaEU3QzA2b0NaTnpVQ21NcmRnTm5YMTJxdHBLeHVJdll6a3Nv?=
 =?iso-2022-jp?B?b3RzYysvaDlJcGwwTkpPc0JxTDlVREk2aC9sMFNEQ1BUSzFIVDZJY0xR?=
 =?iso-2022-jp?B?OEthSkdqZDM3RHF3YmRoTUFkNmJodnJyVmhpT0U0OFVSMVh1RzB3OGg0?=
 =?iso-2022-jp?B?b0NkZjlaVFg4cGZXN2FpUWF3UUdoVW44VHU3cy8yREc3NjNpZ0VzK0dR?=
 =?iso-2022-jp?B?UjJWYnIzeTd5ZUREamdLOTFEMk5LU0hsVnpFcXRlZmFXV0Q3MngzUHJE?=
 =?iso-2022-jp?B?V3VGaW93Mkc3cE5wTVZtUUJYYWxiUGlmc3M3NzQvK3pYMzlHZTlGZno5?=
 =?iso-2022-jp?B?cHdBc1ZRd0dFRTlZcTU0dTE1aWFIT3Z6amtqTVB0cld4dU04bHhxakt4?=
 =?iso-2022-jp?B?OTZjMkxxRFFuSEcvRVNwS051M04zRm9mNkRkVTg1NC9CSHhuOFRiMnIw?=
 =?iso-2022-jp?B?SkE5Y3dFcFM1azFIWk00MFJTbjN0eTZjUTEwOUJaQ1liM2NsZkpRWEd1?=
 =?iso-2022-jp?B?S25DVk1TZUhKNGxYSXpUQ1NXcENiYzF5aGVsL2VnUy82cy9DSWVtb0Qy?=
 =?iso-2022-jp?B?MjAxRlNncTFxVE5hTE90M21tZGY4c1pjQzg2VmhtTERMMkh4dUtZMFhz?=
 =?iso-2022-jp?B?ekNNM3ZGWjdyaEFDRmpZTFVCK1o4UURhek96Z0JLZnJtSER4STB6QmRz?=
 =?iso-2022-jp?B?bGlXRUhIbEYzd0ZReW01QXliVVhGQVQ4K082NCtZYStzaDY3L2pRbDFZ?=
 =?iso-2022-jp?B?MFJHVkF4aWRnYzNLUjUzTmJJVE43T0VmeWhyeStlTVU2aUxESStqTlZs?=
 =?iso-2022-jp?B?SWsvaGpjMzZlOHdvYUw5ZzIwaFpoem9ONzVWaHJocHZtR3hSV1g1U3Zy?=
 =?iso-2022-jp?B?cGsvRW13cGhHa2E5V01JRGVJWVlBWmpHODIrd1RFb3I4NWlxdStaK090?=
 =?iso-2022-jp?B?NlQ0RS9Jdk5ocGRLOTVhVXpIVGw0ZkZ0Um9xRlpCa3JDVjFBK0FuejFv?=
 =?iso-2022-jp?B?T0MySm5pMjFHWjFNYUJ3UEgrcVUrRXJpT1dHOE9qenBlMVpEY2RFdHND?=
 =?iso-2022-jp?B?T1YxbHNEK1kreGY0V2tMOTJrSnRqQjJuckRCMG01UE1kQ1dpbnhuRjR2?=
 =?iso-2022-jp?B?b2xKeUZGWk1adGVUV0N3TVZoZ3FNSTFTSS9IM2lTNEptSzgwUkRBajVs?=
 =?iso-2022-jp?B?aWxGTkdPYm1LelRtV2Mvb0w2VXdCWjNCRHZpbXg3ZTl5cm16TnRaYWhH?=
 =?iso-2022-jp?B?aksxV0ltVUNJVS9FaXl0aE5YOHh0cmtLYUxYVjI5M0JOMG5uSCtWSWY1?=
 =?iso-2022-jp?B?OG82aHZBWEMrQzVYVVNST3RnbTlIU3U4QmhpRkJwY1dwaFM2QlRaVVhJ?=
 =?iso-2022-jp?B?dytIVHJkUkJvSjc4cmJCdVdscXRZbUZLY0lGcWlJSmo0N3RnUnk1bHlp?=
 =?iso-2022-jp?B?aGY3SVBPb0MxMU01RzVDZWpUeU95amFYVHNxeHF6QnhUR1dxMXkxbEc1?=
 =?iso-2022-jp?B?emVONXE5VnBMaGJGdXpaOUJIYlhzSHoySm9UUTE4MTk2SDR5aWJQVElB?=
 =?iso-2022-jp?B?WmxFMTFlNzR2eldLNkNOTkFWVEpyRTc4K3dsR0FIR0R3QzFMMmVEa2hE?=
 =?iso-2022-jp?B?VVJXYWwyQ1VraURBdGwzOWVpRTBjWVR4TlhwekliOWNaMTdvVW1wc0pT?=
 =?iso-2022-jp?B?RUsvRmxCTVdiMFFpamVaVUZSaUNLcU9HT21CMEpYeGtweFlDRmdtQmkw?=
 =?iso-2022-jp?B?TnN2cmRDY2VhY3pMSEg4eDRtVU9zU3J0QTFmdnA5WlFXUHQ0LzJzYTR1?=
 =?iso-2022-jp?B?TTJ1Znk4dXpQcnhDa3hxN0lsRTBUOW55NGZUOWF4S3U2YzV3ZGdQUVl0?=
 =?iso-2022-jp?B?bkI1L25hb1ZURjFNNFBqRUp2aXBnQmZ3OGFBUUhTTlBZU1IrRk1KbGYv?=
 =?iso-2022-jp?B?R0IrOUhjem5sZFNqa2ZzL0NKejM4K3l0alNJbkN3QWJCQkJUSy9rOUh6?=
 =?iso-2022-jp?B?bCs5MHYrU3RNbUhGNzdxSDQ1d2llWU1VTzU0alpuWk1mWHRxS0xUcllM?=
 =?iso-2022-jp?B?akFmSnMydWllVC9nNEEraFFNWGdoYUhBRXFMTGp5S0pMWmxvMGw3MWIy?=
 =?iso-2022-jp?B?YStmdVpHbjhZSW1JYnhTbUo0RjZjQ00yZjN2RE1HS3dwUHhWQUZHVlk2?=
 =?iso-2022-jp?B?UjJBRGg4cnl2MVdCV1ZHdGRNNTZoK2hTaHg0ZWpIVGRXMDVucXlCdVJj?=
 =?iso-2022-jp?B?VFB6bmRxVDlqT3VBRFRVZWVRS2lSVFZtMU9PREZyeEg1TzdI?=
X-MS-Exchange-AntiSpam-MessageData-1: jomDNaneDQ+4iw==
X-OriginatorOrg: sraoss.co.jp
X-MS-Exchange-CrossTenant-Network-Message-Id: 
 569406ee-4148-4357-5dfc-08de99ee7a27
X-MS-Exchange-CrossTenant-AuthSource: OSZP286MB2160.JPNP286.PROD.OUTLOOK.COM
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 14 Apr 2026 06:24:26.4793
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 75db6c32-352e-4063-ae79-cafb8623f6db
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: 
 mBJgAfoTgQxlby3PdZkqUdHlBDjQ6+RE158/Hksoq/656SBzBItbtn3ZHPpc47VBS32dfb+08WaZZuX6b1g+Ag==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: TY1P286MB3121
List-Id: <pgsql-hackers.lists.postgresql.org>
List-Help: <https://lists.postgresql.org/manage/>
List-Subscribe: <https://lists.postgresql.org/manage/>
List-Post: <mailto:pgsql-hackers@lists.postgresql.org>
List-Owner: <mailto:pgsql-hackers-owner@lists.postgresql.org>
List-Archive: <https://www.postgresql.org/list/pgsql-hackers>
Archived-At: 
 <https://www.postgresql.org/message-id/20260414152425.879493d6202956e23afeae03%40sraoss.co.jp>
Precedence: bulk

On Sat, 11 Apr 2026 17:33:13 +0100
Dean Rasheed <dean.a.rasheed@gmail.com> wrote:

> On Fri, 10 Apr 2026 at 21:19, SATYANARAYANA NARLAPURAM
> <satyanarlapuram@gmail.com> wrote:
> >
> > PG19 added support for stats on virtual generated columns [1]. Creating extended statistics on a virtual generated column whose expression can raise an error leads to ANALYZE failing repeatedly, and autovacuum retrying indefinitely. This floods the server logs and also wastes resources. Vacuum analyze on that column (without extended stats) succeeds.
> >
> 
> True, though this is nothing new. The same thing can happen with
> expression statistics on an expression that raises an error, which has
> been possible since PG14.

Yes, this issue is not new, and I’m not aware of a way to prevent it a priori.

> 
> > In order to avoid retry storms, I think we have two options. (1) skipping the offending row from the sample, (2) skipping the extended stats computation for that table with a warning message. At least this avoid autovacuum infinite retry. Attached a draft patch for the option (2). Thoughts?
> >
> 
> I'm not sure. The default retry interval is 1 minute, so it won't
> exactly be a flood of messages. Also, if the error only occurs for a
> small subset of rows, it's possible that retrying might succeed.

I think it would be good to skip ANALYZE for the extended statistics that cause
errors and just emit a warning, rather than aborting ANALYZE for the entire table.
It seems reasonable to treat this as the user’s responsibility to notice the warning
and address the underlying issue.

Regards,
Yugo Nagata

-- 
Yugo Nagata <nagata@sraoss.co.jp>