Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1sBYuV-00HTRO-33 for pgsql-general@arkaria.postgresql.org; Mon, 27 May 2024 11:53:04 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1sBYtW-006SvC-KL for pgsql-general@arkaria.postgresql.org; Mon, 27 May 2024 11:52:02 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1sBYtW-006Sv3-2O for pgsql-general@lists.postgresql.org; Mon, 27 May 2024 11:52:02 +0000 Received: from mail-lj1-x232.google.com ([2a00:1450:4864:20::232]) by magus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.94.2) (envelope-from ) id 1sBYtS-0010px-PU for pgsql-general@lists.postgresql.org; Mon, 27 May 2024 11:52:01 +0000 Received: by mail-lj1-x232.google.com with SMTP id 38308e7fff4ca-2e96f29884dso14465701fa.0 for ; Mon, 27 May 2024 04:51:58 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cybertec-at.20230601.gappssmtp.com; s=20230601; t=1716810718; x=1717415518; darn=lists.postgresql.org; h=mime-version:user-agent:content-transfer-encoding:autocrypt :references:in-reply-to:date:cc:to:from:subject:message-id:from:to :cc:subject:date:message-id:reply-to; bh=lIW0iHdNmsvDystV0F7zfgWBs4xa7V+ocyQe+QEQ/Fc=; b=jvaEngDDnNGA3U6B134eDgiAxriQUcD/62JRK6kvhWcnzoUl8uxxtNDQTuPy3opECT S3ykuo2jQhMbw0v5p+Mp+/jJVKXNylcxY5DAKbRSa2EXb9GfhFe5FYdMb7gBl4RvviP+ JA99U3HQ4lrhqBzJWsibH/iDWEKmcSRU608RDypHtKW/5fsa9gNfw3l34JL4ak2boeiX QW20NMFOEPtdS0jjC+kVbsCq1tXljjhzv+tBvqMtd7ECxFiMmrHmfnXXNBILW4ob/dRV c+V8jxW6c+C0LM2uqiXf+3bqLsX7tHztq9nEmmlI/uys/Syry+/XeOi43rfEw/d8zVve ozBQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1716810718; x=1717415518; h=mime-version:user-agent:content-transfer-encoding:autocrypt :references:in-reply-to:date:cc:to:from:subject:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=lIW0iHdNmsvDystV0F7zfgWBs4xa7V+ocyQe+QEQ/Fc=; b=BrGcAr0I025cnMVEiV1uTO1PT6tc52BHq9sKNMKGACs7ZIOoG+9zeYF5n+hHt00jRZ uYd6JOFZP+TZYV+d+ARYSIrbedA+1A0B3NmbsJsV3SN0QykqWcnq60bVhv2R6zHX389W Fywv+S8pIjQTXTB/rft29ODmCZObm9Wdkd1Hf1pE4Ibf0PLV0NajwQtJvBUTJJFOekDY Ny8VsfcHGT1ORV1mlIaFOC1RQVVmMl/ew8Uh/PSXCINdkN0oYoebgGRaJ4hSeHRdsGiq ZNQBscS9uCP3kSyP8gI05+t3Kjey+wj1wbd4vxUVzEktNmnawkrAD7mOXFKHXcdl+aSA RfHQ== X-Gm-Message-State: AOJu0Yz9pX1SqbF3TaytbkL0g0YtYhZiGOTSyxNJvUOPJ13Wxwf9wAOh qiUzr+4+3Yv5TCEcetMY6hDHz4nmmLUFJIwdt91fl8XGhRYBMjeOCX6nk11DwPEbzPa2RCD1rhj X X-Google-Smtp-Source: AGHT+IHILqRQ3b+02GUBqDNTo0gkEHFH4zNcmB53KhQqoXFVeRL1j/002DG01/CV1Z4tPO58dp59cA== X-Received: by 2002:a2e:bc08:0:b0:2d6:f69d:c74c with SMTP id 38308e7fff4ca-2e95b256308mr61940211fa.38.1716810717734; Mon, 27 May 2024 04:51:57 -0700 (PDT) Received: from localhost.localdomain ([2001:871:5e:1ee1:2933:8762:af5c:a0fe]) by smtp.gmail.com with ESMTPSA id ffacd0b85a97d-3557a1c960esm8864123f8f.80.2024.05.27.04.51.56 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 27 May 2024 04:51:57 -0700 (PDT) Message-ID: Subject: Re: Autovacuum endless loop in heap_page_prune()? From: Laurenz Albe To: Peter Cc: pgsql-general@lists.postgresql.org Date: Mon, 27 May 2024 13:51:56 +0200 In-Reply-To: References: <34f2beb882d607b360dea53433f95a767d1cad8f.camel@cybertec.at> Autocrypt: addr=laurenz.albe@cybertec.at; prefer-encrypt=mutual; keydata=mQINBGGDwAQBEADgbWy5cKXQld3N2mF+DFyiNFbi2oBl2T+XgxpPF8wTRw2D/u4bBKXP0SYSE/lA86jIVNWWU0gf1KODIkVvgJm2w4vH2VBV1b7ddVViGl1Iu+9zaRnv9wulhnH42KefepXnoean6UT1EzLM0opF/Ik0j+40TxdRtobkBprkQUyHDXWlHc2ffPs3SipyFEP9AVLf7ejRC46CXWDnsqjOBSMEW8Z4HiK/8RrPZBsKLts8dJxKF4pygOdJb0CWk8k/X1jbcfdxo+zOLjOMvJcSJ2pFdJmQHU+JufB3rePziqQ2S9Ur6sccr9XnTC1GVBWN4Lf5VHq+vf+bFJjVwg+2hrySZnAVfcOrxoqFLErr7ug1zN2nM1kcpgA4VWn4gxlJtYNYYq+9WxX5dtvnNANlG3ZCrRKQzl8lxtzoF6Zo7LUhEqPaHDwn7Rvs+IdbOn41lF5UDTJGqmC4gS/bZydW2Fy3YWm4aSaN9fgFf8D+PVkrlKAZB7gBLz1TyHjbcRf85cYF+GKKrDld5SzMB/V60VX3oP/Eo8ikFpyWaqiz1f9X7MBot3/PjJkY+wDzp3nmb19QEcOBuQiSQ4xds2r0HewbuHTAR68u8jNNMGmpm2j4x+g09Jd/WQDjqlTBZ/jEltH41fYCCPWMfljXTOOXu2eLNGdfi7ETZogtwjM9oTtSPQARAQABtCdMYXVyZW56IEFsYmUgPGxhdXJlbnouYWxiZUBjeWJlcnRlYy5hdD6JAk4EEwEIADgWIQR0CqhbZGGABqoaSbdi8bhXA2EdmAUCYYPABAIbAwULCQgHAgYVCgkICwIEFgIDAQIeAQIXgAAKCRBi8bhXA2EdmM/6EADK232JCwmBzhlj8h7U9CjG6kx0JHP3uJGv+XfsHtHAlmY/RCwF1BHMEsRlk bT5UrLvJ2jb99bA9QARzhFaxzyn0F/BUKzuIjRGNs/n6d5dNUFA0kOt8sX+TacmC GEyjEBCrVCm4ranBiUyePn9NhHNWnaex7pJyqvMLLdwW9BEMJx0Fqo+DN8ukbXmYRsmhEtd3ue+x/luYmOmJnaGtzInaY5aOJYbW9XqoRIZkZvOCgbi1FfvNmoqWa+3oVxTOgw9RafjJDyW0lTHzKGjbGI5ofMU98l+/hKJFYJqWUF6VpFJY5YIcN/1lf4ZICMwDl+MPIVo/tpq8L10seJL28nLlvw3K+cI+TVW8IW/qL/LyVoDofI3USeOORuYmhpWRhik8JXX6xf3v6GrRilJIPWNFIJbxm1ZblQiQnOw3IOW7T+8nAmPin1HKqM3VrOrJQ2VtShsefNBibNAsr1oFaqcDBkn3yGG8i6CTW+FyO4PZ+/EwNxMVgktxbYdy5AT1/lpXr5tB+phhLIyVfiBvrWs5EThxYMQ/L8Y85c3GMsAy1l/x4h3jqySIYy3SCU9+jc5UVuNnXljbvkEzJ+NLWJ6C1rACFWrMszgPdh5tCrlRY9PpmYll4JbCgb8BtxEIUmR+xr50/ZElEK5iml7Q00KUekCcDt+36PsyGFTXBzNOrkCDQRhg8AEARAAzOZ2tLHlI4rrhG411h6cdCFjBZxuljaFCxFyHn3m6wbGLqwBUWC5k8UrRqjHMz88KcTSaNO7XGAmCqPdWd2SeflPZRnNTbjsVpw7mLdffsBm4JX7kki2Pvk5h0NtYeidXT1PSpc2ri4DutYXuT9uD8RAm1wUDCE5HQNUihT/WH6opt+hskHW21uHao0+y822tG0QQcGMqdQR5Vxdxj89wiEPdqW+HpU/oOZIhrf2E7prduAppxixjHy/o1rcnoznnJvc8D3+YgI9O0LrBMij89dM55pRGbLovTR1oGR3U74sX774+0xmSzeIKwZfiMUz7Atlvfk5SHOsRUFPN2Ux9kaXiiBibQpHFxt7b lDrT4wxdLJ/XCdbPPAyl+lZtOLsaHEEZvYNyTXwZc35dVf3R4/oz20HoG6s7ct8e1 AQygj43XAERzty9SkWgxs8+grp1PrGx6FHVSYRqBM8dS/ZR6yRVwOwJXPyaSSqfIF21DkE4j1y4n+ItSewPGoRp8K/yWCikt6qlkVkO2ASNIiX04fAbtzwVOaNn8ZMRNqyvLc1fED4sr49onE4cAIcBLjcC3KL+w9DUGRQCdziROj5H2Yl/sXGPdMciUHo/Uz2rggc+2th3bQiMhrHWSsBpUkDQp0yWewemstPpPgBL3h2fHKaX8B9oH5Qu/H1IgrOuX8AEQEAAYkCNgQYAQgAIBYhBHQKqFtkYYAGqhpJt2LxuFcDYR2YBQJhg8AEAhsMAAoJEGLxuFcDYR2YuPwQAMkpGtR80pQ1gVsONhdkqj0H2eU66efP/gO3CoyaoIcvrpKYj7C2HipVSmkt1gpByL0X4AMQ/vKuknUz3wd28Ba+G1dCfbVs/Xiusq+SmpUj5rTwmYqdSjWMuCo1R6oS5hdJMdUUJYGMT0QkVlm1KnW8jkmCTl9GzjDxOAsN9O6/6lPzaGFtk9XF+34Bry/N4HKiJkqpC4+UTd0AprPfzJ2jdT64e1F0+W88X8y1bTTgNrHwK4mDiLnlE4SKRuEm54lNhJz//ar86Or5BErzNpM6TL7lk44QS06hwsMrEdKIy8J/SYJPjfzR8tIUnKscclVpOgjKaBqC+0iFiVaRqAgfOlIEiezX6kMh5Q2FIUfqs46qWhhXjRrdKOEoStYAaikdLu5ZXr7vfb0ZaDh+ZwTQtbSMFolyOkecwI81MCdbMfT/1TqIGTOdAj5as9fAakk0jb2pXgUYQ8X1DVTR8ahSDVEaw9VTmWiSvTxvguVJ1Mb7gG4Gmh6aviDTJhfXtH4rPUNXhDLqrTH8JkJjyKROOMakIF68Hjse5vUfUxreBEOtb5r1Coa2Fe7ncJayaSE7ryrDbFqpZ 36UMAx4ulWMyqJajLNGY0DdG8qIsR5nxRhrnK/mrCidZ8F9/D3bWAl4rjtHlsztN59 +AnW5l0HsQcY9ntFL/zEBOaonjdJf Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable User-Agent: Evolution 3.50.4 (3.50.4-1.fc39) MIME-Version: 1.0 List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk On Mon, 2024-05-27 at 12:48 +0200, Peter wrote: > On Mon, May 27, 2024 at 11:25:47AM +0200, Laurenz Albe wrote: > ! On Sat, 2024-05-25 at 12:51 +0200, Peter wrote: > ! > =C2=A0I just found Autovacuum run for 6 hours on a 8 GB table, VACUUM= query > ! > doesnt cancel, cluster doesn't stop, autovacuum worker is not > ! > killable > !=20 > ! This smells of index corruption. > !=20 > ! I have seen cases where a corrupted index sends VACUUM into an endless = loop > ! so that it does not react to query cancellation. >=20 > Thanks for Your reply. So it can happen... Well, not normally. > ! Check the index with the "bt_index_check()" function from the "amcheck" > ! extension. If that reports a problem, rebuild the index. >=20 > [runs amcheck test, no problem is reported] > I don't see a problem there. >=20 > After the database did recover, I did manually run VACUUM on the > respecitve table, it did run successfully in the expected timeframe Ok... What made me suspect corruption is that the process could not be interrupted. Otherwise I'd have assumed that autivacuum was just running too slowly. > ! Apart from hardware problems, one frequent cause is upgrading glibc > ! (if the index on a string column or expression). >=20 > No, this is FreeBSD, we don't normally do such things... ;) You don't update the C library, or collations never change? > Also, that shouldn't happen with locale 'C', 'SQL_ASCII': Right. The C locale is safe (but of course SQL_ASCII is a mistake). Yours, Laurenz Albe