Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1s9gV0-004FoO-A5 for pgsql-general@arkaria.postgresql.org; Wed, 22 May 2024 07:34:59 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1s9gUz-00EW2K-V1 for pgsql-general@arkaria.postgresql.org; Wed, 22 May 2024 07:34:57 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1s9gUz-00EW2B-G8 for pgsql-general@lists.postgresql.org; Wed, 22 May 2024 07:34:57 +0000 Received: from mail-ed1-x532.google.com ([2a00:1450:4864:20::532]) by makus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.94.2) (envelope-from ) id 1s9gUs-001PnX-L4 for pgsql-general@lists.postgresql.org; Wed, 22 May 2024 07:34:55 +0000 Received: by mail-ed1-x532.google.com with SMTP id 4fb4d7f45d1cf-572e48f91e9so10841072a12.0 for ; Wed, 22 May 2024 00:34:50 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cybertec-at.20230601.gappssmtp.com; s=20230601; t=1716363288; x=1716968088; darn=lists.postgresql.org; h=mime-version:user-agent:content-transfer-encoding:autocrypt :references:in-reply-to:date:to:from:subject:message-id:from:to:cc :subject:date:message-id:reply-to; bh=0WGT2SVwylcWwrEQ1qGWCbZR4DZ7qB5Uds6u73MGq9g=; b=LbO9Z08U9hlc7cWgaeqXenSg7mjKJs5118rx7D7n32JQwV29h4ula91OLY0qpYMEF6 fqZxmClvZ3GCaaALvnNk/lCWHPGY16XkznEOJjexFddFdsZ2UtovPgFYjN+Eun0ZuwHq yZFjn2GLSggp1XwmDcyR3fXZHmCM4n8bLARzYljUkPreEvMiPFxzv+Zdl5z851TxfO/b 1KzXu3K6kIguT0vSmrd7wir34kKgt/F6nUIhkvTUi+QRk+sJbwhqenwmQhJuCIO7pO+b F+PybjC5XickcVOub/GhmOFKMIkvZ10xKDs29rnmX3a0Wt04JG4X6lfA5bgFv36LUv4Z 9G3A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1716363288; x=1716968088; h=mime-version:user-agent:content-transfer-encoding:autocrypt :references:in-reply-to:date:to:from:subject:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=0WGT2SVwylcWwrEQ1qGWCbZR4DZ7qB5Uds6u73MGq9g=; b=G7Dn8s/v3VoWkYdWXUttJzdSVUbOWYnVVQE5Mhf/FDwlO3fwbOaKJMGG+aMfN3vMCC Exma8eitylrgW5ywxv1yyF6y1JEZrwFG+7A4lFJY5KqBNdHq6LXpwFh+T7Dia8D2/Miy kPtu0dP8QIWyhXcezo09jGB4E4/NTtLdaczoBNkY/cUyDMZ+Lg/1EGB0a1i3fF+9oA2W BF0NGzOIahiLiRX4OIapHTo5RMuB9e9uGKn20eZVUOFY+1QUTNyf0BpAmqTBzCc8a1aW ALlJ1fYkRLIU9VgA1fq0Ls9K+wEPNe5ygyB3LNLHWubPr2UmRvQYWtL6l+kRJKtZFN/0 fVsQ== X-Forwarded-Encrypted: i=1; AJvYcCX5xNIhxwgq+aWjyZejjerzGMkFgViHTzgg8MzH32zL/N1j+SEJHWM0nttj9i5ywvH6Xzt6c/DmcVgcnU/dSmTBIMHrm9f3NEPwGmbsVKNiikXF X-Gm-Message-State: AOJu0Yx4Oq7tBXGqFDOlyJrSSE9uqEMuGKYWZA6OJX8rFoF73v9oH49s YUWNgZCLNYiJJvDTdCwbVP1XMlZnLTRvudgc4Lo7N03lKbFwt1pFwG7HYNTAEnMvx/IFErKwJ1O xzik= X-Google-Smtp-Source: AGHT+IFQoa2bTBrxWoEQG905tCD9eKDprdjH6hq8WTP5h1Ysb2TMxqUujxNu8xF1O0E8TrIQmvWYTA== X-Received: by 2002:a05:6402:348f:b0:578:36f4:cb30 with SMTP id 4fb4d7f45d1cf-57836f4cbdbmr427802a12.9.1716363288241; Wed, 22 May 2024 00:34:48 -0700 (PDT) Received: from localhost.localdomain ([88.116.133.170]) by smtp.gmail.com with ESMTPSA id 4fb4d7f45d1cf-574f73a7ee0sm10073045a12.4.2024.05.22.00.34.47 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 22 May 2024 00:34:47 -0700 (PDT) Message-ID: <2383464d102aa6e16ff477837878aa2beb7e3e3b.camel@cybertec.at> Subject: Re: vacuum an all frozen table From: Laurenz Albe To: Senor Cervesa , "pgsql-general@lists.postgresql.org" Date: Wed, 22 May 2024 09:34:47 +0200 In-Reply-To: References: Autocrypt: addr=laurenz.albe@cybertec.at; prefer-encrypt=mutual; keydata=mQINBGGDwAQBEADgbWy5cKXQld3N2mF+DFyiNFbi2oBl2T+XgxpPF8wTRw2D/u4bBKXP0SYSE/lA86jIVNWWU0gf1KODIkVvgJm2w4vH2VBV1b7ddVViGl1Iu+9zaRnv9wulhnH42KefepXnoean6UT1EzLM0opF/Ik0j+40TxdRtobkBprkQUyHDXWlHc2ffPs3SipyFEP9AVLf7ejRC46CXWDnsqjOBSMEW8Z4HiK/8RrPZBsKLts8dJxKF4pygOdJb0CWk8k/X1jbcfdxo+zOLjOMvJcSJ2pFdJmQHU+JufB3rePziqQ2S9Ur6sccr9XnTC1GVBWN4Lf5VHq+vf+bFJjVwg+2hrySZnAVfcOrxoqFLErr7ug1zN2nM1kcpgA4VWn4gxlJtYNYYq+9WxX5dtvnNANlG3ZCrRKQzl8lxtzoF6Zo7LUhEqPaHDwn7Rvs+IdbOn41lF5UDTJGqmC4gS/bZydW2Fy3YWm4aSaN9fgFf8D+PVkrlKAZB7gBLz1TyHjbcRf85cYF+GKKrDld5SzMB/V60VX3oP/Eo8ikFpyWaqiz1f9X7MBot3/PjJkY+wDzp3nmb19QEcOBuQiSQ4xds2r0HewbuHTAR68u8jNNMGmpm2j4x+g09Jd/WQDjqlTBZ/jEltH41fYCCPWMfljXTOOXu2eLNGdfi7ETZogtwjM9oTtSPQARAQABtCdMYXVyZW56IEFsYmUgPGxhdXJlbnouYWxiZUBjeWJlcnRlYy5hdD6JAk4EEwEIADgWIQR0CqhbZGGABqoaSbdi8bhXA2EdmAUCYYPABAIbAwULCQgHAgYVCgkICwIEFgIDAQIeAQIXgAAKCRBi8bhXA2EdmM/6EADK232JCwmBzhlj8h7U9CjG6kx0JHP3uJGv+XfsHtHAlmY/RCwF1BHMEsRlk bT5UrLvJ2jb99bA9QARzhFaxzyn0F/BUKzuIjRGNs/n6d5dNUFA0kOt8sX+TacmC GEyjEBCrVCm4ranBiUyePn9NhHNWnaex7pJyqvMLLdwW9BEMJx0Fqo+DN8ukbXmYRsmhEtd3ue+x/luYmOmJnaGtzInaY5aOJYbW9XqoRIZkZvOCgbi1FfvNmoqWa+3oVxTOgw9RafjJDyW0lTHzKGjbGI5ofMU98l+/hKJFYJqWUF6VpFJY5YIcN/1lf4ZICMwDl+MPIVo/tpq8L10seJL28nLlvw3K+cI+TVW8IW/qL/LyVoDofI3USeOORuYmhpWRhik8JXX6xf3v6GrRilJIPWNFIJbxm1ZblQiQnOw3IOW7T+8nAmPin1HKqM3VrOrJQ2VtShsefNBibNAsr1oFaqcDBkn3yGG8i6CTW+FyO4PZ+/EwNxMVgktxbYdy5AT1/lpXr5tB+phhLIyVfiBvrWs5EThxYMQ/L8Y85c3GMsAy1l/x4h3jqySIYy3SCU9+jc5UVuNnXljbvkEzJ+NLWJ6C1rACFWrMszgPdh5tCrlRY9PpmYll4JbCgb8BtxEIUmR+xr50/ZElEK5iml7Q00KUekCcDt+36PsyGFTXBzNOrkCDQRhg8AEARAAzOZ2tLHlI4rrhG411h6cdCFjBZxuljaFCxFyHn3m6wbGLqwBUWC5k8UrRqjHMz88KcTSaNO7XGAmCqPdWd2SeflPZRnNTbjsVpw7mLdffsBm4JX7kki2Pvk5h0NtYeidXT1PSpc2ri4DutYXuT9uD8RAm1wUDCE5HQNUihT/WH6opt+hskHW21uHao0+y822tG0QQcGMqdQR5Vxdxj89wiEPdqW+HpU/oOZIhrf2E7prduAppxixjHy/o1rcnoznnJvc8D3+YgI9O0LrBMij89dM55pRGbLovTR1oGR3U74sX774+0xmSzeIKwZfiMUz7Atlvfk5SHOsRUFPN2Ux9kaXiiBibQpHFxt7b lDrT4wxdLJ/XCdbPPAyl+lZtOLsaHEEZvYNyTXwZc35dVf3R4/oz20HoG6s7ct8e1 AQygj43XAERzty9SkWgxs8+grp1PrGx6FHVSYRqBM8dS/ZR6yRVwOwJXPyaSSqfIF21DkE4j1y4n+ItSewPGoRp8K/yWCikt6qlkVkO2ASNIiX04fAbtzwVOaNn8ZMRNqyvLc1fED4sr49onE4cAIcBLjcC3KL+w9DUGRQCdziROj5H2Yl/sXGPdMciUHo/Uz2rggc+2th3bQiMhrHWSsBpUkDQp0yWewemstPpPgBL3h2fHKaX8B9oH5Qu/H1IgrOuX8AEQEAAYkCNgQYAQgAIBYhBHQKqFtkYYAGqhpJt2LxuFcDYR2YBQJhg8AEAhsMAAoJEGLxuFcDYR2YuPwQAMkpGtR80pQ1gVsONhdkqj0H2eU66efP/gO3CoyaoIcvrpKYj7C2HipVSmkt1gpByL0X4AMQ/vKuknUz3wd28Ba+G1dCfbVs/Xiusq+SmpUj5rTwmYqdSjWMuCo1R6oS5hdJMdUUJYGMT0QkVlm1KnW8jkmCTl9GzjDxOAsN9O6/6lPzaGFtk9XF+34Bry/N4HKiJkqpC4+UTd0AprPfzJ2jdT64e1F0+W88X8y1bTTgNrHwK4mDiLnlE4SKRuEm54lNhJz//ar86Or5BErzNpM6TL7lk44QS06hwsMrEdKIy8J/SYJPjfzR8tIUnKscclVpOgjKaBqC+0iFiVaRqAgfOlIEiezX6kMh5Q2FIUfqs46qWhhXjRrdKOEoStYAaikdLu5ZXr7vfb0ZaDh+ZwTQtbSMFolyOkecwI81MCdbMfT/1TqIGTOdAj5as9fAakk0jb2pXgUYQ8X1DVTR8ahSDVEaw9VTmWiSvTxvguVJ1Mb7gG4Gmh6aviDTJhfXtH4rPUNXhDLqrTH8JkJjyKROOMakIF68Hjse5vUfUxreBEOtb5r1Coa2Fe7ncJayaSE7ryrDbFqpZ 36UMAx4ulWMyqJajLNGY0DdG8qIsR5nxRhrnK/mrCidZ8F9/D3bWAl4rjtHlsztN59 +AnW5l0HsQcY9ntFL/zEBOaonjdJf Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable User-Agent: Evolution 3.50.4 (3.50.4-1.fc39) MIME-Version: 1.0 List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk On Tue, 2024-05-21 at 14:46 -0700, Senor Cervesa wrote: > I'd like to understand what's happening here and whether there is=20 > anything I can do to improve the situation. >=20 > PostgreSQL v11.22 (yeah, I know. Needs upgrade) >=20 > The following 3 autovacuum log entries show a vacuum of an append only= =20 > table that has not had any changes since the end of 5/10/2024. There is= =20 > only 1 page not skipped in each instance yet it takes over 1100 seconds= =20 > to complete. Visibility map shows all frozen. The associated TOAST table= =20 > is similar in numbers except that it completes in sub-second times. >=20 > I understand that the vacuum is occurring due to age of=20 > pg_class.relfrozenxid for the table but what exactly is it referring to= =20 > in these cases? Can that also be frozen or similar? Should I add=20 > autovacuum_freeze_max_age=3D400000000 or higher to relopts do reduce=20 > vacuum frequency. >=20 >=20 > 2024-05-17 09:56:57.167 GMT "" "" LOG:=C2=A0 automatic aggressive vacuum = of=20 > table "workdb1.public.log_entry_20240510": index scans: 0 > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 pages: 0 removed, 535517= 48 remain, 0 skipped due to pins,=20 > 53551747 skipped frozen > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 tuples: 0 removed, 24238= 4013 remain, 0 are dead but not yet=20 > removable, oldest xmin: 3245896267 > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 buffer usage: 107117593 = hits, 123159244 misses, 3 dirtied > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 avg read rate: 856.853 M= B/s, avg write rate: 0.000 MB/s > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 system usage: CPU: user:= 151.07 s, system: 638.29 s, elapsed:=20 > 1122.92 s Strange. Could you run VACUUM (VERBOSE, FREEZE) public.log_entry_20240510; and show the result? Perhaps that contains some clues. Yours, Laurenz Albe