Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1vC3Gh-008OQN-FS for pgsql-general@arkaria.postgresql.org; Thu, 23 Oct 2025 21:54:47 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1vC3Gg-00C85G-DQ for pgsql-general@arkaria.postgresql.org; Thu, 23 Oct 2025 21:54:45 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1vC3Gf-00C853-Kw for pgsql-general@lists.postgresql.org; Thu, 23 Oct 2025 21:54:45 +0000 Received: from mail-northcentralusazon11011020.outbound.protection.outlook.com ([40.107.199.20] helo=CH1PR09CU001.outbound.protection.outlook.com) by makus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.96) (envelope-from ) id 1vC3Gb-003QGx-38 for pgsql-general@lists.postgresql.org; Thu, 23 Oct 2025 21:54:43 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=LgpMddkgTgccHTeDxVGrBb7t/MdBvkOX9AAFZmdCdjsPI+GsB6+kzz1xRGNXBV2b+sPpr4qeWjELAY0WqE3E5TGwMiZL3O6Km4C7N8g2gaHv58Da9EwrmkP9OO0PbY3ae6jcu8C24+ZFsUQ5G4ZKH0XNOvTx9hL0WW2lpA7EdUb2VBLIS0qsE8o+jdA9zEihrfUzck0P6Wwf8B1kExcnGQuYupXUb1kzqgHYxPAZS0xVQI8gM9YgHafySWeEzhJtl4ojJXrn0Z2O1cJj+GlYh7/1bBYqVcsCV7AteK6Jy3dmGuZmYUzOyioQAtZIcnpISgVv45ZD5kY3xSn3WSpUPg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=yAiYM6sCasfDPMrFm2LaAEB/CrVlYGIEzm18+jYHohI=; b=PlT9ZCRIbj39o1S6Whh4UG1R82b9CQ300Hjtv75y21OoR3pOICvUa0a6kCykBSl7ypLRGjaDy1irxzSxvXDWvmtHFhGAxLC3UjuRvs46lp/jEKoPXIT2PciRURxMZ8DxZFSFk3w8bI5hSq7aRV9lPh9vIp8mYX6xJpRmWTOGXe9Hatne2ZXwq5fKqekVQe44rS2TpWCx/H4EdXGtXFLPtDiaP+TXlA9MDfxyrEJB2wQUCfp8m9oHljdBLBtwbcu0OQgdjtxpEsKyJZu+kRvfl+2jMRNyzVYHEf840JBJZa81mvDju09ixlMRX27gJlaRV1hMrToHHbTAJnyUZil7xw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=fnal.gov; dmarc=pass action=none header.from=fnal.gov; dkim=pass header.d=fnal.gov; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=fnal.gov; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=yAiYM6sCasfDPMrFm2LaAEB/CrVlYGIEzm18+jYHohI=; b=fkhfvwajAu/fKD9aoPcplLb4xrLZERhU38445MobB0T0yst6fTVNemKuOxHQOjE94PWuPeWhgZvreA/0IQnpP5tX57Rl2SkFbttdpi+SFttHNS09Cj7Kb5RhNAkPUVhEt0aDqT+5WSN4hD2MzZmUE4I0G+3+HBgdPdK03O5W7BlEwJU2G3yfA+zqeNGqPxciuStVZ8q3lMs6MBkCOcLDE/MXuQGa7F3eH24K08WmhrQD4uDOx0mpb7Xgap1RMTqd2uuhiH0Hg3s3TJpWrzI3GL3zXIdeBAWGYVbTnrnlW9ubJiFrabXQO1rOD4Gz9HSqrGQojcp75QeUTGkXGhlotQ== Received: from SA1PR09MB7311.namprd09.prod.outlook.com (2603:10b6:806:17a::11) by DS9PR09MB12293.namprd09.prod.outlook.com (2603:10b6:8:2ca::10) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.9253.13; Thu, 23 Oct 2025 21:54:38 +0000 Received: from SA1PR09MB7311.namprd09.prod.outlook.com ([fe80::b5f4:d7c8:eb5d:ad64]) by SA1PR09MB7311.namprd09.prod.outlook.com ([fe80::b5f4:d7c8:eb5d:ad64%4]) with mapi id 15.20.9253.011; Thu, 23 Oct 2025 21:54:38 +0000 From: Dmitry Litvintsev To: pgsql-generallists.postgresql.org Subject: could not stat file "pg_wal/RECOVERYHISTORY": No such file or director Thread-Topic: could not stat file "pg_wal/RECOVERYHISTORY": No such file or director Thread-Index: AQHcRGWpdz6/Pjko3EuF0mVXekStdQ== Date: Thu, 23 Oct 2025 21:54:38 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: msip_labels: authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=fnal.gov; x-ms-publictraffictype: Email x-ms-traffictypediagnostic: SA1PR09MB7311:EE_|DS9PR09MB12293:EE_ x-ms-office365-filtering-correlation-id: 0d027a3e-0e48-4b43-8dac-08de127ec316 x-fermilab-ob: 1 x-fermilab-sender-location: inside x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0;ARA:13230040|10070799003|366016|1800799024|38070700021; x-microsoft-antispam-message-info: =?iso-8859-1?Q?M6o9mTkXHuaj7ZF696x7QAk2iuYZLkpcBY4fOofoXV3J3w4B/1APkPXv8/?= =?iso-8859-1?Q?70fgl1ukaMVcLlSLvQxRoUiBkWaeNKGjDdd3dEofo0pWWqBojNstDn/ed2?= =?iso-8859-1?Q?08cjN5zxP9M+HJ+2IyKRbUZBDiK0Re/eqzKcMov3s0ogOGLotfspAmeC0q?= =?iso-8859-1?Q?CjF2F2+voB8mIk4UWltwqzHVlKvYmZ/NC/mLTgHT8JUiQIdQtHbtOP8Uc6?= =?iso-8859-1?Q?In6I4q+YYhAZhCRkQDxTzr3bGMXZqZ0PATl6ZFYThsk/O774HMUpGSGuPL?= =?iso-8859-1?Q?Tke0abUsvMgfjkCXiWlZUISPqeaGjLgK7jI74lnC/dWmAhvFA4zo0+Hczo?= =?iso-8859-1?Q?1GRn9jj2HEz8bx7fnkBw0lZ5RoFRyDWp24OpAv7lFrFwJgYKUgXPSahRdH?= =?iso-8859-1?Q?jZQofgIMjOOIF9AnGHsk2PR9H/8GACMX4oh+1Lrc4pwiIfd3QDNVXfRh4r?= =?iso-8859-1?Q?wTmWLD87hn3/0n23zXzAlfAAbc7jrsShw3vrBPWKX1IYAEi0yv5jL9YdtL?= =?iso-8859-1?Q?fpbrctwyy5ZJ0Wjs4dYIzDky2fEfuE8pDByD4ZAFh9Pj5L7jRWzveiZGU8?= =?iso-8859-1?Q?4CsaHWq2QcUall2UiMR8EkfwQb6FK5IdBenLe+EeToQmlfKzOPvS3Xse/h?= =?iso-8859-1?Q?qbPj8G8ILvn5KlDe5eUerVdFftbMd0/gVTnPNo7ziKmIqhWJgSQmEOFVr4?= =?iso-8859-1?Q?nrAjocXlHdjfvKT2nRZ0i8Ap6hipJb7LlH4Tlt8MyWdbUe6BzsRraluWT0?= =?iso-8859-1?Q?gb7I3vGZAsxcFEsCanHoHv7VW6Yw1Gj+3yD0Z9YqSu7bLIb2tJU5ytm2Ab?= =?iso-8859-1?Q?viA0KHHfO7MEbpiDhT7GZ5BBjqgj/GO1CiSlLhB60ZO2ISgZ+NzNPJZr4i?= =?iso-8859-1?Q?EEUEby3hWQevh5j10HOzCRBSXTbo2dbm2nXEPCPYIVTvNYj4uHu/5E9USL?= =?iso-8859-1?Q?vrHCOyyuu4zjYLtaf4cCfo9ITOfbLTSHtIqdtxlECGaABn1AtLfaNE22hN?= =?iso-8859-1?Q?RbptRTql27xStzyYRRba4F/whUtWSwpuMnIbEDeautG/40KugiihiuqZmd?= =?iso-8859-1?Q?0A2Kn6KF2vPqIUZNplK3a4cZ37wsz1lW3+m2EJWRLeDP0nOV5N9OEn3OPs?= =?iso-8859-1?Q?IJsQMLNQj1zvEFxoesdXNszNUSVePl3opwBtcBG2aEn7dCDWUjQG80uQra?= =?iso-8859-1?Q?tm/PMAX04kAvgCntW7E1pRrEjwwowK1CIwUuq9NQE2j7wMGMjQUj8Us/EY?= =?iso-8859-1?Q?ctLz0jWd6KoOrHXKREge2b6yc9KrIX5sW2NNrc2wAdu1YuDk6ZWs910D4a?= =?iso-8859-1?Q?kbB8G1x/Bg1z2fYbDt0K3evNJXGUJLnlYgs6IgxTRgbr+5wDxPVfMGB2Qo?= =?iso-8859-1?Q?PJUSp+4cDDs8G8zf4EpIfLukK/pvmUc+w+z/j6+g115LRKKw3tqqGZ3u3G?= =?iso-8859-1?Q?zZUj4koR7OLuSJd6faT82YPUVct9TjrLepA485pEmrfyK7yvxI1F3q463c?= =?iso-8859-1?Q?w2odaS54lvrCseTBi4XO8bQs8NgllhPeGEjoKbkie628gorogcRbUoM9Im?= =?iso-8859-1?Q?/Od1ak1GzoyFpy7QjyPRUJIVFV0W?= x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:SA1PR09MB7311.namprd09.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230040)(10070799003)(366016)(1800799024)(38070700021);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?iso-8859-1?Q?jYag5bzneGTceDz5HZVRLVgUsNASl4Fj/yB+JPuVB4oqE5d09H4Ti3QroW?= =?iso-8859-1?Q?cxmFO64XzyacMRTh8EUJJ+pMmXxkbJWcyNJXpSTkfC5Nov2K0sem2wRQMv?= =?iso-8859-1?Q?RJ9CvZ6SFQmMEdjod/aLyUYZqaoYdjFKz0EG99edTPNYipCU3XVDr5Bou9?= =?iso-8859-1?Q?IGA90T9jTDTw5dSIvlsaJTmZsKGBavE2G8YSCk8AA/+DQMRizKIudeJ6Wa?= =?iso-8859-1?Q?UlNqeqqebfB+OwRjx9WsXnjfdtxCEQHza84mkDGhpRfSgH8P1aimz+jmuv?= =?iso-8859-1?Q?rMRH/KE5nqDza8Vosx0njW3SvUpxI/1RyyHpFTiYMciRfyswwKHNQIkxAO?= =?iso-8859-1?Q?oBRzf3hoUT5n1Aw1dpygaJuWMkEpDwQyG6VZkXBKSwkYJqlvCxs/bKeHRN?= =?iso-8859-1?Q?7ss+rpZkSdhK0rcoBcMh1y1BDVjxGB7N4xici35Cnn+dx+/IHhqFuSuAzz?= =?iso-8859-1?Q?XW0CzFtVqfYMHYzde+xhQvzbk4aMbyqTEmMVKQ5A75QxCFyUOsHJvsPmom?= =?iso-8859-1?Q?M1Oko1w10Fhu8Zog69FzvnhRtYlvP1KAkfJXbyrWGfjNRPJWW1E/lov04u?= =?iso-8859-1?Q?6YGT7NXyF2NDstr99OowUQuYEgZWY+Gp4LjujEUDIUPTtzQG+n7Yr+F4oA?= =?iso-8859-1?Q?3sde4Ie8KuEt1TpuyBMdk1M/g4m8qO4I5DksU6zDSBXZceGQYTKbQrp6SM?= =?iso-8859-1?Q?bjma16THyVuboh5osyhwCgpgLuoYnfv/Z+ePjybBA3n2tFYedFGbRovzbc?= =?iso-8859-1?Q?H5vFJRxvUpyshnTQhx3xv4agN/F8QcWfp3m1VbnB7Ch15FjpLKteO1B7we?= =?iso-8859-1?Q?H+9Tl3pC9g73zFw9Ijw31Cuo6bk2e2ELCnb/wVwWXpPWZE0prCTGrHed8I?= =?iso-8859-1?Q?Mb9wreQymRDP9Yd7LXYMp+soYDoaS6hy92ocAy4Jy7kjJmePFcVS2gvllg?= =?iso-8859-1?Q?RiuifGTiE7Tp3Hvg9JSc/B90rtnRha/MTVmdfZpaV96Ud45Kr1oEtWFfUn?= =?iso-8859-1?Q?Yb+YRmKRfY8JrrhhVqKqFWwqvGC8wEJXRp6Zmxo6SodLQYscTvfFXVz3IX?= =?iso-8859-1?Q?v8ioT5jbbZJgX1RUSM7Rbova4mqc8yxe5DFvmV1nHrczaEF8NDtaVSzOGB?= =?iso-8859-1?Q?tBbrs8ZReG0EfdQIYQERteJyCEEWUXjo4/dgcBpkhn8Svs3lNfcIfp1diA?= =?iso-8859-1?Q?60qrPjbdd2vH/tufqabMa1FilXPKYOYtqmyd/JLCia+YGhFuic7LGiGBNj?= =?iso-8859-1?Q?HgX2BfyzowwEKym8rKbnfuWeg8Y1B7GL5yzC7ZSMOqIQhDTDVRlDBwE3eQ?= =?iso-8859-1?Q?Dci3u88RJl3NGmShGlA++ZpoRTdWQ//M7ZHLMQb6xe8943eTy7E9+0RXtq?= =?iso-8859-1?Q?dMhJZ4PXB940if1tGAdZRj200wDYMk0qCDEP/TbjsyeVlshB5IR1bSvf3J?= =?iso-8859-1?Q?urcSgQGY/ezj/oJZ7BvLZoK8Ha3vctByx3u2fMVRzYQy664RtpJ5owMWkg?= =?iso-8859-1?Q?1knHMuD1shK3LQ94GYL+lGYYRnQcUKLCEHykAZKwyDTi1EaLKlnz+BzGlS?= =?iso-8859-1?Q?3kXJlyADMSoM33xCH90zSPMvLGaiXtaWgVD0OyCcSujptMRFzHYD1aaCGj?= =?iso-8859-1?Q?O39Fx46Brp4l+bHi87o0m4nLe8ZBkEval15e/Fdg2HqYpc/ECDUAw7ULjW?= =?iso-8859-1?Q?dS8TFid2Ibl8Cn63cyg=3D?= Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: fnal.gov X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: SA1PR09MB7311.namprd09.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 0d027a3e-0e48-4b43-8dac-08de127ec316 X-MS-Exchange-CrossTenant-originalarrivaltime: 23 Oct 2025 21:54:38.1331 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 9d5f83d3-d338-4fd3-b1c9-b7d94d70255a X-MS-Exchange-Transport-CrossTenantHeadersStamped: DS9PR09MB12293 List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk Hello, =0A= =0A= I have been setting PITR backup off of base backup. Wal files are shipped t= o the host running pg_basebackup pulling backup from =0A= master host. =0A= =0A= Once base backup finished I wanted to try recovery. =0A= =0A= I added=0A= =0A= restore_command =3D 'gunzip /data/xlogs/%f.gz > %p'=0A= =0A= (that command is wrapped in a script that checks existence of input and exi= ts w/ 0 if it does not as per instructions)=0A= =0A= I did move pg_wal out of the way and re-created it:=0A= =0A= mv pg_wal pg_wal.bak=0A= mkdir pg_wal=0A= =0A= I did touch recovery signal:=0A= =0A= touch recovery.signal=0A= =0A= I see in the log:=0A= =0A= =0A= < 2025-10-23 16:05:30.750 CDT 2876871 > LOG: database system was interrup= ted; last known up at 2025-10-23 02:00:41 CDT=0A= < 2025-10-23 16:05:31.582 CDT 2876871 > LOG: could not stat file "pg_wal/= RECOVERYHISTORY": No such file or directory=0A= < 2025-10-23 16:05:31.582 CDT 2876871 > DETAIL: restore_command returned = a zero exit status, but stat() failed.=0A= < 2025-10-23 16:05:31.582 CDT 2876871 > LOG: starting archive recovery=0A= < 2025-10-23 16:05:31.583 CDT 2876871 > LOG: starting backup recovery wit= h redo LSN 20975/FE0AC690, checkpoint LSN 20975/FE21CA88, on timeline ID 4= =0A= < 2025-10-23 16:05:31.586 CDT 2876871 > LOG: could not stat file "pg_wal/= RECOVERYHISTORY": No such file or directory=0A= < 2025-10-23 16:05:31.586 CDT 2876871 > DETAIL: restore_command returned = a zero exit status, but stat() failed.=0A= < 2025-10-23 16:05:31.798 CDT 2876871 > LOG: restored log file "000000040= 0020975000000FE" from archive=0A= < 2025-10-23 16:05:31.819 CDT 2876871 > LOG: redo starts at 20975/FE0AC69= 0=0A= < 2025-10-23 16:05:33.927 CDT 2876871 > LOG: restored log file "000000040= 0020975000000FF" from archive=0A= =0A= it seems to be churning on, but I am a bit worried about :=0A= =0A= could not stat file "pg_wal/RECOVERYHISTORY": No such file or directory=0A= =0A= I do not recall having to deal with this in the past? Should I have manuall= y created =0A= =0A= pg_wal/archive_status=0A= =0A= my old scripts seem to indicate the need for this - I am trying to resurrec= t =0A= PITR after multiple upgrades and not running it for some time (relying in r= eplica instead) =0A= =0A= So, is it harmless? Postgresql does not fail, the recovery is still ongoing= . =0A= =0A= This is postgresql 15. =0A= =0A= Additional question.... as the wall file are continuously getting shipped t= o the backup host, =0A= will this recovery ever end? (I neglected to set recovery_target_time)=0A= =0A= Thank you very much in advance=0A= =0A= =0A=