Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1oTOHj-0003LT-KN for pgsql-hackers@arkaria.postgresql.org; Wed, 31 Aug 2022 14:01:39 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1oTOHi-0001lZ-7S for pgsql-hackers@arkaria.postgresql.org; Wed, 31 Aug 2022 14:01:38 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1oTOHh-0001lQ-Pc for pgsql-hackers@lists.postgresql.org; Wed, 31 Aug 2022 14:01:37 +0000 Received: from mail-io1-xd31.google.com ([2607:f8b0:4864:20::d31]) by magus.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.92) (envelope-from ) id 1oTOHb-00044c-Ck for pgsql-hackers@postgresql.org; Wed, 31 Aug 2022 14:01:37 +0000 Received: by mail-io1-xd31.google.com with SMTP id n202so11942549iod.6 for ; Wed, 31 Aug 2022 07:01:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=telsasoft-com.20210112.gappssmtp.com; s=20210112; h=user-agent:content-disposition:mime-version:message-id:subject:cc :to:from:date:from:to:cc:subject:date; bh=h0kZMWoNWfCo+tL+yEfXXrc37Z/bqVyNk8vI5R6futw=; b=3s6TZ1p7mH2xSTyzv7bw3hrwQZ0Bv+Ju/WCRVynYFZjnXyqucwBuUcJgtH+IZhoxdS 7pP+enD8T3+lRrC4z5xw/SdyKAce6A7B78LTtgNSsM0qCxWxBpp6dv/PxMpr09NP7yg/ ddZD4RWcFn6Esb9oRT0bLZuBLnkV14LSVbqICUmfjtbam9Ipaez7D0xPc1SUiN7vs3v7 Zwd/CfoPLoEbntIVTlL0NtVBZIJFpYjCUeQ/SQ/ZyOIaBMT5aSBP7JL7vtTEtwgaa0+V Rt2BSl54Dwxm0K3x6AjT7C2kUurl41x/9e59CBQDtNgViRBi/ll/Pt/RVrSesg0xPF+V mLQg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=user-agent:content-disposition:mime-version:message-id:subject:cc :to:from:date:x-gm-message-state:from:to:cc:subject:date; bh=h0kZMWoNWfCo+tL+yEfXXrc37Z/bqVyNk8vI5R6futw=; b=JjK2b6J8mLP4gxpkVCuhixx7bkO8kxLvU1GB11H3+ujMxxvG20HgpccLRnQg6XgRaW BWjJJryMVq7D8B0t9XINwzmMyiAD/7NLQyM1V3dKjMJI9GbG99pKtc97+q7GtT2cFRjh ShywMBaaVW1ATM/TnnxTYhjCg5c1DJZmxiNp92T2S+xO/SSaNQsXLYx5N0kWK/U17hhH ddgnDnvx7xGYcG07SBoRagCn0+v4RwvBXG80tYBcFhqaDe5J4vVhd9QFgTUImgfghLkv 6d4wLeq2sdlp+giMR3NxdUUmx2wAmc8Ms3cANCwGb/vQwihx878RSVLTp6Ks6quPMD2w iiwQ== X-Gm-Message-State: ACgBeo08XQbRWNP+jvbhnaT+nn/3r1j7MVG2oourpoWPsYsz1z7S7IGk ftZBOavfUT29jj2DlXXsNorpmA== X-Google-Smtp-Source: AA6agR4pVYoKBjEBb/j70RMk3B7YO6ioV/0LdNeBddrNOmY94BN4oz+y2S7UMxcWT4Nwod7rmgwEAg== X-Received: by 2002:a02:85a1:0:b0:349:2e9f:794 with SMTP id d30-20020a0285a1000000b003492e9f0794mr15013344jai.113.1661954489344; Wed, 31 Aug 2022 07:01:29 -0700 (PDT) Received: from pryzbyj.telsasoft (charmander.telsasoft.com. [50.244.222.1]) by smtp.gmail.com with ESMTPSA id g8-20020a022708000000b00331598832besm6880013jaa.25.2022.08.31.07.01.28 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Wed, 31 Aug 2022 07:01:28 -0700 (PDT) Received: by pryzbyj.telsasoft (Postfix, from userid 1000) id 4D124800E22; Wed, 31 Aug 2022 09:01:28 -0500 (CDT) Date: Wed, 31 Aug 2022 09:01:28 -0500 From: Justin Pryzby To: Thomas Munro Cc: "Shinoda, Noriyoshi (PN Japan FSIP)" , Tomas Vondra , Stephen Frost , Andres Freund , Jakub Wartak , Alvaro Herrera , Tomas Vondra , Dmitry Dolgov <9erthalion6@gmail.com>, David Steele , pgsql-hackers Subject: pg15b3: recovery fails with wal prefetch enabled Message-ID: <20220831140128.GS31833@telsasoft.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.9.4 (2018-02-28) List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk An internal VM crashed last night due to OOM. When I tried to start postgres, it failed like: < 2022-08-31 08:44:10.495 CDT >LOG: checkpoint starting: end-of-recovery immediate wait < 2022-08-31 08:44:10.609 CDT >LOG: request to flush past end of generated WAL; request 1201/1CAF84F0, current position 1201/1CADB730 < 2022-08-31 08:44:10.609 CDT >CONTEXT: writing block 0 of relation base/16881/2840_vm < 2022-08-31 08:44:10.609 CDT >ERROR: xlog flush request 1201/1CAF84F0 is not satisfied --- flushed only to 1201/1CADB730 < 2022-08-31 08:44:10.609 CDT >CONTEXT: writing block 0 of relation base/16881/2840_vm < 2022-08-31 08:44:10.609 CDT >FATAL: checkpoint request failed I was able to start it with -c recovery_prefetch=no, so it seems like prefetch tried to do too much. The VM runs centos7 under qemu. I'm making a copy of the data dir in cases it's needed. -- Justin