Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.89) (envelope-from ) id 1iAuxF-0002E6-LW for pgsql-hackers@arkaria.postgresql.org; Thu, 19 Sep 2019 11:50:33 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.89) (envelope-from ) id 1iAuxE-00088S-3g for pgsql-hackers@arkaria.postgresql.org; Thu, 19 Sep 2019 11:50:32 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.89) (envelope-from ) id 1iAuxD-00088L-Og for pgsql-hackers@lists.postgresql.org; Thu, 19 Sep 2019 11:50:31 +0000 Received: from mail-vs1-xe43.google.com ([2607:f8b0:4864:20::e43]) by magus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.89) (envelope-from ) id 1iAuxA-00009G-P6 for pgsql-hackers@lists.postgresql.org; Thu, 19 Sep 2019 11:50:31 +0000 Received: by mail-vs1-xe43.google.com with SMTP id l2so2036894vsr.8 for ; Thu, 19 Sep 2019 04:50:28 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=HEbKbGMnMwNc0vFm95IjUYt3xW0SYmNL7mA7SI8Peds=; b=T3bBc8NjOzkrh/GgNYuNT+0NbOD4Oh3pSkQhfBxhdoY/NZqSSOed9RPPgEdUzQMW9J 3/0beDr5YZ6+TaCOem7DIfuByoLT948YLWCM37cXD+OqO8d79rnKWgkBsb7ff/mZNIZ/ URLSH0AO+FdigysIcvt6vd20euGVZafWvbzEezlDCY73qpAMYyCK3Zpg8r0gGjYzB/s/ ZybOkMhBJh8/UEOlH7PqFwtNLCu7eeHMBn7iCdcSjyto0QmS/srzsvYJOx7H9T2sMIhz eXhYV2BX/Ynai5IE4Uouwl/rQcwjz+VuHChE+l8OMLvPH9nzR5p6wZ+gwxLcQ/fNzHzf sPOQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=HEbKbGMnMwNc0vFm95IjUYt3xW0SYmNL7mA7SI8Peds=; b=Wj/riNgZZ5BY78EjtTnICoXhvg+ZgF2aLxvcPC0VTiQdw7Djv9ZbbmJHFviw4+PifE /WMdcvoTr9sHq0RRDNcc+FLl6x9ZHFZoZZ/RIVhvXgZnFgUCs78Q+wjba8WXuAfuP2zr N/W2GOhqLbkta2ipGId6O9Yt4NJusLxExOGEBMCVtsam9Ik6PK63KkwbssHf42yG7kue 8Ks6webBm++Y6xfrYQcjqY+SUIeWM8zkkCzpb/q6BwrzCKm5z3+jNg+qoMGgG9M6C/w6 4ngmxjpOVchdunxn8LwAvM74EngWBYpsArdrYDICP2vosA4om4kJnWOkjtT9/HdqXdgw UIdg== X-Gm-Message-State: APjAAAVdHVP1xZTtLXFt1IT5BLeqbXuleRSo05Gw8s5K2Wcc89sf5CRM cp5MzWFPe9TLO/CZX1LG29aLPfcp2Zr97SZ5dhg= X-Google-Smtp-Source: APXvYqxlWkc/gKUlwTHMY7Ph88hspRdSoD9Dt+FPrHh2nG+UMQO4aPZvx1+2kpMxyncvpZTS0NpB/BHCRoaXFwk5UUo= X-Received: by 2002:a67:70c5:: with SMTP id l188mr4959378vsc.19.1568893826829; Thu, 19 Sep 2019 04:50:26 -0700 (PDT) MIME-Version: 1.0 References: <20190213215147.cjbymfojf6xndr4t@alap3.anarazel.de> <20190813080435.GL2551@paquier.xyz> <20190826132904.3ayuw36qzl2c4ktr@development> <7361.1568738373@sss.pgh.pa.us> <20190917194510.iqwyl3be62pz7l27@development> <20190918005815.GB8909@paquier.xyz> <20190918215808.yonxqgycme6pbctp@development> <20190919042305.GA21144@paquier.xyz> In-Reply-To: <20190919042305.GA21144@paquier.xyz> From: Kuntal Ghosh Date: Thu, 19 Sep 2019 17:20:15 +0530 Message-ID: Subject: Re: subscriptionCheck failures on nightjar To: Michael Paquier Cc: Tomas Vondra , Tom Lane , Robert Haas , Andres Freund , Thomas Munro , PostgreSQL Hackers Content-Type: text/plain; charset="UTF-8" List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Precedence: bulk Hello hackers, It seems there is a pattern how the error is occurring in different systems. Following are the relevant log snippets: nightjar: sub3 LOG: received replication command: CREATE_REPLICATION_SLOT "sub3_16414_sync_16394" TEMPORARY LOGICAL pgoutput USE_SNAPSHOT sub3 LOG: logical decoding found consistent point at 0/160B578 sub1 PANIC: could not open file "pg_logical/snapshots/0-160B578.snap": No such file or directory dromedary scenario 1: sub3_16414_sync_16399 LOG: received replication command: CREATE_REPLICATION_SLOT "sub3_16414_sync_16399" TEMPORARY LOGICAL pgoutput USE_SNAPSHOT sub3_16414_sync_16399 LOG: logical decoding found consistent point at 0/15EA694 sub2 PANIC: could not open file "pg_logical/snapshots/0-15EA694.snap": No such file or directory dromedary scenario 2: sub3_16414_sync_16399 LOG: received replication command: CREATE_REPLICATION_SLOT "sub3_16414_sync_16399" TEMPORARY LOGICAL pgoutput USE_SNAPSHOT sub3_16414_sync_16399 LOG: logical decoding found consistent point at 0/15EA694 sub1 PANIC: could not open file "pg_logical/snapshots/0-15EA694.snap": No such file or directory While subscription 3 is created, it eventually reaches to a consistent snapshot point and prints the WAL location corresponding to it. It seems sub1/sub2 immediately fails to serialize the snapshot to the .snap file having the same WAL location. Is this helpful? -- Thanks & Regards, Kuntal Ghosh EnterpriseDB: http://www.enterprisedb.com