Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1kqBMS-0001Cy-Qn for pgsql-admin@arkaria.postgresql.org; Fri, 18 Dec 2020 08:43:41 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1kqBMR-0001nx-Gx for pgsql-admin@arkaria.postgresql.org; Fri, 18 Dec 2020 08:43:39 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1kqBMR-0001np-5a for pgsql-admin@lists.postgresql.org; Fri, 18 Dec 2020 08:43:39 +0000 Received: from mail-ed1-x529.google.com ([2a00:1450:4864:20::529]) by magus.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.92) (envelope-from ) id 1kqBML-0003m1-8F for pgsql-admin@lists.postgresql.org; Fri, 18 Dec 2020 08:43:38 +0000 Received: by mail-ed1-x529.google.com with SMTP id b73so1469368edf.13 for ; Fri, 18 Dec 2020 00:43:32 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cybertec-at.20150623.gappssmtp.com; s=20150623; h=message-id:subject:from:to:date:in-reply-to:references:user-agent :mime-version:content-transfer-encoding; bh=XcNrErL016WecO3ac1jyiog8dMrn5Vg9lCP9MX9JnBw=; b=qDxftzFz5AETaWrEHQKNF+rMa0ITCF728hVFujrXBTzumd68YhTTPbeTQd51J7R1ID Ia7wOP9nQHzF9mW0WVc+ymtcIsBpfsojFVYnPMqgY5cyqODUi8QbScUOEbS0etg8qznh 3eyM/3LVfPAef+tVutf8uSaBl7fA0v7GPHM2odjrH6aFivK4nDj1sAxaLHsOxOiiqd8Y 79XmdnBkd5VR5XypykEBERZRCS+R4mY0gTKDe3c308yLyYYCMWgawVaLqmriXjFk67zP y0iRoRjL1vcG+mM2Z2DhWu7c8OaITExEk5HH2M8AZTtNlnCDdvRLhQs/9/dFEs/ODb9o 9I+w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:message-id:subject:from:to:date:in-reply-to :references:user-agent:mime-version:content-transfer-encoding; bh=XcNrErL016WecO3ac1jyiog8dMrn5Vg9lCP9MX9JnBw=; b=ZPnn0JzThCOjEy3ZG7/hnZ34bAZZYIoPyL+SYaRCuSw4Rkx+TTSnTjx3KzxOSU+X8M al6VKt9LxIN6KkpqecRGZr9q7vFBN7oEl2g4hGd21OgM8ILf0wCk53fdOoXly8PSLxX6 wi3pOCrsLpZpXDCXEyaJmO/oz+mh4twFssouwpGMzpXHmuuLyIBqUvw4+TPyxaHXUaL7 /V9eeCTfJOiS/yfzqzHBY/dth2IEymwpfW88PQhiVQG3ZAh0VZqoV+DgJYg31k5SqDaV iJW4P9i7x9DZt4ZR1CmgRhRk+GWBRbUrWM4p4Iuprco/ZPc3kxoxouAJczWxYGvYngvi RpFQ== X-Gm-Message-State: AOAM533EqRmHh7o290l2qcdoIuMt28gUVjmaM76UbDKWZynhRLQhVLJN thGkRxPCwskDu3htfkdK23FbWg== X-Google-Smtp-Source: ABdhPJwE6v1fxeUWC4h3l60beYuXGC6QAr8dZjxR87dolh9/6jb7F/+aDntkw7GTX3ELbu7HzQqlaw== X-Received: by 2002:a05:6402:6c9:: with SMTP id n9mr3273237edy.43.1608281011475; Fri, 18 Dec 2020 00:43:31 -0800 (PST) Received: from localhost.localdomain (217-149-175-126.nat.highway.telekom.at. [217.149.175.126]) by smtp.gmail.com with ESMTPSA id cf17sm24319977edb.16.2020.12.18.00.43.30 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 18 Dec 2020 00:43:30 -0800 (PST) Message-ID: <9492f3e4fff86b6fcb1d064d680920e8579d9c37.camel@cybertec.at> Subject: Re: Replication failed From: Laurenz Albe To: Sreejith P , pgsql-admin@lists.postgresql.org Date: Fri, 18 Dec 2020 09:43:30 +0100 In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" User-Agent: Evolution 3.36.5 (3.36.5-2.fc32) MIME-Version: 1.0 Content-Transfer-Encoding: 7bit List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Precedence: bulk On Fri, 2020-12-18 at 00:56 +0530, Sreejith P wrote: > We had 1 M x 4 slave server streaming replication using Postgres 10. Was working successfully for long time. > > Suddenly all replication servers got failed and getting following message. > > 2020-12-17 22:24:32 +04 [1587]: [357-1] db=,user=LOG: invalid contrecord length 2722 at AEA/A1FFF9E0. > > Requesting help for identifying root cause. Looks like this problem: https://postgr.es/m/77734732-44A4-4209-8C2F-3AF36C9D4D18%40amazon.com Was there a crash on the primary sever? There is a patch under development at this thread: https://postgr.es/m/CBDDFA01-6E40-46BB-9F98-9340F4379505%40amazon.com Yours, Laurenz Albe