Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1t30zV-009Zd0-NE for pgsql-general@arkaria.postgresql.org; Mon, 21 Oct 2024 22:35:09 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1t30zT-00C5px-C5 for pgsql-general@arkaria.postgresql.org; Mon, 21 Oct 2024 22:35:07 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1t30zS-00C5po-Ur for pgsql-general@lists.postgresql.org; Mon, 21 Oct 2024 22:35:07 +0000 Received: from mail-oa1-x32.google.com ([2001:4860:4864:20::32]) by makus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.94.2) (envelope-from ) id 1t30zM-0029nq-7D for pgsql-general@lists.postgresql.org; Mon, 21 Oct 2024 22:35:05 +0000 Received: by mail-oa1-x32.google.com with SMTP id 586e51a60fabf-27beb2496f4so1676391fac.1 for ; Mon, 21 Oct 2024 15:35:00 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1729550099; x=1730154899; darn=lists.postgresql.org; h=cc:to:subject:message-id:date:from:references:in-reply-to :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=ZGi5+Pctm4TkqTxXtY5IsMOPkqKywEe8cYfQurd8NpA=; b=Q3d832b4oa+toU7v/kCCxHkwGnuq90bpOSC+U2DGlO73bEYsoYLmN7VoKAkmmWMly3 LD3YTsnSMcBiw5DmXKcN7Tb7+hAnMU0T5ToM2/4JOrSayORE/L+KOB5EcpYGTyUHyTLo 19TcjQ5pSFXlxfb2fUyn5mscKMYrofCYOalcZcXjWw/ZHOM+Z25belKRfd16r4/3VIp9 nxEIA98aNtS37/Dk8Jh1tKqNiXe4i+6rQOJVIUyy0Q3k+FjruOobXBZB7641BbePqIyV mfg7u34r60ObBtNHmLE+TjoMqyWoq1RAy6xTVnp+ExfxuBYxWnhR6tXmNtu8OnTaXxhz Ko0Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1729550099; x=1730154899; h=cc:to:subject:message-id:date:from:references:in-reply-to :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=ZGi5+Pctm4TkqTxXtY5IsMOPkqKywEe8cYfQurd8NpA=; b=aEDST1cKg5R+U+brV+2Ia6AqXhaPyaI08nDoqiKd9IyLZkE6hH+oHRMsgSjvt9hfkq Rj6L+6+TUNcEy7YQgltLn0zBUniYEq+elz4WpD+O/LE3LIpXVc+s1i+TFtccVhTfB+b7 NqePYfOWdGcEYOh5m1CeMBl6D9HDTRCulPz+njAsIuHkH1jasVza8GKxeAd6B8pGcEWB 2KxIKza1OtrnvfLQkX9JT0oP9D+3uNR8RXF/a7wCK6ldG6HTIoyT8YmXHtjB7pYv3v/W zASOaYVRf6J/YxOiBb43TybyN32t4jeyhyY0gEvVaGiMpPAaeq70uXX0inOjvDWmmOmv RvlQ== X-Forwarded-Encrypted: i=1; AJvYcCXLY6XK1vlKQy5mTbmrjwIQIzykP67O05c4DG0kS/f6hAKaa4ESpRgS8VhPYs2OoMQoxtaW+ttpHz3bQ5yM@lists.postgresql.org X-Gm-Message-State: AOJu0YySG1t3XH69fRx2TlPWTSs498HAWVtmBEqChJrojbKq3EzoZQs7 MiavvgcOBtYiVOIZdAf2JNzB6jYvF3Egzh4RjxqsU2qetuUz8r6sLLwa2Y5bJDrJD1CwfnhCFRA XDCxh0baUTyheqmu2x6qAUZtV/8Q= X-Google-Smtp-Source: AGHT+IG47GqiQOc6NN+qcia2hq9n2X951+sRyE3euDieDPUZ65tKrNAW9MxlUpkPS5rdmm+554fThfff2j8x3bO8Z9w= X-Received: by 2002:a05:6870:470e:b0:27c:475c:ab34 with SMTP id 586e51a60fabf-2892c257ce4mr10140382fac.2.1729550099133; Mon, 21 Oct 2024 15:34:59 -0700 (PDT) MIME-Version: 1.0 Received: by 2002:a8a:e87:0:b0:56c:c9af:3ee6 with HTTP; Mon, 21 Oct 2024 15:34:58 -0700 (PDT) In-Reply-To: References: <52afa4c9-7393-4265-88bb-6393f1b0fb03@aklaver.com> <45e8c44b-2506-41b5-b999-5fdc42472644@aklaver.com> From: "David G. Johnston" Date: Mon, 21 Oct 2024 15:34:58 -0700 Message-ID: Subject: Re: Basebackup fails without useful error message To: Koen De Groote Cc: Adrian Klaver , PostgreSQL General Content-Type: multipart/alternative; boundary="00000000000047be5c0625044356" List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk --00000000000047be5c0625044356 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Sunday, October 20, 2024, Koen De Groote wrote: > > > I'm going to be testing this. If someone could confirm that this is how > writing WAL files works, that being: that it is only considered "done" wh= en > the archive_command is done, that would be great. > The archiving of WAL files by the primary does not involve a replication connection of any sort and thus the =E2=80=9CWAL sender=E2=80=9D settings a= re not relevant to it; or, here, whether or not you are archiving your WAL is immaterial since you are streaming it as it gets produced. If you are streaming WAL it seems highly unusual that you=E2=80=99d end up = in a situation where the connection goes idle long enough that it gets killed, especially if the backup is still happening. I=E2=80=99d probably go with performing the backup under a disabled (or extremely large?) timeout though and move on to other things. That isn=E2=80=99t to say I fully understand what actually is happening her= e=E2=80=A6 David J. --00000000000047be5c0625044356 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Sunday, October 20, 2024, Koen De Groote <kdg.dev@gmail.com> wrote:

I'm going to be testing this. I= f someone could confirm that this is how writing WAL files works, that bein= g: that it is only considered "done" when the archive_command is = done, that would be great.

The archiving of WAL files by the primary does not involve a replication = connection of any sort and thus the =E2=80=9CWAL sender=E2=80=9D settings a= re not relevant to it; or, here, whether or not you are archiving your WAL = is immaterial since you are streaming it as it gets produced.
If you are streaming WAL it seems highly unusual that you=E2=80= =99d end up in a situation where the connection goes idle long enough that = it gets killed, especially if the backup is still happening.=C2=A0 I=E2=80= =99d probably go with performing the backup under a disabled (or extremely = large?) timeout though and move on to other things.

That isn=E2=80=99t to say I fully understand what actually is happening h= ere=E2=80=A6

David J.

--00000000000047be5c0625044356--