MIME-Version: 1.0
References: <CAAccyYKpNsQMD+S-A7a8YtDevFN0uRXkzg4tYWWBOFsv_jASNg@mail.gmail.com>
 <fd5c6708-3791-4339-83a2-e5fc389cd9cb@aklaver.com> <CAAccyYLYZmwQiNMoJcQgo5t+E24rDtu1ZeBUrER7ZTKNAcZesw@mail.gmail.com>
 <d3622bf1-6a62-4703-b14e-295f47b5e348@aklaver.com> <CAAccyYJ-07SzCRAEkGJ2Qa8EAPCHQM4qcpB=OvD8P0zDbCJ0KQ@mail.gmail.com>
 <73f3723b-f279-43c6-884d-d12b3151ec9e@aklaver.com>
In-Reply-To: <73f3723b-f279-43c6-884d-d12b3151ec9e@aklaver.com>
From: Bob Jolliffe <bobjolliffe@gmail.com>
Date: Tue, 12 Aug 2025 18:40:08 +0100
Message-ID: <CACd=f9c9MZUhjGc9hKZL=7S18LkxwW_LDsiH15wmUAO-ERkXxg@mail.gmail.com>
Subject: Re: Questions about the continuity of WAL archiving
To: pgsql-general@lists.postgresql.org
Content-Type: multipart/alternative; boundary="000000000000c3c135063c2e8840"
Archived-At: <https://www.postgresql.org/message-id/CACd%3Df9c9MZUhjGc9hKZL%3D7S18LkxwW_LDsiH15wmUAO-ERkXxg%40mail.gmail.com>
Precedence: bulk

--000000000000c3c135063c2e8840
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

On Tue, 12 Aug 2025 at 17:14, Adrian Klaver <adrian.klaver@aklaver.com>
wrote:

> On 8/12/25 01:24, px shi wrote:
> >
> >     1) What is the current archiving setup on the primary and why is
> >     lagging?
> >
> >   The archive command uses pgBackRest to archive to S3. Because it is
> > uploaded to S3, the archiving speed is slow, which has caused lagging.
> >
> >     2) Have you looked at archiving off the standby node while it is in
> >     standby per:
> >
> > Yes, archiving on the standby node is disabled. Is it recommended to
> > share the WAL archive between the primary and standby nodes to avoid
> > interruptions in archiving?
>
> Given that you are using a less then capable storage solution(S3) why do
> you think pushing the WAL from the standby to S3 would perform any
> better then what is happening with the primary WAL?
>
> The solution is to use a more capable storage platform.
>

That is an interesting point you make Adrian.  S3 seems quite popular for
this type of archiving.  What would you suggest as a more capable (and cost
effective) storage platform?

Regards
Bob

>
> >
> > Adrian Klaver <adrian.klaver@aklaver.com
> > <mailto:adrian.klaver@aklaver.com>> =E4=BA=8E2025=E5=B9=B48=E6=9C=888=
=E6=97=A5=E5=91=A8=E4=BA=94 23:23=E5=86=99=E9=81=93=EF=BC=9A
> >
>
> --
> Adrian Klaver
> adrian.klaver@aklaver.com
>
>
>

--000000000000c3c135063c2e8840
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div dir=3D"ltr">On Tue, 12 Aug 2025 at 17:14, Adrian Klav=
er &lt;<a href=3D"mailto:adrian.klaver@aklaver.com">adrian.klaver@aklaver.c=
om</a>&gt; wrote:</div><div class=3D"gmail_quote gmail_quote_container"><bl=
ockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-lef=
t:1px solid rgb(204,204,204);padding-left:1ex">On 8/12/25 01:24, px shi wro=
te:<br>
&gt; <br>
&gt;=C2=A0 =C2=A0 =C2=A01) What is the current archiving setup on the prima=
ry and why is<br>
&gt;=C2=A0 =C2=A0 =C2=A0lagging?<br>
&gt; <br>
&gt;=C2=A0 =C2=A0The archive command uses pgBackRest to archive to S3. Beca=
use it is <br>
&gt; uploaded to S3, the archiving speed is slow, which has caused lagging.=
<br>
&gt; <br>
&gt;=C2=A0 =C2=A0 =C2=A02) Have you looked at archiving off the standby nod=
e while it is in<br>
&gt;=C2=A0 =C2=A0 =C2=A0standby per:<br>
&gt; <br>
&gt; Yes, archiving on the standby node is disabled. Is it recommended to <=
br>
&gt; share the WAL archive between the primary and standby nodes to avoid <=
br>
&gt; interruptions in archiving?<br>
<br>
Given that you are using a less then capable storage solution(S3) why do <b=
r>
you think pushing the WAL from the standby to S3 would perform any <br>
better then what is happening with the primary WAL?<br>
<br>
The solution is to use a more capable storage platform.<br></blockquote><di=
v><br></div>That is an interesting point you make Adrian.=C2=A0 S3 seems qu=
ite popular for this type of archiving.=C2=A0 What would you suggest as a m=
ore capable (and cost effective) storage platform?<div><br></div><div>Regar=
ds</div><div>Bob=C2=A0</div><blockquote class=3D"gmail_quote" style=3D"marg=
in:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1e=
x">
<br>
&gt; <br>
&gt; Adrian Klaver &lt;<a href=3D"mailto:adrian.klaver@aklaver.com" target=
=3D"_blank">adrian.klaver@aklaver.com</a> <br>
&gt; &lt;mailto:<a href=3D"mailto:adrian.klaver@aklaver.com" target=3D"_bla=
nk">adrian.klaver@aklaver.com</a>&gt;&gt; =E4=BA=8E2025=E5=B9=B48=E6=9C=888=
=E6=97=A5=E5=91=A8=E4=BA=94 23:23=E5=86=99=E9=81=93=EF=BC=9A<br>
&gt; <br>
<br>
-- <br>
Adrian Klaver<br>
<a href=3D"mailto:adrian.klaver@aklaver.com" target=3D"_blank">adrian.klave=
r@aklaver.com</a><br>
<br>
<br>
</blockquote></div></div>

--000000000000c3c135063c2e8840--