MIME-Version: 1.0
References: <CAJM9iN3w3UdA3q4_Xnw+Pg+Nnxe4OAUjLQ7EgLtPe36y4A0HDA@mail.gmail.com>
 <399f53cd1274345d0301dd7ecf016ae749e87abe.camel@cybertec.at>
In-Reply-To: <399f53cd1274345d0301dd7ecf016ae749e87abe.camel@cybertec.at>
From: Justin Swanhart <greenlion@gmail.com>
Date: Thu, 10 Apr 2025 09:12:52 -0400
Message-ID: <CAJM9iN1gwycOH6PBGhN6j5BnrdDMsMq6_rN4nb0dXGL_8m0zWA@mail.gmail.com>
Subject: Re: Archive logging not cleaning up pg_wal directory
To: pgsql-general@lists.postgresql.org
Content-Type: multipart/alternative; boundary="000000000000ae49f306326c5801"
Archived-At: <https://www.postgresql.org/message-id/CAJM9iN1gwycOH6PBGhN6j5BnrdDMsMq6_rN4nb0dXGL_8m0zWA%40mail.gmail.com>
Precedence: bulk

--000000000000ae49f306326c5801
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

Thank you very much.  I had a stale replication slot.  I removed it and the
logs were cleaned up immediately.

--Justin

On Thu, Apr 10, 2025 at 8:48=E2=80=AFAM Laurenz Albe <laurenz.albe@cybertec=
.at>
wrote:

> On Thu, 2025-04-10 at 08:28 -0400, Justin Swanhart wrote:
> > I have the following in my postgresql.conf for archive logging:
> > archive_command=3D'test ! -f /var/lib/postgresql/prod_archive_logs/%f &=
&
> cp %p /var/lib/postgresql/prod_archive_logs/%f'
> >
> > This command is properly copying the log files to my archive directory
> but they remain in the `pg_wal`
> > directory after they are copied, consuming hundreds of gigs of space.
> Am I supposed to create a cron
> > job to clean out the `pg_wal` directory periodically (keep only 1 day o=
f
> logs I guess?)
> >
> > I tried to use mv:
> > archive_command=3D'test ! -f /var/lib/postgresql/prod_archive_logs/%f &=
&
> mv %p /var/lib/postgresql/prod_archive_logs/%f'
> >
> > When I did this the archives were moved away to the archive directory
> but when I tried to set up
> > replication the server could not find the archived log to replicate fro=
m
> so I changed it to "cp" and now have this problem.
> >
> > What am I missing?
>
> Something else is blocking WAL removal:
> https://www.cybertec-postgresql.com/en/why-does-my-pg_wal-keep-growing/
>
> Since you mention replication, my money is on a stale replication slot.
>
> Yours,
> Laurenz Albe
>

--000000000000ae49f306326c5801
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div>Thank you very much.=C2=A0 I had a stale replication =
slot.=C2=A0 I removed it and the logs were cleaned up immediately.</div><di=
v><br></div><div>--Justin</div><br><div class=3D"gmail_quote gmail_quote_co=
ntainer"><div dir=3D"ltr" class=3D"gmail_attr">On Thu, Apr 10, 2025 at 8:48=
=E2=80=AFAM Laurenz Albe &lt;<a href=3D"mailto:laurenz.albe@cybertec.at">la=
urenz.albe@cybertec.at</a>&gt; wrote:<br></div><blockquote class=3D"gmail_q=
uote" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,2=
04);padding-left:1ex">On Thu, 2025-04-10 at 08:28 -0400, Justin Swanhart wr=
ote:<br>
&gt; I have the following in my postgresql.conf for archive logging:<br>
&gt; archive_command=3D&#39;test ! -f /var/lib/postgresql/prod_archive_logs=
/%f &amp;&amp; cp %p /var/lib/postgresql/prod_archive_logs/%f&#39;<br>
&gt; <br>
&gt; This command is properly copying the log files to my archive directory=
 but they remain in the `pg_wal`<br>
&gt; directory after they are copied, consuming hundreds of gigs of space.=
=C2=A0 Am I supposed to create a cron<br>
&gt; job to clean out the `pg_wal` directory periodically (keep only 1 day =
of logs I guess?)<br>
&gt; <br>
&gt; I tried to use mv:<br>
&gt; archive_command=3D&#39;test ! -f /var/lib/postgresql/prod_archive_logs=
/%f &amp;&amp; mv %p /var/lib/postgresql/prod_archive_logs/%f&#39;<br>
&gt; <br>
&gt; When I did this the archives were moved away to the archive directory =
but when I tried to set up<br>
&gt; replication the server could not find the=C2=A0archived log to replica=
te from so I changed it to &quot;cp&quot; and now have this problem.<br>
&gt; <br>
&gt; What am I missing?<br>
<br>
Something else is blocking WAL removal:<br>
<a href=3D"https://www.cybertec-postgresql.com/en/why-does-my-pg_wal-keep-g=
rowing/" rel=3D"noreferrer" target=3D"_blank">https://www.cybertec-postgres=
ql.com/en/why-does-my-pg_wal-keep-growing/</a><br>
<br>
Since you mention replication, my money is on a stale replication slot.<br>
<br>
Yours,<br>
Laurenz Albe<br>
</blockquote></div></div>

--000000000000ae49f306326c5801--