public inbox for [email protected]
help / color / mirror / Atom feedWal file increase
6+ messages / 2 participants
[nested] [flat]
* Wal file increase
@ 2025-12-14 15:30 kasem adel <[email protected]>
2025-12-15 06:31 ` Re: Wal file increase Laurenz Albe <[email protected]>
0 siblings, 1 reply; 6+ messages in thread
From: kasem adel @ 2025-12-14 15:30 UTC (permalink / raw)
To: pgsql-admin
Dears,
Appreciate your usual support that we facing an issue when take
pg_basebackup for 4 TB database in standby server and when backup finished
we face huge number of wal file with huge size generated for 6 hours the
cause replication interruption.
Thanks
^ permalink raw reply [nested|flat] 6+ messages in thread
* Re: Wal file increase
2025-12-14 15:30 Wal file increase kasem adel <[email protected]>
@ 2025-12-15 06:31 ` Laurenz Albe <[email protected]>
2025-12-15 07:25 ` Re: Wal file increase kasem adel <[email protected]>
0 siblings, 1 reply; 6+ messages in thread
From: Laurenz Albe @ 2025-12-15 06:31 UTC (permalink / raw)
To: kasem adel <[email protected]>; pgsql-admin
On Sun, 2025-12-14 at 17:30 +0200, kasem adel wrote:
> Appreciate your usual support that we facing an issue when take pg_basebackup for 4 TB
> database in standby server and when backup finished we face huge number of wal file
> with huge size generated for 6 hours the cause replication interruption.
If you want help with that, you will have to give us enough information to explain what
happened.
- What exactly is a "replication interruption", and how do you diagnose it?
- Are you using streaming replication or logical replication?
- If it is streaming replication, are you using a replication slot?
- It is expected that if you suspend replication and have a replication slot, WAL will
pile up on the primary. But what is the connection with pg_basebackup?
Yours,
Laurenz Albe
^ permalink raw reply [nested|flat] 6+ messages in thread
* Re: Wal file increase
2025-12-14 15:30 Wal file increase kasem adel <[email protected]>
2025-12-15 06:31 ` Re: Wal file increase Laurenz Albe <[email protected]>
@ 2025-12-15 07:25 ` kasem adel <[email protected]>
2025-12-15 08:09 ` Re: Wal file increase Laurenz Albe <[email protected]>
0 siblings, 1 reply; 6+ messages in thread
From: kasem adel @ 2025-12-15 07:25 UTC (permalink / raw)
To: Laurenz Albe <[email protected]>; pgsql-admin
Dear @Laurenz Albe<mailto:[email protected]>,
Thanks for your support We have physical replication connection with Postgres node standby and have another replication slot with logical replication with another node and every day after run pg_basebackup we face huge number of file created and size per every hour is 23GB and in normal size is 0.8 GB and in logical replication we see in logs it’s in same checkpoint but baseline change and we run pg_basebackup with -X fetch -C fast.
Thanks
________________________________
من: Laurenz Albe <[email protected]>
تم الإرسال: Monday, December 15, 2025 8:31:05 AM
إلى: kasem adel <[email protected]>; pgsql-admin <[email protected]>
الموضوع: Re: Wal file increase
On Sun, 2025-12-14 at 17:30 +0200, kasem adel wrote:
> Appreciate your usual support that we facing an issue when take pg_basebackup for 4 TB
> database in standby server and when backup finished we face huge number of wal file
> with huge size generated for 6 hours the cause replication interruption.
If you want help with that, you will have to give us enough information to explain what
happened.
- What exactly is a "replication interruption", and how do you diagnose it?
- Are you using streaming replication or logical replication?
- If it is streaming replication, are you using a replication slot?
- It is expected that if you suspend replication and have a replication slot, WAL will
pile up on the primary. But what is the connection with pg_basebackup?
Yours,
Laurenz Albe
^ permalink raw reply [nested|flat] 6+ messages in thread
* Re: Wal file increase
2025-12-14 15:30 Wal file increase kasem adel <[email protected]>
2025-12-15 06:31 ` Re: Wal file increase Laurenz Albe <[email protected]>
2025-12-15 07:25 ` Re: Wal file increase kasem adel <[email protected]>
@ 2025-12-15 08:09 ` Laurenz Albe <[email protected]>
2025-12-15 08:19 ` Re: Wal file increase kasem adel <[email protected]>
0 siblings, 1 reply; 6+ messages in thread
From: Laurenz Albe @ 2025-12-15 08:09 UTC (permalink / raw)
To: kasem adel <[email protected]>; pgsql-admin
On Mon, 2025-12-15 at 07:25 +0000, kasem adel wrote:
> Thanks for your support We have physical replication connection with Postgres node standby
> and have another replication slot with logical replication with another node and every day
> after run pg_basebackup we face huge number of file created and size per every hour is 23GB
> and in normal size is 0.8 GB and in logical replication we see in logs it’s in same
> checkpoint but baseline change and we run pg_basebackup with -X fetch -C fast.
pg_basebackup does not increase the WAL volume, except by the full-page images that get
written after any checkpoint. So you'd need to find an explanation for that.
"-X fetch" is not a good choice. Use "-X stream".
Anyway, you didn't answer all my questions.
Yours,
Laurenz Albe
^ permalink raw reply [nested|flat] 6+ messages in thread
* Re: Wal file increase
2025-12-14 15:30 Wal file increase kasem adel <[email protected]>
2025-12-15 06:31 ` Re: Wal file increase Laurenz Albe <[email protected]>
2025-12-15 07:25 ` Re: Wal file increase kasem adel <[email protected]>
2025-12-15 08:09 ` Re: Wal file increase Laurenz Albe <[email protected]>
@ 2025-12-15 08:19 ` kasem adel <[email protected]>
2025-12-15 12:14 ` Re: Wal file increase Laurenz Albe <[email protected]>
0 siblings, 1 reply; 6+ messages in thread
From: kasem adel @ 2025-12-15 08:19 UTC (permalink / raw)
To: Laurenz Albe <[email protected]>; pgsql-admin
Dear @Laurenz Albe<mailto:[email protected]>,
-What exactly is a "replication interruption", and how do you diagnose it?
We see replication slot restart every time in these period
- Are you using streaming replication or logical replication?
I have streaming replication for one node and another logical replication
- If it is streaming replication, are you using a replication slot?
Yes have replication slot
- It is expected that if you suspend replication and have a replication slot, WAL will
pile up on the primary. But what is the connection with pg_basebackup?
Yes still exist.
احصل على Outlook لـ iOS<https://aka.ms/o0ukef;
________________________________
من: Laurenz Albe <[email protected]>
تم الإرسال: Monday, December 15, 2025 10:09:00 AM
إلى: kasem adel <[email protected]>; pgsql-admin <[email protected]>
الموضوع: Re: Wal file increase
On Mon, 2025-12-15 at 07:25 +0000, kasem adel wrote:
> Thanks for your support We have physical replication connection with Postgres node standby
> and have another replication slot with logical replication with another node and every day
> after run pg_basebackup we face huge number of file created and size per every hour is 23GB
> and in normal size is 0.8 GB and in logical replication we see in logs it’s in same
> checkpoint but baseline change and we run pg_basebackup with -X fetch -C fast.
pg_basebackup does not increase the WAL volume, except by the full-page images that get
written after any checkpoint. So you'd need to find an explanation for that.
"-X fetch" is not a good choice. Use "-X stream".
Anyway, you didn't answer all my questions.
Yours,
Laurenz Albe
^ permalink raw reply [nested|flat] 6+ messages in thread
* Re: Wal file increase
2025-12-14 15:30 Wal file increase kasem adel <[email protected]>
2025-12-15 06:31 ` Re: Wal file increase Laurenz Albe <[email protected]>
2025-12-15 07:25 ` Re: Wal file increase kasem adel <[email protected]>
2025-12-15 08:09 ` Re: Wal file increase Laurenz Albe <[email protected]>
2025-12-15 08:19 ` Re: Wal file increase kasem adel <[email protected]>
@ 2025-12-15 12:14 ` Laurenz Albe <[email protected]>
0 siblings, 0 replies; 6+ messages in thread
From: Laurenz Albe @ 2025-12-15 12:14 UTC (permalink / raw)
To: kasem adel <[email protected]>; pgsql-admin
On Mon, 2025-12-15 at 08:19 +0000, kasem adel wrote:
> > -What exactly is a "replication interruption", and how do you diagnose it?
> We see replication slot restart every time in these period
I have never heard of a "replication slot restart"...
> > - Are you using streaming replication or logical replication?
> I have streaming replication for one node and another logical replication
> > - If it is streaming replication, are you using a replication slot?
> Yes have replication slot
> > - It is expected that if you suspend replication and have a replication slot, WAL will
> > pile up on the primary. But what is the connection with pg_basebackup?
> Yes still exist.
You probably need to hire an expert to have a look at your system and find
out what *really* is going on there.
Yours,
Laurenz Albe
^ permalink raw reply [nested|flat] 6+ messages in thread
end of thread, other threads:[~2025-12-15 12:14 UTC | newest]
Thread overview: 6+ messages (download: mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2025-12-14 15:30 Wal file increase kasem adel <[email protected]>
2025-12-15 06:31 ` Laurenz Albe <[email protected]>
2025-12-15 07:25 ` kasem adel <[email protected]>
2025-12-15 08:09 ` Laurenz Albe <[email protected]>
2025-12-15 08:19 ` kasem adel <[email protected]>
2025-12-15 12:14 ` Laurenz Albe <[email protected]>
This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox