pg.ddx.io  pgsql-admin@postgresql.org mailing list archive  
help / color / mirror / Atom feed
Stuck Checkpoint Process
4+ messages / 2 participants
[nested] [flat]

* Stuck Checkpoint Process
@ 2021-11-03 09:17  Nikhil Shetty <nikhil.dba04@gmail.com>
  0 siblings, 1 reply; 4+ messages in thread

From: Nikhil Shetty @ 2021-11-03 09:17 UTC (permalink / raw)
  To: pgsql-admin

Hi Team,

PostgreSQL Version - 11.7
OS - RHEL 7.9

Problem:
We see that the backups were not happening on one of the instances. On
further checking, we saw that the checkpoint process was not working. Last
checkpoint was 7 days ago. Manual checkpoint goes into hang state.

Checkpoint Process

> >   pid  |         backend_start         | wait_event_type |
> wait_event      | backend_type
> >
> -------+-------------------------------+-----------------+---------------------+--------------
> >  21237 | 2021-06-29 21:27:51.806746+00 | LWLock          |
> replication_slot_io | checkpointer
> > (1 row)


Time of latest checkpoint:            Wed 27 Oct 2021 03:45:09 PM PDT

I see it is waiting for I/O on replication slots. I see no issue on standby
and replication is working fine. Need help to further debug this

Replication Slots

> > dbname=# select pg_current_wal_lsn();
> >  pg_current_wal_lsn
> > --------------------
> >  2B0/75042DE0
>
> > dbname=# select * from pg_replication_slots ;
> >    slot_name   | plugin | slot_type | datoid | database | temporary |
> active | active_pid | xmin | catalog_xmin | restart_lsn  |
> confirmed_flush_lsn
> >
> ---------------+--------+-----------+--------+----------+-----------+--------+------------+------+--------------+--------------+---------------------
> >  repmgr_slot_5 |        | physical  |        |          | f         | t
>      |       4285 |      |              | 2B0/75042DE0 |
> >  repmgr_slot_1 |        | physical  |        |          | f         | t
>      |       3402 |      |              | 2B0/75042DE0 |
>

Thanks and Regards,
Nikhil

^ permalink  raw  reply  [nested|flat] 4+ messages in thread

* Re: Stuck Checkpoint Process
@ 2021-11-05 05:02  Nikhil Shetty <nikhil.dba04@gmail.com>
  parent: Nikhil Shetty <nikhil.dba04@gmail.com>
  0 siblings, 1 reply; 4+ messages in thread

From: Nikhil Shetty @ 2021-11-05 05:02 UTC (permalink / raw)
  To: pgsql-admin

Hi Team,

Any assist here would be helpful

Thanks,
Nikhil

On Wed, 3 Nov 2021 at 2:47 PM, Nikhil Shetty <nikhil.dba04@gmail.com> wrote:

> Hi Team,
>
> PostgreSQL Version - 11.7
> OS - RHEL 7.9
>
> Problem:
> We see that the backups were not happening on one of the instances. On
> further checking, we saw that the checkpoint process was not working. Last
> checkpoint was 7 days ago. Manual checkpoint goes into hang state.
>
> Checkpoint Process
>
>> >   pid  |         backend_start         | wait_event_type |
>> wait_event      | backend_type
>> >
>> -------+-------------------------------+-----------------+---------------------+--------------
>> >  21237 | 2021-06-29 21:27:51.806746+00 | LWLock          |
>> replication_slot_io | checkpointer
>> > (1 row)
>
>
> Time of latest checkpoint:            Wed 27 Oct 2021 03:45:09 PM PDT
>
> I see it is waiting for I/O on replication slots. I see no issue on
> standby and replication is working fine. Need help to further debug this
>
> Replication Slots
>
>> > dbname=# select pg_current_wal_lsn();
>> >  pg_current_wal_lsn
>> > --------------------
>> >  2B0/75042DE0
>>
>> > dbname=# select * from pg_replication_slots ;
>> >    slot_name   | plugin | slot_type | datoid | database | temporary |
>> active | active_pid | xmin | catalog_xmin | restart_lsn  |
>> confirmed_flush_lsn
>> >
>> ---------------+--------+-----------+--------+----------+-----------+--------+------------+------+--------------+--------------+---------------------
>> >  repmgr_slot_5 |        | physical  |        |          | f         | t
>>      |       4285 |      |              | 2B0/75042DE0 |
>> >  repmgr_slot_1 |        | physical  |        |          | f         | t
>>      |       3402 |      |              | 2B0/75042DE0 |
>>
>
> Thanks and Regards,
> Nikhil
>

^ permalink  raw  reply  [nested|flat] 4+ messages in thread

* Re: Stuck Checkpoint Process
@ 2021-11-07 16:55  Satoshi Nakamoto <70camero@live.com>
  parent: Nikhil Shetty <nikhil.dba04@gmail.com>
  0 siblings, 1 reply; 4+ messages in thread

From: Satoshi Nakamoto @ 2021-11-07 16:55 UTC (permalink / raw)
  To: Nikhil Shetty <nikhil.dba04@gmail.com>; pgsql-admin

Restart then upload the fiol an run it then see what you can do you can put it in a block header an work on it with out crashing  an burningthermit a termitburn is going to bet the ne upgrad to block chain.

Get Outlook for Android<https://aka.ms/AAb9ysg;
________________________________
From: Nikhil Shetty <nikhil.dba04@gmail.com>
Sent: Thursday, November 4, 2021 10:02:04 PM
To: pgsql-admin <pgsql-admin@postgresql.org>
Subject: Re: Stuck Checkpoint Process


Hi Team,

Any assist here would be helpful

Thanks,
Nikhil

On Wed, 3 Nov 2021 at 2:47 PM, Nikhil Shetty <nikhil.dba04@gmail.com<mailto:nikhil.dba04@gmail.com>> wrote:
Hi Team,

PostgreSQL Version - 11.7
OS - RHEL 7.9

Problem:
We see that the backups were not happening on one of the instances. On further checking, we saw that the checkpoint process was not working. Last checkpoint was 7 days ago. Manual checkpoint goes into hang state.

Checkpoint Process
>   pid  |         backend_start         | wait_event_type |     wait_event      | backend_type
> -------+-------------------------------+-----------------+---------------------+--------------
>  21237 | 2021-06-29 21:27:51.806746+00 | LWLock          | replication_slot_io | checkpointer
> (1 row)

Time of latest checkpoint:            Wed 27 Oct 2021 03:45:09 PM PDT

I see it is waiting for I/O on replication slots. I see no issue on standby and replication is working fine. Need help to further debug this

Replication Slots
> dbname=# select pg_current_wal_lsn();
>  pg_current_wal_lsn
> --------------------
>  2B0/75042DE0

> dbname=# select * from pg_replication_slots ;
>    slot_name   | plugin | slot_type | datoid | database | temporary | active | active_pid | xmin | catalog_xmin | restart_lsn  | confirmed_flush_lsn
> ---------------+--------+-----------+--------+----------+-----------+--------+------------+------+--------------+--------------+---------------------
>  repmgr_slot_5 |        | physical  |        |          | f         | t      |       4285 |      |              | 2B0/75042DE0 |
>  repmgr_slot_1 |        | physical  |        |          | f         | t      |       3402 |      |              | 2B0/75042DE0 |

Thanks and Regards,
Nikhil

^ permalink  raw  reply  [nested|flat] 4+ messages in thread

* Re: Stuck Checkpoint Process
@ 2021-11-09 15:59  Nikhil Shetty <nikhil.dba04@gmail.com>
  parent: Satoshi Nakamoto <70camero@live.com>
  0 siblings, 0 replies; 4+ messages in thread

From: Nikhil Shetty @ 2021-11-09 15:59 UTC (permalink / raw)
  To: Satoshi Nakamoto <70camero@live.com>; +Cc: pgsql-admin

Hi,

After restart it is working but I wanted to understand the root cause of
the problem

Thanks,
Nikhil

On Sun, 7 Nov 2021 at 10:25 PM, Satoshi Nakamoto <70camero@live.com> wrote:

> Restart then upload the fiol an run it then see what you can do you can
> put it in a block header an work on it with out crashing  an burningthermit
> a termitburn is going to bet the ne upgrad to block chain.
>
> Get Outlook for Android <https://aka.ms/AAb9ysg;
> ------------------------------
> *From:* Nikhil Shetty <nikhil.dba04@gmail.com>
> *Sent:* Thursday, November 4, 2021 10:02:04 PM
> *To:* pgsql-admin <pgsql-admin@postgresql.org>
> *Subject:* Re: Stuck Checkpoint Process
>
>
> Hi Team,
>
> Any assist here would be helpful
>
> Thanks,
> Nikhil
>
> On Wed, 3 Nov 2021 at 2:47 PM, Nikhil Shetty <nikhil.dba04@gmail.com>
> wrote:
>
> Hi Team,
>
> PostgreSQL Version - 11.7
> OS - RHEL 7.9
>
> Problem:
> We see that the backups were not happening on one of the instances. On
> further checking, we saw that the checkpoint process was not working. Last
> checkpoint was 7 days ago. Manual checkpoint goes into hang state.
>
> Checkpoint Process
>
> >   pid  |         backend_start         | wait_event_type |
> wait_event      | backend_type
> >
> -------+-------------------------------+-----------------+---------------------+--------------
> >  21237 | 2021-06-29 21:27:51.806746+00 | LWLock          |
> replication_slot_io | checkpointer
> > (1 row)
>
>
> Time of latest checkpoint:            Wed 27 Oct 2021 03:45:09 PM PDT
>
> I see it is waiting for I/O on replication slots. I see no issue on
> standby and replication is working fine. Need help to further debug this
>
> Replication Slots
>
> > dbname=# select pg_current_wal_lsn();
> >  pg_current_wal_lsn
> > --------------------
> >  2B0/75042DE0
>
> > dbname=# select * from pg_replication_slots ;
> >    slot_name   | plugin | slot_type | datoid | database | temporary |
> active | active_pid | xmin | catalog_xmin | restart_lsn  |
> confirmed_flush_lsn
> >
> ---------------+--------+-----------+--------+----------+-----------+--------+------------+------+--------------+--------------+---------------------
> >  repmgr_slot_5 |        | physical  |        |          | f         | t
>      |       4285 |      |              | 2B0/75042DE0 |
> >  repmgr_slot_1 |        | physical  |        |          | f         | t
>      |       3402 |      |              | 2B0/75042DE0 |
>
>
> Thanks and Regards,
> Nikhil
>
>

^ permalink  raw  reply  [nested|flat] 4+ messages in thread


end of thread, other threads:[~2021-11-09 15:59 UTC | newest]

Thread overview: 4+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2021-11-03 09:17 Stuck Checkpoint Process Nikhil Shetty <nikhil.dba04@gmail.com>
2021-11-05 05:02 ` Nikhil Shetty <nikhil.dba04@gmail.com>
2021-11-07 16:55   ` Satoshi Nakamoto <70camero@live.com>
2021-11-09 15:59     ` Nikhil Shetty <nikhil.dba04@gmail.com>

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox