public inbox for [email protected]help / color / mirror / Atom feed
No. Of wal files generated 7+ messages / 4 participants [nested] [flat]
* No. Of wal files generated @ 2025-03-07 15:59 Atul Kumar <[email protected]> 0 siblings, 2 replies; 7+ messages in thread From: Atul Kumar @ 2025-03-07 15:59 UTC (permalink / raw) To: pgsql-general <[email protected]> Hi, Please could you help me by sharing any redhat linux command through which I can count the no. of wal files and no. of ".ready" files generated in last 10 minutes. Regards, Atul ^ permalink raw reply [nested|flat] 7+ messages in thread
* Re: No. Of wal files generated @ 2025-03-07 17:15 Ron Johnson <[email protected]> parent: Atul Kumar <[email protected]> 1 sibling, 1 reply; 7+ messages in thread From: Ron Johnson @ 2025-03-07 17:15 UTC (permalink / raw) To: pgsql-general <[email protected]> On Fri, Mar 7, 2025 at 10:59 AM Atul Kumar <[email protected]> wrote: > Hi, > > Please could you help me by sharing any redhat linux command through which > I can count the no. of wal files and no. of ".ready" files generated in > last 10 minutes. > What problem are you trying to solve? -- Death to <Redacted>, and butter sauce. Don't boil me, I'm still alive. <Redacted> lobster! ^ permalink raw reply [nested|flat] 7+ messages in thread
* Re: No. Of wal files generated @ 2025-03-07 19:46 Atul Kumar <[email protected]> parent: Ron Johnson <[email protected]> 0 siblings, 2 replies; 7+ messages in thread From: Atul Kumar @ 2025-03-07 19:46 UTC (permalink / raw) To: Ron Johnson <[email protected]>; +Cc: pgsql-general <[email protected]> I want to check and compare the speed wal file generation process and archival process. So I want to check how many wal file got created in x minutes and how many .ready files got created in those x minutes. Regards, Atul On Fri, 7 Mar 2025, 22:45 Ron Johnson, <[email protected]> wrote: > On Fri, Mar 7, 2025 at 10:59 AM Atul Kumar <[email protected]> wrote: > >> Hi, >> >> Please could you help me by sharing any redhat linux command through >> which I can count the no. of wal files and no. of ".ready" files generated >> in last 10 minutes. >> > > What problem are you trying to solve? > > -- > Death to <Redacted>, and butter sauce. > Don't boil me, I'm still alive. > <Redacted> lobster! > ^ permalink raw reply [nested|flat] 7+ messages in thread
* Re: No. Of wal files generated @ 2025-03-07 20:07 Ron Johnson <[email protected]> parent: Atul Kumar <[email protected]> 1 sibling, 1 reply; 7+ messages in thread From: Ron Johnson @ 2025-03-07 20:07 UTC (permalink / raw) To: Atul Kumar <[email protected]>; +Cc: pgsql-general <[email protected]> inotifywait can log every file creation and deletion in a directory. Honestly, though, I'd strongly think about using PgBackRest instead of something you wrote yourself. On Fri, Mar 7, 2025 at 2:47 PM Atul Kumar <[email protected]> wrote: > I want to check and compare the speed wal file generation process and > archival process. > > So I want to check how many wal file got created in x minutes and how many > .ready files got created in those x minutes. > > > > Regards, > Atul > > On Fri, 7 Mar 2025, 22:45 Ron Johnson, <[email protected]> wrote: > >> On Fri, Mar 7, 2025 at 10:59 AM Atul Kumar <[email protected]> wrote: >> >>> Hi, >>> >>> Please could you help me by sharing any redhat linux command through >>> which I can count the no. of wal files and no. of ".ready" files generated >>> in last 10 minutes. >>> >> >> What problem are you trying to solve? >> >> -- >> Death to <Redacted>, and butter sauce. >> Don't boil me, I'm still alive. >> <Redacted> lobster! >> > -- Death to <Redacted>, and butter sauce. Don't boil me, I'm still alive. <Redacted> lobster! ^ permalink raw reply [nested|flat] 7+ messages in thread
* Re: No. Of wal files generated @ 2025-03-08 00:53 Atul Kumar <[email protected]> parent: Ron Johnson <[email protected]> 0 siblings, 0 replies; 7+ messages in thread From: Atul Kumar @ 2025-03-08 00:53 UTC (permalink / raw) To: pgsql-general <[email protected]> Please can you elaborate more about the meaning of inotifywait. And how pgbackrest will solve the issue ? Regards. On Sat, 8 Mar 2025, 01:37 Ron Johnson, <[email protected]> wrote: > inotifywait can log every file creation and deletion in a directory. > > Honestly, though, I'd strongly think about using PgBackRest instead of > something you wrote yourself. > > On Fri, Mar 7, 2025 at 2:47 PM Atul Kumar <[email protected]> wrote: > >> I want to check and compare the speed wal file generation process and >> archival process. >> >> So I want to check how many wal file got created in x minutes and how >> many .ready files got created in those x minutes. >> >> >> >> Regards, >> Atul >> >> On Fri, 7 Mar 2025, 22:45 Ron Johnson, <[email protected]> wrote: >> >>> On Fri, Mar 7, 2025 at 10:59 AM Atul Kumar <[email protected]> >>> wrote: >>> >>>> Hi, >>>> >>>> Please could you help me by sharing any redhat linux command through >>>> which I can count the no. of wal files and no. of ".ready" files generated >>>> in last 10 minutes. >>>> >>> >>> What problem are you trying to solve? >>> >>> -- >>> Death to <Redacted>, and butter sauce. >>> Don't boil me, I'm still alive. >>> <Redacted> lobster! >>> >> > > -- > Death to <Redacted>, and butter sauce. > Don't boil me, I'm still alive. > <Redacted> lobster! > ^ permalink raw reply [nested|flat] 7+ messages in thread
* Re: No. Of wal files generated @ 2025-03-08 03:34 Greg Sabino Mullane <[email protected]> parent: Atul Kumar <[email protected]> 1 sibling, 0 replies; 7+ messages in thread From: Greg Sabino Mullane @ 2025-03-08 03:34 UTC (permalink / raw) To: Atul Kumar <[email protected]>; +Cc: Ron Johnson <[email protected]>; pgsql-general <[email protected]> Take a look at the pg_stat_archiver view, if you have not already: https://www.postgresql.org/docs/current/monitoring-stats.html#MONITORING-PG-STAT-ARCHIVER-VIEW So I want to check how many wal file got created in x minutes and how many > .ready files got created in those x minutes. > It's not clear why you would want to track .ready files, they should be quite transient, and not a concern unless you are rolling your own archiving system (which you should not be). But Ron's suggestion of inotifywait is a good one for this. Probably listed as inotify or inotify-tools in your packaging system. Basic usage would be something like this, from the data directory: timeout 10m inotifywait pg_wal/ -r -m -e close_write -o walinfo.log Cheers, Greg -- Crunchy Data - https://www.crunchydata.com Enterprise Postgres Software Products & Tech Support ^ permalink raw reply [nested|flat] 7+ messages in thread
* Re: No. Of wal files generated @ 2025-03-10 07:41 Achilleas Mantzios - cloud <[email protected]> parent: Atul Kumar <[email protected]> 1 sibling, 0 replies; 7+ messages in thread From: Achilleas Mantzios - cloud @ 2025-03-10 07:41 UTC (permalink / raw) To: [email protected] On 3/7/25 17:59, Atul Kumar wrote: > Hi, > > Please could you help me by sharing any redhat linux command through > which I can count the no. of wal files and no. of ".ready" files > generated in last 10 minutes. Do you have wal archiving enabled? If yes, then simply go to the archive dir and suit your self with find , ls, grep, awk, sort , unic -c , etc . Find files created in the last 10 mins : find -cmin 10 to get statistics over time : ***CLOUD*** jboss@sma:/smadb/smadb/pgsql/pitr$ ls -lt | head -10 total 629962796 -rw------- 1 postgres postgres 16777216 Mar 10 09:32 000000010000472D00000078 -rw------- 1 postgres postgres 16777216 Mar 10 09:32 000000010000472D00000077 -rw------- 1 postgres postgres 16777216 Mar 10 09:32 000000010000472D00000076 -rw------- 1 postgres postgres 16777216 Mar 10 09:32 000000010000472D00000075 ... you may use : ls -lt | awk '{print $6""$7"_"substr($8,1,2) }' | sort | uniq -c | less to get the distribution over (group by) 1 hour intervals > > > > Regards, > Atul ^ permalink raw reply [nested|flat] 7+ messages in thread
end of thread, other threads:[~2025-03-10 07:41 UTC | newest] Thread overview: 7+ messages (download: mbox mbox.gz follow: Atom feed) -- links below jump to the message on this page -- 2025-03-07 15:59 No. Of wal files generated Atul Kumar <[email protected]> 2025-03-07 17:15 ` Ron Johnson <[email protected]> 2025-03-07 19:46 ` Atul Kumar <[email protected]> 2025-03-07 20:07 ` Ron Johnson <[email protected]> 2025-03-08 00:53 ` Atul Kumar <[email protected]> 2025-03-08 03:34 ` Greg Sabino Mullane <[email protected]> 2025-03-10 07:41 ` Achilleas Mantzios - cloud <[email protected]>
This inbox is served by agora; see mirroring instructions for how to clone and mirror all data and code used for this inbox