pg.ddx.io pgaudit/pgaudit GitHub issues and pull requestshelp / color / mirror / Atom feed
[pgaudit/pgaudit] issue #331: pgaudit_analyze cannot keep up with high-volume CSV audit logs and falls hours behind 5+ messages / 2 participants [nested] [flat]
* [pgaudit/pgaudit] issue #331: pgaudit_analyze cannot keep up with high-volume CSV audit logs and falls hours behind @ 2026-09-08 05:39 "RominVaghasiya (@RominVaghasiya)" <noreply+RominVaghasiya@github.com> 0 siblings, 0 replies; 5+ messages in thread From: RominVaghasiya (@RominVaghasiya) @ 2026-09-08 05:39 UTC (permalink / raw) To: pgaudit/pgaudit <noreply+pgaudit-pgaudit@github.com> ## Problem I am experiencing a significant performance/throughput issue with `pgaudit_analyze` when processing a high-volume PostgreSQL 18 + pgAudit workload. PostgreSQL is generating CSV audit log files much faster than `pgaudit_analyze` can process them. The analyzer continues running and does make progress, but it cannot keep up with the incoming audit-log generation rate. As a result, a continuously increasing backlog of CSV files is created, and the data written to the `pgaudit.*` tables becomes significantly delayed. In my environment, the processing delay has reached more than 1–2 hours. --- ## Environment - OS: Ubuntu Linux - PostgreSQL: 18 - pgAudit: 18.x - Architecture: x86_64 - PostgreSQL port: 5432 - `pgaudit_analyze`: built from the current `pgaudit/pgaudit_analyze` repository PostgreSQL logging configuration: ```text logging_collector = on log_destination = stderr,csvlog log_rotation_size = 10MB log_rotation_age = 1d ^ permalink raw [nested|flat] 5+ messages in thread
* Re: [pgaudit/pgaudit] issue #331: pgaudit_analyze cannot keep up with high-volume CSV audit logs and falls hours behind @ 2026-09-09 07:31 "dwsteele (@dwsteele)" <noreply+dwsteele@github.com> 3 siblings, 0 replies; 5+ messages in thread From: dwsteele (@dwsteele) @ 2026-09-09 07:31 UTC (permalink / raw) To: pgaudit/pgaudit <noreply+pgaudit-pgaudit@github.com> @dwsteele assigned @dwsteele. ^ permalink raw [nested|flat] 5+ messages in thread
* Re: [pgaudit/pgaudit] issue #331: pgaudit_analyze cannot keep up with high-volume CSV audit logs and falls hours behind @ 2026-09-09 07:31 "dwsteele (@dwsteele)" <noreply+dwsteele@github.com> 3 siblings, 0 replies; 5+ messages in thread From: dwsteele (@dwsteele) @ 2026-09-09 07:31 UTC (permalink / raw) To: pgaudit/pgaudit <noreply+pgaudit-pgaudit@github.com> @dwsteele applied label "invalid". ^ permalink raw [nested|flat] 5+ messages in thread
* Re: [pgaudit/pgaudit] issue #331: pgaudit_analyze cannot keep up with high-volume CSV audit logs and falls hours behind @ 2026-09-09 07:32 "dwsteele (@dwsteele)" <noreply+dwsteele@github.com> 3 siblings, 0 replies; 5+ messages in thread From: dwsteele (@dwsteele) @ 2026-09-09 07:32 UTC (permalink / raw) To: pgaudit/pgaudit <noreply+pgaudit-pgaudit@github.com> @dwsteele closed this. ^ permalink raw [nested|flat] 5+ messages in thread
* Re: [pgaudit/pgaudit] issue #331: pgaudit_analyze cannot keep up with high-volume CSV audit logs and falls hours behind @ 2026-09-09 07:32 "dwsteele (@dwsteele)" <noreply+dwsteele@github.com> 3 siblings, 0 replies; 5+ messages in thread From: dwsteele (@dwsteele) @ 2026-09-09 07:32 UTC (permalink / raw) To: pgaudit/pgaudit <noreply+pgaudit-pgaudit@github.com> Does not apply to this project, closing as invalid. I'll answer the issue on the pgaudit_analyze repo. ^ permalink raw [nested|flat] 5+ messages in thread
end of thread, other threads:[~2026-09-09 07:32 UTC | newest] Thread overview: 5+ messages (download: mbox mbox.gz follow: Atom feed) -- links below jump to the message on this page -- 2026-09-08 05:39 [pgaudit/pgaudit] issue #331: pgaudit_analyze cannot keep up with high-volume CSV audit logs and falls hours behind "RominVaghasiya (@RominVaghasiya)" <noreply+RominVaghasiya@github.com> 2026-09-09 07:31 ` "dwsteele (@dwsteele)" <noreply+dwsteele@github.com> 2026-09-09 07:31 ` "dwsteele (@dwsteele)" <noreply+dwsteele@github.com> 2026-09-09 07:32 ` "dwsteele (@dwsteele)" <noreply+dwsteele@github.com> 2026-09-09 07:32 ` "dwsteele (@dwsteele)" <noreply+dwsteele@github.com>
This inbox is served by DDX for PostgreSQL; see mirroring instructions for how to clone and mirror all data and code used for this inbox