pg.ddx.io  pgaudit/pgaudit GitHub issues and pull requests  
help / color / mirror / Atom feed
[pgaudit/pgaudit] issue #331: pgaudit_analyze cannot keep up with high-volume CSV audit logs and falls hours behind
5+ messages / 2 participants
[nested] [flat]

* [pgaudit/pgaudit] issue #331: pgaudit_analyze cannot keep up with high-volume CSV audit logs and falls hours behind
@ 2026-09-08 05:39 "RominVaghasiya (@RominVaghasiya)" <noreply+RominVaghasiya@github.com>
  0 siblings, 0 replies; 5+ messages in thread

From: RominVaghasiya (@RominVaghasiya) @ 2026-09-08 05:39 UTC (permalink / raw)
  To: pgaudit/pgaudit <noreply+pgaudit-pgaudit@github.com>

## Problem

I am experiencing a significant performance/throughput issue with `pgaudit_analyze` when processing a high-volume PostgreSQL 18 + pgAudit workload.

PostgreSQL is generating CSV audit log files much faster than `pgaudit_analyze` can process them.

The analyzer continues running and does make progress, but it cannot keep up with the incoming audit-log generation rate. As a result, a continuously increasing backlog of CSV files is created, and the data written to the `pgaudit.*` tables becomes significantly delayed.

In my environment, the processing delay has reached more than 1–2 hours.

---

## Environment

- OS: Ubuntu Linux
- PostgreSQL: 18
- pgAudit: 18.x
- Architecture: x86_64
- PostgreSQL port: 5432
- `pgaudit_analyze`: built from the current `pgaudit/pgaudit_analyze` repository

PostgreSQL logging configuration:

```text
logging_collector = on
log_destination = stderr,csvlog
log_rotation_size = 10MB
log_rotation_age = 1d

^ permalink  raw  [nested|flat] 5+ messages in thread

* Re: [pgaudit/pgaudit] issue #331: pgaudit_analyze cannot keep up with high-volume CSV audit logs and falls hours behind
@ 2026-09-09 07:31 ` "dwsteele (@dwsteele)" <noreply+dwsteele@github.com>
  3 siblings, 0 replies; 5+ messages in thread

From: dwsteele (@dwsteele) @ 2026-09-09 07:31 UTC (permalink / raw)
  To: pgaudit/pgaudit <noreply+pgaudit-pgaudit@github.com>

@dwsteele assigned @dwsteele.

^ permalink  raw  [nested|flat] 5+ messages in thread

* Re: [pgaudit/pgaudit] issue #331: pgaudit_analyze cannot keep up with high-volume CSV audit logs and falls hours behind
@ 2026-09-09 07:31 ` "dwsteele (@dwsteele)" <noreply+dwsteele@github.com>
  3 siblings, 0 replies; 5+ messages in thread

From: dwsteele (@dwsteele) @ 2026-09-09 07:31 UTC (permalink / raw)
  To: pgaudit/pgaudit <noreply+pgaudit-pgaudit@github.com>

@dwsteele applied label "invalid".

^ permalink  raw  [nested|flat] 5+ messages in thread

* Re: [pgaudit/pgaudit] issue #331: pgaudit_analyze cannot keep up with high-volume CSV audit logs and falls hours behind
@ 2026-09-09 07:32 ` "dwsteele (@dwsteele)" <noreply+dwsteele@github.com>
  3 siblings, 0 replies; 5+ messages in thread

From: dwsteele (@dwsteele) @ 2026-09-09 07:32 UTC (permalink / raw)
  To: pgaudit/pgaudit <noreply+pgaudit-pgaudit@github.com>

@dwsteele closed this.

^ permalink  raw  [nested|flat] 5+ messages in thread

* Re: [pgaudit/pgaudit] issue #331: pgaudit_analyze cannot keep up with high-volume CSV audit logs and falls hours behind
@ 2026-09-09 07:32 ` "dwsteele (@dwsteele)" <noreply+dwsteele@github.com>
  3 siblings, 0 replies; 5+ messages in thread

From: dwsteele (@dwsteele) @ 2026-09-09 07:32 UTC (permalink / raw)
  To: pgaudit/pgaudit <noreply+pgaudit-pgaudit@github.com>

Does not apply to this project, closing as invalid. I'll answer the issue on the pgaudit_analyze repo.

^ permalink  raw  [nested|flat] 5+ messages in thread


end of thread, other threads:[~2026-09-09 07:32 UTC | newest]

Thread overview: 5+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2026-09-08 05:39 [pgaudit/pgaudit] issue #331: pgaudit_analyze cannot keep up with high-volume CSV audit logs and falls hours behind "RominVaghasiya (@RominVaghasiya)" <noreply+RominVaghasiya@github.com>
2026-09-09 07:31 ` "dwsteele (@dwsteele)" <noreply+dwsteele@github.com>
2026-09-09 07:31 ` "dwsteele (@dwsteele)" <noreply+dwsteele@github.com>
2026-09-09 07:32 ` "dwsteele (@dwsteele)" <noreply+dwsteele@github.com>
2026-09-09 07:32 ` "dwsteele (@dwsteele)" <noreply+dwsteele@github.com>

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox