From: RominVaghasiya (@RominVaghasiya) <noreply+RominVaghasiya@github.com>
To: pgaudit/pgaudit <noreply+pgaudit-pgaudit@github.com>
Subject: [pgaudit/pgaudit] issue #331: pgaudit_analyze cannot keep up with high-volume CSV audit logs and falls hours behind
Date: Tue, 08 Sep 2026 05:39:00 +0000
Message-ID: <gh-pgaudit-pgaudit-331@github.com> (raw)
## Problem
I am experiencing a significant performance/throughput issue with `pgaudit_analyze` when processing a high-volume PostgreSQL 18 + pgAudit workload.
PostgreSQL is generating CSV audit log files much faster than `pgaudit_analyze` can process them.
The analyzer continues running and does make progress, but it cannot keep up with the incoming audit-log generation rate. As a result, a continuously increasing backlog of CSV files is created, and the data written to the `pgaudit.*` tables becomes significantly delayed.
In my environment, the processing delay has reached more than 1–2 hours.
---
## Environment
- OS: Ubuntu Linux
- PostgreSQL: 18
- pgAudit: 18.x
- Architecture: x86_64
- PostgreSQL port: 5432
- `pgaudit_analyze`: built from the current `pgaudit/pgaudit_analyze` repository
PostgreSQL logging configuration:
```text
logging_collector = on
log_destination = stderr,csvlog
log_rotation_size = 10MB
log_rotation_age = 1d