pg.ddx.io  pgaudit/pgaudit GitHub issues and pull requests  
help / color / mirror / Atom feed
From: RominVaghasiya (@RominVaghasiya) <noreply+RominVaghasiya@github.com>
To: pgaudit/pgaudit <noreply+pgaudit-pgaudit@github.com>
Subject: [pgaudit/pgaudit] issue #331: pgaudit_analyze cannot keep up with high-volume CSV audit logs and falls hours behind
Date: Tue, 08 Sep 2026 05:39:00 +0000
Message-ID: <gh-pgaudit-pgaudit-331@github.com> (raw)

## Problem

I am experiencing a significant performance/throughput issue with `pgaudit_analyze` when processing a high-volume PostgreSQL 18 + pgAudit workload.

PostgreSQL is generating CSV audit log files much faster than `pgaudit_analyze` can process them.

The analyzer continues running and does make progress, but it cannot keep up with the incoming audit-log generation rate. As a result, a continuously increasing backlog of CSV files is created, and the data written to the `pgaudit.*` tables becomes significantly delayed.

In my environment, the processing delay has reached more than 1–2 hours.

---

## Environment

- OS: Ubuntu Linux
- PostgreSQL: 18
- pgAudit: 18.x
- Architecture: x86_64
- PostgreSQL port: 5432
- `pgaudit_analyze`: built from the current `pgaudit/pgaudit_analyze` repository

PostgreSQL logging configuration:

```text
logging_collector = on
log_destination = stderr,csvlog
log_rotation_size = 10MB
log_rotation_age = 1d

view thread (5+ messages)  latest in thread

Message-ID: <gh-pgaudit-pgaudit-331@github.com>
Permalink:  ../gh-pgaudit-pgaudit-331@github.com/

 · 


This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox