pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Tomas Szepe <szepe@pinerecords.com>
To: pgsql-bugs@postgresql.org
Subject: db growing out of proportion
Date: Thu, 29 May 2003 18:32:39 +0200
Message-ID: <20030529163239.GA11101@louise.pinerecords.com> (raw)

Hello everybody,

I'm facing a simple yet gravely problem with postgresql 7.3.2 on x86 Linux.
My db is used to store IP accounting statistics for about 30 C's.  There are
a couple truly trivial tables such as the one below:

CREATE TABLE stats_min
(
	ip	inet		NOT NULL,
	start	timestamp	NOT NULL default CURRENT_TIMESTAMP(0),
	intlen	int4		NOT NULL default 60,
	d_in	int8		NOT NULL,
	d_out	int8		NOT NULL,

	constraint "stats_min_pkey" PRIMARY KEY ("ip", "start")
);
CREATE INDEX stats_min_start ON stats_min (start);

A typical transaction committed on these tables looks like this:

BEGIN WORK
	DELETE ...
	UPDATE/INSERT ...
COMMIT WORK

Trouble is, as the rows in the tables get deleted/inserted/updated
(the frequency being a couple thousand rows per minute), the database
is growing out of proportion in size.  After about a week, I have
to redump the db by hand so as to get query times back to sensible
figures.  A transaction that takes ~50 seconds before the redump will
then complete in under 5 seconds (the corresponding data/base/ dir having
shrunk from ~2 GB to ~0.6GB).

A nightly VACCUM ANALYZE is no use.

A VACUUM FULL is no use.

A VACUUM FULL followed by REINDEX is no use.

It seems that only a full redump involving "pg_dump olddb | \
psql newdb" is capable of restoring the system to its working
glory.

Please accept my apologies if I've overlooked a relevant piece of
information in the docs.  I'm in an urgent need of getting this
problem resolved.

-- 
Tomas Szepe <szepe@pinerecords.com>



view thread (15+ messages)  latest in thread

Message-ID: <20030529163239.GA11101@louise.pinerecords.com>
Permalink:  ../20030529163239.GA11101@louise.pinerecords.com/
Also on:    postgresql.org/message-id/20030529163239.GA11101@louise.pinerecords.com

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients from your mail client; the link fills in
  the headers below: reply via email
  Some clients, webmail especially, drop In-Reply-To and References from
  a link, and the reply then starts a new thread: use the mbox below.

  To: pgsql-performance@postgresql.org
  Cc: szepe@pinerecords.com, pgsql-bugs@postgresql.org
  Subject: Re: db growing out of proportion
  In-Reply-To: <20030529163239.GA11101@louise.pinerecords.com>
  References: <20030529163239.GA11101@louise.pinerecords.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox