pg.ddx.io  pgsql-admin@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Bruno Wolff III <bruno@wolff.to>
To: Kevin Johnson <Kevin.Johnson@noaa.gov>
Cc: pgsql-admin@postgresql.org, Sean Webb <Sean.Webb@noaa.gov>
Subject: Re: Disk space consumed by pk not returned after vacuum or reindex
Date: Fri, 22 Sep 2006 12:05:57 -0500
Message-ID: <20060922170557.GB571@wolff.to> (raw)
In-Reply-To: <45080D4C.2020709@noaa.gov>
References: <45080D4C.2020709@noaa.gov>

On Wed, Sep 13, 2006 at 09:53:16 -0400,
  Kevin Johnson <Kevin.Johnson@noaa.gov> wrote:
> 
> We have a database, which consistently consumes more and more of the 
> disk space in it's lvol until it reaches 100%.  So far, we have tried to 
> run a full vacuum on the database, with limited success.  Eventually, we 
> had to drop and reload the database with the same data inside.  It 
> brought the disk usage down to 73%.  It then began to creep once more 
> toward 100%.  After some research, I was able to use the pg_class 
> catalog to find that the items which are expanding the quickest are 
> primary key (btree) indexes.  I attempted to run a REINDEX on one of the 
> tables with the pk taking up the largest amount of space.  The usage 
> according to pg_class dropped dramatically, however the disk space was 
> not returned to the system.  So I attempted another full vacuum 
> afterwards, and still nothing was returned to the system.  These tables 
> are updated extremely frequently (although their total number of rows is 
> close to constant), which is my guess as to why the pk indexes increase 
> so rapidly in terms of their disk usage.  Unfortunately, PostgreSQL 
> knowledge is limited, and I was wondering if anyone had experienced 
> something similar / knows what else we can do to return this disk space 
> back to the system?

This is possibly index bloat due to new keys always being larger than existing
keys. This was fixed in later releases. There is still some potential for
bloat due to fragmentation, but I believe that has a constant bound.
You might try using the cluster command. I think that will both clean up
the indexes and remove dead rows and do it faster than using a vacuum full
and reindexing. The downside is that the table will be unavailable during
the cluster which might be a deal breaker for you.



view thread (7+ messages)  latest in thread

Message-ID: <20060922170557.GB571@wolff.to>
Permalink:  ../20060922170557.GB571@wolff.to/
Also on:    postgresql.org/message-id/20060922170557.GB571@wolff.to

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients from your mail client; the link fills in
  the headers below: reply via email
  Some clients, webmail especially, drop In-Reply-To and References from
  a link, and the reply then starts a new thread: use the mbox below.

  To: pgsql-admin@postgresql.org
  Cc: bruno@wolff.to, Kevin.Johnson@noaa.gov, Sean.Webb@noaa.gov
  Subject: Re: Disk space consumed by pk not returned after vacuum or reindex
  In-Reply-To: <20060922170557.GB571@wolff.to>
  References: <45080D4C.2020709@noaa.gov> <20060922170557.GB571@wolff.to>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox