pg.ddx.io  pgsql-admin@postgresql.org mailing list archive  
help / color / mirror / Atom feed
Data Partition is Growing
4+ messages / 2 participants
[nested] [flat]

* Data Partition is Growing
@ 2004-09-29 23:48  Mike Darretta <michael.darretta.ctr@metnet.navy.mil>
  0 siblings, 2 replies; 4+ messages in thread

From: Mike Darretta @ 2004-09-29 23:48 UTC (permalink / raw)
  To: pgsql-admin

I'm an application developer trying to understand a pg data partition 
issue. We are storing large objects (gifs) at a rate of about 1GIG /day. 
After about a week, most of the objects are recycled -- that is, an 
insert triggers a delete of a similar object. The postgres data 
partition, though, continues to grow, even though the objects are 
successfully deleted from the application *and* largeobject tables. I 
understand that removing an object from the database does not 
automatically free up disk space, but I expected to see the disk space 
"level out" at some point. The data partition is currently at 40Gig and 
growing.

We are running Postgres 7.4 with the incremental vacuum process active.

Any thoughts?

Thanks,
Mike




^ permalink  raw  reply  [nested|flat] 4+ messages in thread

* Re: Data Partition is Growing
@ 2004-09-30 01:13  Tom Lane <tgl@sss.pgh.pa.us>
  parent: Mike Darretta <michael.darretta.ctr@metnet.navy.mil>
  1 sibling, 1 reply; 4+ messages in thread

From: Tom Lane @ 2004-09-30 01:13 UTC (permalink / raw)
  To: Mike Darretta <michael.darretta.ctr@metnet.navy.mil>; +Cc: pgsql-admin

Mike Darretta <michael.darretta.ctr@metnet.navy.mil> writes:
> I'm an application developer trying to understand a pg data partition 
> issue. We are storing large objects (gifs) at a rate of about 1GIG /day. 
> After about a week, most of the objects are recycled -- that is, an 
> insert triggers a delete of a similar object. The postgres data 
> partition, though, continues to grow, even though the objects are 
> successfully deleted from the application *and* largeobject tables.

You need to check your free-space-map settings --- it sounds like the
FSM is not large enough to keep track of all the free space in
pg_largeobject.

If you do a "vacuum verbose" across the whole database, the tail end of
the (voluminous) printout will tell you something about where you need
to set the FSM parameters.

			regards, tom lane



^ permalink  raw  reply  [nested|flat] 4+ messages in thread

* Re: Data Partition is Growing
@ 2004-09-30 01:15  Tom Lane <tgl@sss.pgh.pa.us>
  parent: Mike Darretta <michael.darretta.ctr@metnet.navy.mil>
  1 sibling, 0 replies; 4+ messages in thread

From: Tom Lane @ 2004-09-30 01:15 UTC (permalink / raw)
  To: Mike Darretta <michael.darretta.ctr@metnet.navy.mil>; +Cc: pgsql-admin

... forgot to mention ...

Mike Darretta <michael.darretta.ctr@metnet.navy.mil> writes:
> We are running Postgres 7.4 with the incremental vacuum process active.

Also make sure you have an up-to-date version of pg_autovacuum.  The
early releases had bugs that could prevent it from vacuuming very large
tables at all :-( ... and your pg_largeobject table definitely qualifies
as large.

			regards, tom lane



^ permalink  raw  reply  [nested|flat] 4+ messages in thread

* Re: Data Partition is Growing
@ 2004-09-30 16:43  Mike Darretta <michael.darretta.ctr@metnet.navy.mil>
  parent: Tom Lane <tgl@sss.pgh.pa.us>
  0 siblings, 0 replies; 4+ messages in thread

From: Mike Darretta @ 2004-09-30 16:43 UTC (permalink / raw)
  To: pgsql-admin

Thanks. I'll investigate and let you know how things go....

Mike

Tom Lane wrote:

>Mike Darretta <michael.darretta.ctr@metnet.navy.mil> writes:
>  
>
>>I'm an application developer trying to understand a pg data partition 
>>issue. We are storing large objects (gifs) at a rate of about 1GIG /day. 
>>After about a week, most of the objects are recycled -- that is, an 
>>insert triggers a delete of a similar object. The postgres data 
>>partition, though, continues to grow, even though the objects are 
>>successfully deleted from the application *and* largeobject tables.
>>    
>>
>
>You need to check your free-space-map settings --- it sounds like the
>FSM is not large enough to keep track of all the free space in
>pg_largeobject.
>
>If you do a "vacuum verbose" across the whole database, the tail end of
>the (voluminous) printout will tell you something about where you need
>to set the FSM parameters.
>
>			regards, tom lane
>
>  
>





^ permalink  raw  reply  [nested|flat] 4+ messages in thread


end of thread, other threads:[~2004-09-30 16:43 UTC | newest]

Thread overview: 4+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2004-09-29 23:48 Data Partition is Growing Mike Darretta <michael.darretta.ctr@metnet.navy.mil>
2004-09-30 01:13 ` Tom Lane <tgl@sss.pgh.pa.us>
2004-09-30 16:43   ` Mike Darretta <michael.darretta.ctr@metnet.navy.mil>
2004-09-30 01:15 ` Tom Lane <tgl@sss.pgh.pa.us>

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox