pg.ddx.io pgsql-performance@postgresql.org mailing list archive
help / color / mirror / Atom feedRe: disk filling up
9+ messages / 8 participants
[nested] [flat]
* Re: disk filling up
@ 2007-07-26 13:34 Bill Moran <wmoran@collaborativefusion.com>
parent: Brandon Shalton <brandon@cydataservices.com>
3 siblings, 0 replies; 9+ messages in thread
From: Bill Moran @ 2007-07-26 13:34 UTC (permalink / raw)
To: Brandon Shalton <brandon@cydataservices.com>; +Cc: pgsql-performance
In response to "Brandon Shalton" <brandon@cydataservices.com>:
> Hello all,
>
> My hard disk is filling up in the /base directory to where it has consumed
> all 200gig of that drive.
>
> All the posts that i see keep saying move to a bigger drive, but at some
> point a bigger drive would just get consumed.
>
> How can i keep the disk from filling up other than get like a half TB setup
> just to hold the ./base/* folder
Are you vacuuming regularly? What is the output of vacuum verbose.
If table bloat (fixed by correctly vacuuming) is not your problem, then
you either need to implement a data expiration policy to get rid of
old data, or increase the amount of storage to accommodate the data
you want to keep.
--
Bill Moran
Collaborative Fusion Inc.
http://people.collaborativefusion.com/~wmoran/
wmoran@collaborativefusion.com
Phone: 412-422-3463x4023
^ permalink raw reply [nested|flat] 9+ messages in thread
* Re: disk filling up
@ 2007-07-26 14:37 Mark Lewis <mark.lewis@mir3.com>
parent: Brandon Shalton <brandon@cydataservices.com>
3 siblings, 0 replies; 9+ messages in thread
From: Mark Lewis @ 2007-07-26 14:37 UTC (permalink / raw)
To: Brandon Shalton <brandon@cydataservices.com>; +Cc: pgsql-performance
On Thu, 2007-07-26 at 09:18 -0700, Brandon Shalton wrote:
> Hello all,
>
> My hard disk is filling up in the /base directory to where it has consumed
> all 200gig of that drive.
>
> All the posts that i see keep saying move to a bigger drive, but at some
> point a bigger drive would just get consumed.
>
> How can i keep the disk from filling up other than get like a half TB setup
> just to hold the ./base/* folder
Ummm, don't put more 200G worth of data in there? :)
You didn't give us any information about what you're using the database
for, why you think that using 200G is excessive, what version of the
database you're running, stuff like that. So really there's nothing
that we can help you out with, except for the normal "read the manual
about vacuuming and make sure you're doing it" newbie answer.
-- Mark
^ permalink raw reply [nested|flat] 9+ messages in thread
* Re: disk filling up
@ 2007-07-26 14:47 Joshua D. Drake <jd@commandprompt.com>
parent: Brandon Shalton <brandon@cydataservices.com>
3 siblings, 1 reply; 9+ messages in thread
From: Joshua D. Drake @ 2007-07-26 14:47 UTC (permalink / raw)
To: Brandon Shalton <brandon@cydataservices.com>; +Cc: pgsql-performance
Brandon Shalton wrote:
> Hello all,
>
> My hard disk is filling up in the /base directory to where it has
> consumed all 200gig of that drive.
>
> All the posts that i see keep saying move to a bigger drive, but at some
> point a bigger drive would just get consumed.
>
> How can i keep the disk from filling up other than get like a half TB
> setup just to hold the ./base/* folder
1. Don't have two hundred gig of data.
2. Sounds more like you don't have 200G of data and you aren't vacuuming
enough.
Joshua D. Drake
>
>
>
>
>
> ---------------------------(end of broadcast)---------------------------
> TIP 1: if posting/reading through Usenet, please send an appropriate
> subscribe-nomail command to majordomo@postgresql.org so that your
> message can get through to the mailing list cleanly
>
--
=== The PostgreSQL Company: Command Prompt, Inc. ===
Sales/Support: +1.503.667.4564 || 24x7/Emergency: +1.800.492.2240
Providing the most comprehensive PostgreSQL solutions since 1997
http://www.commandprompt.com/
Donate to the PostgreSQL Project: http://www.postgresql.org/about/donate
PostgreSQL Replication: http://www.commandprompt.com/products/
^ permalink raw reply [nested|flat] 9+ messages in thread
* Re: disk filling up
@ 2007-07-26 15:06 Yudhvir Singh Sidhu <ysidhu@gmail.com>
parent: Mark Kirkwood <markir@paradise.net.nz>
0 siblings, 0 replies; 9+ messages in thread
From: Yudhvir Singh Sidhu @ 2007-07-26 15:06 UTC (permalink / raw)
To: Mark Kirkwood <markir@paradise.net.nz>; +Cc: Brandon Shalton <brandon@cydataservices.com>; pgsql-performance
Mark Kirkwood wrote:
> Brandon Shalton wrote:
>> Hello all,
>>
>> My hard disk is filling up in the /base directory to where it has
>> consumed all 200gig of that drive.
>>
>> All the posts that i see keep saying move to a bigger drive, but at
>> some point a bigger drive would just get consumed.
>>
>> How can i keep the disk from filling up other than get like a half TB
>> setup just to hold the ./base/* folder
>>
>
> Two things come to mind:
>
> - Vacuum as already mentioned by others.
> - Temporary sort files from queries needing to sort massive amounts of
> data.
>
> But you need to help us out by supplying more info...
>
> Cheers
>
> Mark
>
> ---------------------------(end of broadcast)---------------------------
> TIP 4: Have you searched our list archives?
>
> http://archives.postgresql.org
>
Try fsck-ing and do a df before and after and tell us if that makes a
difference.
Yudhvir
^ permalink raw reply [nested|flat] 9+ messages in thread
* disk filling up
@ 2007-07-26 16:18 Brandon Shalton <brandon@cydataservices.com>
0 siblings, 4 replies; 9+ messages in thread
From: Brandon Shalton @ 2007-07-26 16:18 UTC (permalink / raw)
To: pgsql-performance
Hello all,
My hard disk is filling up in the /base directory to where it has consumed
all 200gig of that drive.
All the posts that i see keep saying move to a bigger drive, but at some
point a bigger drive would just get consumed.
How can i keep the disk from filling up other than get like a half TB setup
just to hold the ./base/* folder
^ permalink raw reply [nested|flat] 9+ messages in thread
* Re: disk filling up
@ 2007-07-27 00:48 Mark Kirkwood <markir@paradise.net.nz>
parent: Brandon Shalton <brandon@cydataservices.com>
3 siblings, 1 reply; 9+ messages in thread
From: Mark Kirkwood @ 2007-07-27 00:48 UTC (permalink / raw)
To: Brandon Shalton <brandon@cydataservices.com>; +Cc: pgsql-performance
Brandon Shalton wrote:
> Hello all,
>
> My hard disk is filling up in the /base directory to where it has
> consumed all 200gig of that drive.
>
> All the posts that i see keep saying move to a bigger drive, but at
> some point a bigger drive would just get consumed.
>
> How can i keep the disk from filling up other than get like a half TB
> setup just to hold the ./base/* folder
>
Two things come to mind:
- Vacuum as already mentioned by others.
- Temporary sort files from queries needing to sort massive amounts of data.
But you need to help us out by supplying more info...
Cheers
Mark
^ permalink raw reply [nested|flat] 9+ messages in thread
* Re: disk filling up
@ 2007-07-27 13:44 Merlin Moncure <mmoncure@gmail.com>
parent: Joshua D. Drake <jd@commandprompt.com>
0 siblings, 1 reply; 9+ messages in thread
From: Merlin Moncure @ 2007-07-27 13:44 UTC (permalink / raw)
To: Joshua D. Drake <jd@commandprompt.com>; +Cc: Brandon Shalton <brandon@cydataservices.com>; pgsql-performance
On 7/26/07, Joshua D. Drake <jd@commandprompt.com> wrote:
> Brandon Shalton wrote:
> > Hello all,
> >
> > My hard disk is filling up in the /base directory to where it has
> > consumed all 200gig of that drive.
> >
> > All the posts that i see keep saying move to a bigger drive, but at some
> > point a bigger drive would just get consumed.
> >
> > How can i keep the disk from filling up other than get like a half TB
> > setup just to hold the ./base/* folder
>
> 1. Don't have two hundred gig of data.
> 2. Sounds more like you don't have 200G of data and you aren't vacuuming
> enough.
third (but unlikely) possibility is there are various dropped tables,
etc which need to be deleted but there are stale postgresql processes
holding on to the fd. This would only happen following a postmaster
crash or some other bizarre scenario, but i've seen it on production
box. symptoms are du and df reporting different numbers. solutions
is easy: reboot or stop postmaster and kill all postgresql processes
(or, if you are brave, do it with dbms running and nail all processes
not following postmaster, do a ps axf [on linux] to see them).
merlin
^ permalink raw reply [nested|flat] 9+ messages in thread
* Re: disk filling up
@ 2007-07-31 05:19 Tom Lane <tgl@sss.pgh.pa.us>
parent: Merlin Moncure <mmoncure@gmail.com>
0 siblings, 1 reply; 9+ messages in thread
From: Tom Lane @ 2007-07-31 05:19 UTC (permalink / raw)
To: Merlin Moncure <mmoncure@gmail.com>; +Cc: Joshua D. Drake <jd@commandprompt.com>; Brandon Shalton <brandon@cydataservices.com>; pgsql-performance
"Merlin Moncure" <mmoncure@gmail.com> writes:
> third (but unlikely) possibility is there are various dropped tables,
> etc which need to be deleted but there are stale postgresql processes
> holding on to the fd. This would only happen following a postmaster
> crash or some other bizarre scenario, but i've seen it on production
> box.
Brent Reid reported something similar in bug #3483 but I'm still quite
unclear how it'd happen in any realistic scenario. Can you create a
test case?
regards, tom lane
^ permalink raw reply [nested|flat] 9+ messages in thread
* Re: disk filling up
@ 2007-07-31 16:16 Merlin Moncure <mmoncure@gmail.com>
parent: Tom Lane <tgl@sss.pgh.pa.us>
0 siblings, 0 replies; 9+ messages in thread
From: Merlin Moncure @ 2007-07-31 16:16 UTC (permalink / raw)
To: Tom Lane <tgl@sss.pgh.pa.us>; +Cc: Joshua D. Drake <jd@commandprompt.com>; Brandon Shalton <brandon@cydataservices.com>; pgsql-performance
On 7/31/07, Tom Lane <tgl@sss.pgh.pa.us> wrote:
> "Merlin Moncure" <mmoncure@gmail.com> writes:
> > third (but unlikely) possibility is there are various dropped tables,
> > etc which need to be deleted but there are stale postgresql processes
> > holding on to the fd. This would only happen following a postmaster
> > crash or some other bizarre scenario, but i've seen it on production
> > box.
>
> Brent Reid reported something similar in bug #3483 but I'm still quite
> unclear how it'd happen in any realistic scenario. Can you create a
> test case?
No, but I've seen it on a production 8.1 box (once). I didn't
actually cause the problem, just cleaned it up. It was unnoticed for
several weeks/months because the postmaster processes showed up
without a controlling tty.
My best guess is the postmaster was killed improperly out of haste
during a maintenance window, or possibly an out of disk space related
issue at an earlier point. I never really considered that it was a
postgresql problem.
merlin
^ permalink raw reply [nested|flat] 9+ messages in thread
end of thread, other threads:[~2007-07-31 16:16 UTC | newest]
Thread overview: 9+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2007-07-26 16:18 disk filling up Brandon Shalton <brandon@cydataservices.com>
2007-07-26 13:34 ` Bill Moran <wmoran@collaborativefusion.com>
2007-07-26 14:37 ` Mark Lewis <mark.lewis@mir3.com>
2007-07-26 14:47 ` Joshua D. Drake <jd@commandprompt.com>
2007-07-27 13:44 ` Merlin Moncure <mmoncure@gmail.com>
2007-07-31 05:19 ` Tom Lane <tgl@sss.pgh.pa.us>
2007-07-31 16:16 ` Merlin Moncure <mmoncure@gmail.com>
2007-07-27 00:48 ` Mark Kirkwood <markir@paradise.net.nz>
2007-07-26 15:06 ` Yudhvir Singh Sidhu <ysidhu@gmail.com>
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox