pg.ddx.io pgsql-performance@postgresql.org mailing list archive
help / color / mirror / Atom feedpg_dump error - out of memory, Failed on request of size 536870912
4+ messages / 3 participants
[nested] [flat]
* pg_dump error - out of memory, Failed on request of size 536870912
@ 2008-08-06 09:48 Marcin Citowicki <marcin.citowicki@m4n.nl>
0 siblings, 1 reply; 4+ messages in thread
From: Marcin Citowicki @ 2008-08-06 09:48 UTC (permalink / raw)
To: pgsql-performance
Hello,
We have a bit of a problem with the daily db backup. At the moment the
backup db size is half of the main db, and we have the following errors
in the log file:
ERROR: out of memory
DETAIL: Failed on request of size 536870912
(There's a bunch of those.)
There were some 'permission denied for language c' errors earlier in the
log, but then the backup continued for a while.
This is the command we're running:
pg_dump -c -h $DB_HOST -U $DB_USER $DB_NAME | PGOPTIONS='-c
maintenance_work_mem=1500MB -c sort_mem=64MB'
psql --quiet -U $DB_DUMP_USER -h $DB_DUMP_HOST $DB_DUMP_NAME;
Both databases (main and backup) are Postgres 8.3.
I'd appreciate any suggestions on how to fix this problem. Also, if you
have a better idea on running a daily backup please let me know.
Thanks!
Marcin
Attachments:
marcin_citowicki.vcf (text/x-vcard, 132B) download
begin:vcard
fn:Marcin Citowicki
n:Citowicki;Marcin
email;internet:marcin.citowicki@m4n.nl
x-mozilla-html:FALSE
version:2.1
end:vcard
* Re: pg_dump error - out of memory, Failed on request of size 536870912
@ 2008-08-06 10:26 Marcin Citowicki <marcin.citowicki@m4n.nl>
parent: Marcin Citowicki <marcin.citowicki@m4n.nl>
0 siblings, 2 replies; 4+ messages in thread
From: Marcin Citowicki @ 2008-08-06 10:26 UTC (permalink / raw)
To: pgsql-performance
Hello,
I forgot to add - all those 'out of memory' errors happen when backup db
is trying to create index. Every 'CREATE INDEX' operation is followed by
'out of memory' error.
Thanks!
Marcin
Marcin Citowicki wrote:
> Hello,
>
> We have a bit of a problem with the daily db backup. At the moment the
> backup db size is half of the main db, and we have the following
> errors in the log file:
>
> ERROR: out of memory
> DETAIL: Failed on request of size 536870912
>
> (There's a bunch of those.)
>
> There were some 'permission denied for language c' errors earlier in
> the log, but then the backup continued for a while.
>
> This is the command we're running:
>
> pg_dump -c -h $DB_HOST -U $DB_USER $DB_NAME | PGOPTIONS='-c
> maintenance_work_mem=1500MB -c sort_mem=64MB'
> psql --quiet -U $DB_DUMP_USER -h $DB_DUMP_HOST $DB_DUMP_NAME;
>
> Both databases (main and backup) are Postgres 8.3.
>
> I'd appreciate any suggestions on how to fix this problem. Also, if
> you have a better idea on running a daily backup please let me know.
> Thanks!
>
> Marcin
Attachments:
marcin_citowicki.vcf (text/x-vcard, 132B) download
begin:vcard
fn:Marcin Citowicki
n:Citowicki;Marcin
email;internet:marcin.citowicki@m4n.nl
x-mozilla-html:FALSE
version:2.1
end:vcard
* Re: pg_dump error - out of memory, Failed on request of size 536870912
@ 2008-08-06 12:21 Pavel Stehule <pavel.stehule@gmail.com>
parent: Marcin Citowicki <marcin.citowicki@m4n.nl>
1 sibling, 0 replies; 4+ messages in thread
From: Pavel Stehule @ 2008-08-06 12:21 UTC (permalink / raw)
To: Marcin Citowicki <marcin.citowicki@m4n.nl>; +Cc: pgsql-performance
Hello
you have some data files broken.
try to use http://svana.org/kleptog/pgsql/pgfsck.html - but DO
DATABASE CLUSTER FILES BACKUP BEFORE. pgfsck doesn't support 8.3, but
it can help you to search currupted rows. Then you have remove these
rows, thats all. Later check your hardware - probably your server has
problems with memory or controller.
regards
Pavel Stehule
2008/8/6 Marcin Citowicki <marcin.citowicki@m4n.nl>:
> Hello,
>
> I forgot to add - all those 'out of memory' errors happen when backup db is
> trying to create index. Every 'CREATE INDEX' operation is followed by 'out
> of memory' error.
> Thanks!
>
> Marcin
>
>
> Marcin Citowicki wrote:
>>
>> Hello,
>>
>> We have a bit of a problem with the daily db backup. At the moment the
>> backup db size is half of the main db, and we have the following errors in
>> the log file:
>>
>> ERROR: out of memory
>> DETAIL: Failed on request of size 536870912
>>
>> (There's a bunch of those.)
>>
>> There were some 'permission denied for language c' errors earlier in the
>> log, but then the backup continued for a while.
>>
>> This is the command we're running:
>>
>> pg_dump -c -h $DB_HOST -U $DB_USER $DB_NAME | PGOPTIONS='-c
>> maintenance_work_mem=1500MB -c sort_mem=64MB'
>> psql --quiet -U $DB_DUMP_USER -h $DB_DUMP_HOST $DB_DUMP_NAME;
>>
>> Both databases (main and backup) are Postgres 8.3.
>>
>> I'd appreciate any suggestions on how to fix this problem. Also, if you
>> have a better idea on running a daily backup please let me know.
>> Thanks!
>>
>> Marcin
>
>
> --
> Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org)
> To make changes to your subscription:
> http://www.postgresql.org/mailpref/pgsql-performance
>
>
^ permalink raw reply [nested|flat] 4+ messages in thread
* Re: pg_dump error - out of memory, Failed on request of size 536870912
@ 2008-08-06 12:33 Stefan Kaltenbrunner <stefan@kaltenbrunner.cc>
parent: Marcin Citowicki <marcin.citowicki@m4n.nl>
1 sibling, 0 replies; 4+ messages in thread
From: Stefan Kaltenbrunner @ 2008-08-06 12:33 UTC (permalink / raw)
To: Marcin Citowicki <marcin.citowicki@m4n.nl>; +Cc: pgsql-performance
Marcin Citowicki wrote:
> Hello,
>
> I forgot to add - all those 'out of memory' errors happen when backup db
> is trying to create index. Every 'CREATE INDEX' operation is followed by
> 'out of memory' error.
are you sure that your OS (or ulimit) is able to support a
maintenance_work_setting that large ? - try reducing to a say 128MB for
a start and try again.
Stefan
^ permalink raw reply [nested|flat] 4+ messages in thread
end of thread, other threads:[~2008-08-06 12:33 UTC | newest]
Thread overview: 4+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2008-08-06 09:48 pg_dump error - out of memory, Failed on request of size 536870912 Marcin Citowicki <marcin.citowicki@m4n.nl>
2008-08-06 10:26 ` Marcin Citowicki <marcin.citowicki@m4n.nl>
2008-08-06 12:21 ` Pavel Stehule <pavel.stehule@gmail.com>
2008-08-06 12:33 ` Stefan Kaltenbrunner <stefan@kaltenbrunner.cc>
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox