pg.ddx.io  pgsql-admin@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Shoaib Mir <shoaibmir@gmail.com>
To: Thomas Markus <t.markus@proventis.net>
Cc: pgsql-admin@postgresql.org
Subject: Re: out of memory in backup and restore
Date: Fri, 15 Dec 2006 17:17:11 +0500
Message-ID: <bf54be870612150417y6ff7eb69r383cfaff455db22a@mail.gmail.com> (raw)
In-Reply-To: <45828ED6.9020501@proventis.net>
References: <45826AD7.7050005@proventis.net>
	<bf54be870612150319x90ea963hf2b0c3443139ad3e@mail.gmail.com>
	<45828ED6.9020501@proventis.net>

Looks like with 1.8 GB usage not much left for dump to get the required
chunk from memory. Not sure if that will help but try increasing the swap
space...

-------------
Shoaib Mir
EnterpriseDB (www.enterprisedb.com)

On 12/15/06, Thomas Markus <t.markus@proventis.net> wrote:
>
> Hi,
>
> logfile content see http://www.rafb.net/paste/results/cvD7uk33.html
> - cat /proc/sys/kernel/shmmax is 2013265920
> - ulimit is unlimited
> kernel is 2.6.15-1-em64t-p4-smp, pg version is 8.1.0 32bit
> postmaster process usage is 1.8gb ram atm
>
> thx
> Thomas
>
>
> Shoaib Mir schrieb:
> > Can you please show the dbserver logs and syslog at the same time when
> > it goes out of memory...
> >
> > Also how much is available RAM you have and the SHMMAX set?
> >
> > ------------
> > Shoaib Mir
> > EnterpriseDB ( www.enterprisedb.com <http://www.enterprisedb.com;)
> >
> > On 12/15/06, *Thomas Markus* <t.markus@proventis.net
> > <mailto:t.markus@proventis.net>> wrote:
> >
> >     Hi,
> >
> >     i'm running pg 8.1.0 on a debian linux (64bit) box (dual xeon 8gb
> ram)
> >     pg_dump creates an error when exporting a large table with blobs
> >     (largest blob is 180mb)
> >
> >     error is:
> >     pg_dump: ERROR:  out of memory
> >     DETAIL:  Failed on request of size 1073741823.
> >     pg_dump: SQL command to dump the contents of table "downloads"
> failed:
> >     PQendcopy() failed.
> >     pg_dump: Error message from server: ERROR:  out of memory
> >     DETAIL:  Failed on request of size 1073741823.
> >     pg_dump: The command was: COPY public.downloads ...  TO stdout;
> >
> >     if i try pg_dump with -d dump runs with all types (c,t,p), but i
> cant
> >     restore (out of memory error or corrupt tar header at ...)
> >
> >     how can i backup (and restore) such a db?
> >
> >     kr
> >     Thomas
> >
> >     ---------------------------(end of
> >     broadcast)---------------------------
> >     TIP 4: Have you searched our list archives?
> >
> >                    http://archives.postgresql.org
> >
> >
>
> --
> Thomas Markus
>
> Tel:    +49 30 29 36 399 - 22
> Fax:    +49 30 29 36 399 - 50
> Mail:   t.markus@proventis.net
> Web:    www.proventis.net
> Web:    www.blue-ant.de
>
> proventis GmbH
> Zimmerstraße 79-80
> 10117 Berlin
>
> "proventis: Wir bewegen Organisationen."
>
>
>
>
> ---------------------------(end of broadcast)---------------------------
> TIP 4: Have you searched our list archives?
>
>                http://archives.postgresql.org
>
>
>
>

view thread (10+ messages)  latest in thread

Message-ID: <bf54be870612150417y6ff7eb69r383cfaff455db22a@mail.gmail.com>
Permalink:  ../bf54be870612150417y6ff7eb69r383cfaff455db22a@mail.gmail.com/
Also on:    postgresql.org/message-id/bf54be870612150417y6ff7eb69r383cfaff455db22a@mail.gmail.com

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients from your mail client; the link fills in
  the headers below: reply via email
  Some clients, webmail especially, drop In-Reply-To and References from
  a link, and the reply then starts a new thread: use the mbox below.

  To: pgsql-admin@postgresql.org
  Cc: shoaibmir@gmail.com, t.markus@proventis.net
  Subject: Re: out of memory in backup and restore
  In-Reply-To: <bf54be870612150417y6ff7eb69r383cfaff455db22a@mail.gmail.com>
  References: <45826AD7.7050005@proventis.net> <bf54be870612150319x90ea963hf2b0c3443139ad3e@mail.gmail.com> <45828ED6.9020501@proventis.net> <bf54be870612150417y6ff7eb69r383cfaff455db22a@mail.gmail.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox