Received: from localhost (maia-5.hub.org [200.46.204.182]) by postgresql.org (Postfix) with ESMTP id 9937C9FA274 for ; Fri, 15 Dec 2006 08:10:06 -0400 (AST) Received: from postgresql.org ([200.46.204.71]) by localhost (mx1.hub.org [200.46.204.182]) (amavisd-new, port 10024) with ESMTP id 24290-04 for ; Fri, 15 Dec 2006 08:09:49 -0400 (AST) X-Greylist: domain auto-whitelisted by SQLgrey-1.7.4 Received: from ug-out-1314.google.com (ug-out-1314.google.com [66.249.92.168]) by postgresql.org (Postfix) with ESMTP id C32F59FA0B7 for ; Fri, 15 Dec 2006 08:09:52 -0400 (AST) Received: by ug-out-1314.google.com with SMTP id k3so794800ugf for ; Fri, 15 Dec 2006 04:09:51 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:references; b=uh1a01KP8ad/eSucP4yXGmvDvbr1TLnusqrKqGUtp1iEUfVksj95Jlotu12gGBQsBkaoJ57Q7FFyW9BQN4wgpEUL80cskilx8HtzwKLSEqrzfjRx11jGKq06AjhaR5kIfQjuftmplEW2LUaDHOwgGfw348UYyNpSCXhOmMtoRQo= Received: by 10.66.243.4 with SMTP id q4mr828615ugh.1166184590322; Fri, 15 Dec 2006 04:09:50 -0800 (PST) Received: by 10.66.252.11 with HTTP; Fri, 15 Dec 2006 04:09:50 -0800 (PST) Message-ID: Date: Fri, 15 Dec 2006 09:09:50 -0300 From: "Marcelo Costa" To: "Thomas Markus" Subject: Re: out of memory in backup and restore Cc: pgsql-admin@postgresql.org In-Reply-To: <45828ED6.9020501@proventis.net> MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_198065_16064772.1166184590239" References: <45826AD7.7050005@proventis.net> <45828ED6.9020501@proventis.net> X-Virus-Scanned: Maia Mailguard 1.0.1 X-Archive-Number: 200612/211 X-Sequence-Number: 24003 ------=_Part_198065_16064772.1166184590239 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: quoted-printable Content-Disposition: inline Try see your /tmp directory on your server, this maybe can for an left spac= e on your system disk. [],s Marcelo. 2006/12/15, Thomas Markus : > > Hi, > > logfile content see http://www.rafb.net/paste/results/cvD7uk33.html > - cat /proc/sys/kernel/shmmax is 2013265920 > - ulimit is unlimited > kernel is 2.6.15-1-em64t-p4-smp, pg version is 8.1.0 32bit > postmaster process usage is 1.8gb ram atm > > thx > Thomas > > > Shoaib Mir schrieb: > > Can you please show the dbserver logs and syslog at the same time when > > it goes out of memory... > > > > Also how much is available RAM you have and the SHMMAX set? > > > > ------------ > > Shoaib Mir > > EnterpriseDB ( www.enterprisedb.com ) > > > > On 12/15/06, *Thomas Markus* > > wrote: > > > > Hi, > > > > i'm running pg 8.1.0 on a debian linux (64bit) box (dual xeon 8gb > ram) > > pg_dump creates an error when exporting a large table with blobs > > (largest blob is 180mb) > > > > error is: > > pg_dump: ERROR: out of memory > > DETAIL: Failed on request of size 1073741823. > > pg_dump: SQL command to dump the contents of table "downloads" > failed: > > PQendcopy() failed. > > pg_dump: Error message from server: ERROR: out of memory > > DETAIL: Failed on request of size 1073741823. > > pg_dump: The command was: COPY public.downloads ... TO stdout; > > > > if i try pg_dump with -d dump runs with all types (c,t,p), but i > cant > > restore (out of memory error or corrupt tar header at ...) > > > > how can i backup (and restore) such a db? > > > > kr > > Thomas > > > > ---------------------------(end of > > broadcast)--------------------------- > > TIP 4: Have you searched our list archives? > > > > http://archives.postgresql.org > > > > > > -- > Thomas Markus > > Tel: +49 30 29 36 399 - 22 > Fax: +49 30 29 36 399 - 50 > Mail: t.markus@proventis.net > Web: www.proventis.net > Web: www.blue-ant.de > > proventis GmbH > Zimmerstra=DFe 79-80 > 10117 Berlin > > "proventis: Wir bewegen Organisationen." > > > > > ---------------------------(end of broadcast)--------------------------- > TIP 4: Have you searched our list archives? > > http://archives.postgresql.org > > > > --=20 Marcelo Costa ------=_Part_198065_16064772.1166184590239 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline Try see your /tmp directory on your server, this maybe can for an left spac= e on your system disk.

[],s

Marcelo.

2006/12/15, Thomas Markus < t.markus@proventis.net>:
Hi,

logfile content see http://www.rafb.net/paste/results/cvD7uk33.html
- cat /proc/sys/kern= el/shmmax is 2013265920
- ulimit is unlimited
kernel is 2.6.15-1-em64= t-p4-smp, pg version is 8.1.0 32bit
postmaster process usage is 1.8gb ram atm

thx
Thomas


Shoaib Mir schrieb:
> Can yo= u please show the dbserver logs and syslog at the same time when
> it= goes out of memory...
>
> Also how much is available RAM you h= ave and the SHMMAX set?
>
> ------------
> Shoaib Mir
> EnterpriseDB ( www.enterprisedb.com <http://www.enterprisedb.com>)
&g= t;
> On 12/15/06, *Thomas Markus* <t.markus@proventis.net
> <mailto:t.markus@proventis.net>> wrote:
>
>     Hi,
>
>     i'= m running pg 8.1.0 on a debian linux (64bit) box (dual xeon 8gb ram)
>= ;     pg_dump creates an error when exporting a large t= able with blobs
>     (largest blob is 180mb)
= >
>     error is:
>     = pg_dump: ERROR:  out of memory
>     DE= TAIL:  Failed on request of size 1073741823.
>  &= nbsp;  pg_dump: SQL command to dump the contents of table "downlo= ads" failed:
>     PQendcopy() failed.
>   &= nbsp; pg_dump: Error message from server: ERROR:  out of memory>     DETAIL:  Failed on request of size= 1073741823.
>     pg_dump: The command was: COPY= public.downloads ...  TO stdout;
>
>     if i try pg_dump with -d dump runs= with all types (c,t,p), but i cant
>     restore= (out of memory error or corrupt tar header at ...)
>
> &n= bsp;   how can i backup (and restore) such a db?
>
>     kr
>    = Thomas
>
>     ---------------------------= (end of
>     broadcast)-------------------------= --
>     TIP 4: Have you searched our list archiv= es?
>
>         &n= bsp;           http://archives.postgresql.org
>
>

--
Thomas Markus

Tel:   =  +49 30 29 36 399 - 22
Fax:    +49 30 29 36 399= - 50
Mail:  
t.markus@proventis.net
Web:    www.proventis.net
Web:    www.blue-ant.de

proventis GmbH<= br>Zimmerstra=DFe 79-80
10117 Berlin

"proventis: Wir bewegen Organisationen."




-= --------------------------(end of broadcast)---------------------------
= TIP 4: Have you searched our list archives?

    =            http://archives.postgresql.org





--
Marcelo Costa ------=_Part_198065_16064772.1166184590239--