Received: from localhost (maia-2.hub.org [200.46.204.187]) by postgresql.org (Postfix) with ESMTP id B51889FA0EE for ; Fri, 15 Dec 2006 07:19:22 -0400 (AST) Received: from postgresql.org ([200.46.204.71]) by localhost (mx1.hub.org [200.46.204.187]) (amavisd-new, port 10024) with ESMTP id 89032-01 for ; Fri, 15 Dec 2006 07:19:08 -0400 (AST) X-Greylist: domain auto-whitelisted by SQLgrey-1.7.4 Received: from nz-out-0506.google.com (nz-out-0506.google.com [64.233.162.234]) by postgresql.org (Postfix) with ESMTP id CDEA39FA0B7 for ; Fri, 15 Dec 2006 07:19:17 -0400 (AST) Received: by nz-out-0506.google.com with SMTP id i11so393822nzh for ; Fri, 15 Dec 2006 03:19:16 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:references; b=V4f6HOZYwYxfKpXTyxQK0K/FS4ShnkmKaERdzdnqq/UG8OzTg9yJSYj1/65cH9ISLNoc5YDpLWuO4K71d6nT9tOzsAeqMuQxrGBGMnhjBVRNA/lZtUSXFwZnTmRpOsZn20Ha5erw24QUQIwxE8Q85colF5iH8n0bjbf/Berul8E= Received: by 10.65.193.16 with SMTP id v16mr1085737qbp.1166181556400; Fri, 15 Dec 2006 03:19:16 -0800 (PST) Received: by 10.65.206.17 with HTTP; Fri, 15 Dec 2006 03:19:16 -0800 (PST) Message-ID: Date: Fri, 15 Dec 2006 16:19:16 +0500 From: "Shoaib Mir" To: "Thomas Markus" Subject: Re: out of memory in backup and restore Cc: pgsql-admin@postgresql.org In-Reply-To: <45826AD7.7050005@proventis.net> MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_117153_31269572.1166181556330" References: <45826AD7.7050005@proventis.net> X-Virus-Scanned: Maia Mailguard 1.0.1 X-Archive-Number: 200612/209 X-Sequence-Number: 24001 ------=_Part_117153_31269572.1166181556330 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline Can you please show the dbserver logs and syslog at the same time when it goes out of memory... Also how much is available RAM you have and the SHMMAX set? ------------ Shoaib Mir EnterpriseDB (www.enterprisedb.com) On 12/15/06, Thomas Markus wrote: > > Hi, > > i'm running pg 8.1.0 on a debian linux (64bit) box (dual xeon 8gb ram) > pg_dump creates an error when exporting a large table with blobs > (largest blob is 180mb) > > error is: > pg_dump: ERROR: out of memory > DETAIL: Failed on request of size 1073741823. > pg_dump: SQL command to dump the contents of table "downloads" failed: > PQendcopy() failed. > pg_dump: Error message from server: ERROR: out of memory > DETAIL: Failed on request of size 1073741823. > pg_dump: The command was: COPY public.downloads ... TO stdout; > > if i try pg_dump with -d dump runs with all types (c,t,p), but i cant > restore (out of memory error or corrupt tar header at ...) > > how can i backup (and restore) such a db? > > kr > Thomas > > ---------------------------(end of broadcast)--------------------------- > TIP 4: Have you searched our list archives? > > http://archives.postgresql.org > ------=_Part_117153_31269572.1166181556330 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline Can you please show the dbserver logs and syslog at the same time when it goes out of memory...

Also how much is available RAM you have and the SHMMAX set?

------------
Shoaib Mir
EnterpriseDB ( www.enterprisedb.com)

On 12/15/06, Thomas Markus <t.markus@proventis.net> wrote:
Hi,

i'm running pg 8.1.0 on a debian linux (64bit) box (dual xeon 8gb ram)
pg_dump creates an error when exporting a large table with blobs
(largest blob is 180mb)

error is:
pg_dump: ERROR:  out of memory
DETAIL:  Failed on request of size 1073741823.
pg_dump: SQL command to dump the contents of table "downloads" failed:
PQendcopy() failed.
pg_dump: Error message from server: ERROR:  out of memory
DETAIL:  Failed on request of size 1073741823.
pg_dump: The command was: COPY public.downloads ...  TO stdout;

if i try pg_dump with -d dump runs with all types (c,t,p), but i cant
restore (out of memory error or corrupt tar header at ...)

how can i backup (and restore) such a db?

kr
Thomas

---------------------------(end of broadcast)---------------------------
TIP 4: Have you searched our list archives?

               http://archives.postgresql.org

------=_Part_117153_31269572.1166181556330--