Received: from localhost (maia-4.hub.org [200.46.204.183]) by postgresql.org (Postfix) with ESMTP id 6B1759FA0FB for ; Fri, 15 Dec 2006 08:57:27 -0400 (AST) Received: from postgresql.org ([200.46.204.71]) by localhost (mx1.hub.org [200.46.204.183]) (amavisd-new, port 10024) with ESMTP id 17116-02 for ; Fri, 15 Dec 2006 08:57:18 -0400 (AST) X-Greylist: from auto-whitelisted by SQLgrey-1.7.4 Received: from p15105778.pureserver.info (p15105778.pureserver.info [217.160.133.184]) by postgresql.org (Postfix) with ESMTP id B4E6C9F9B05 for ; Fri, 15 Dec 2006 08:57:18 -0400 (AST) Received: by p15105778.pureserver.info (Postfix, from userid 65534) id 26674440D5; Fri, 15 Dec 2006 13:57:36 +0100 (CET) Received: from localhost (localhost [127.0.0.1]) by server1.proventis.net (Postfix) with ESMTP id 85F2DC44096 for ; Fri, 15 Dec 2006 13:53:12 +0100 (CET) Received: from server1.proventis.net ([127.0.0.1]) by localhost (server1.proventis.net [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 12049-03 for ; Fri, 15 Dec 2006 13:53:11 +0100 (CET) Received: from [192.168.22.130] (tmarkus.proventis.net [192.168.22.130]) by server1.proventis.net (Postfix) with ESMTP id E77A3C44094 for ; Fri, 15 Dec 2006 13:53:10 +0100 (CET) Message-ID: <45829AB6.7050800@proventis.net> Date: Fri, 15 Dec 2006 13:53:10 +0100 From: Thomas Markus Organization: proventis GmbH User-Agent: Thunderbird 1.5.0.8 (X11/20061025) MIME-Version: 1.0 To: pgsql-admin@postgresql.org Subject: Re: out of memory in backup and restore References: <45826AD7.7050005@proventis.net> <45828ED6.9020501@proventis.net> <45829417.3030109@proventis.net> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: by amavisd-new at proventis.net X-Virus-Scanned: Maia Mailguard 1.0.1 X-Archive-Number: 200612/219 X-Sequence-Number: 24011 df -h Filesystem Size Used Avail Use% Mounted on /dev/sda5 132G 99G 34G 75% / tmpfs 4.0G 0 4.0G 0% /dev/shm /dev/sda1 74M 16M 54M 23% /boot is there another dump tool that dumps blobs (or all) as binary content (not as insert statements, maybe directly dbblocks)? Marcelo Costa schrieb: > To decrease shared buffers you need restart your pgsql. > > If do you make on df -h command what is the result, please send. > > 2006/12/15, Thomas Markus < t.markus@proventis.net > >: > > Hi, > > free diskspace is 34gb (underlying xfs) (complete db dump is 9gb). > free > -tm says 6gb free ram and 6gb unused swap space. > can i decrease shared buffers without pg restart? > > thx > Thomas > > Shoaib Mir schrieb: > > Looks like with 1.8 GB usage not much left for dump to get the > > required chunk from memory. Not sure if that will help but try > > increasing the swap space... > > > > ------------- > > Shoaib Mir > > EnterpriseDB ( www.enterprisedb.com > ) > > > > On 12/15/06, *Thomas Markus* > > >> wrote: > > > > Hi, > > > > logfile content see > http://www.rafb.net/paste/results/cvD7uk33.html > > - cat /proc/sys/kernel/shmmax is 2013265920 > > - ulimit is unlimited > > kernel is 2.6.15-1-em64t-p4-smp, pg version is 8.1.0 32bit > > postmaster process usage is 1.8gb ram atm > > > > thx > > Thomas > > > > > > Shoaib Mir schrieb: > > > Can you please show the dbserver logs and syslog at the same > > time when > > > it goes out of memory... > > > > > > Also how much is available RAM you have and the SHMMAX set? > > > > > > ------------ > > > Shoaib Mir > > > EnterpriseDB ( www.enterprisedb.com > > > < http://www.enterprisedb.com> ) > > > > > > On 12/15/06, *Thomas Markus* < t.markus@proventis.net > > > > > > > > > >>> wrote: > > > > > > Hi, > > > > > > i'm running pg 8.1.0 on a debian linux (64bit) box (dual > > xeon 8gb ram) > > > pg_dump creates an error when exporting a large table with > > blobs > > > (largest blob is 180mb) > > > > > > error is: > > > pg_dump: ERROR: out of memory > > > DETAIL: Failed on request of size 1073741823. > > > pg_dump: SQL command to dump the contents of table > > "downloads" failed: > > > PQendcopy() failed. > > > pg_dump: Error message from server: ERROR: out of memory > > > DETAIL: Failed on request of size 1073741823. > > > pg_dump: The command was: COPY public.downloads > ... TO stdout; > > > > > > if i try pg_dump with -d dump runs with all types (c,t,p), > > but i cant > > > restore (out of memory error or corrupt tar header at > ...) > > > > > > how can i backup (and restore) such a db? > > > > > > kr > > > Thomas > > > > > > ---------------------------(end of > > > broadcast)--------------------------- > > > TIP 4: Have you searched our list archives? > > > > > > http://archives.postgresql.org > > > > > > > > > > > > > ---------------------------(end of > broadcast)--------------------------- > TIP 4: Have you searched our list archives? > > http://archives.postgresql.org > > > > > -- > Marcelo Costa