Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1Vb8vk-0005md-Kq for pgsql-admin@arkaria.postgresql.org; Tue, 29 Oct 2013 13:01:56 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.80) (envelope-from ) id 1Vb8vj-0006bN-Qa for pgsql-admin@arkaria.postgresql.org; Tue, 29 Oct 2013 13:01:55 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1Vb8vj-0006bF-2c for pgsql-admin@postgresql.org; Tue, 29 Oct 2013 13:01:55 +0000 Received: from mail.iqbuzz.ru ([95.163.96.206]) by magus.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1Vb8vb-0001Uv-Nn for pgsql-admin@postgresql.org; Tue, 29 Oct 2013 13:01:54 +0000 Received: from [172.16.8.64] (unknown [85.158.95.4]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) (Authenticated sender: klochkov@iqbuzz.ru) by mail.iqbuzz.ru (Postfix) with ESMTPSA id 552DEC01EE; Tue, 29 Oct 2013 17:01:45 +0400 (MSK) Message-ID: <526FB1B8.6080305@iqbuzz.ru> Date: Tue, 29 Oct 2013 17:01:44 +0400 From: Sergey Klochkov User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/20130510 Thunderbird/17.0.6 MIME-Version: 1.0 To: pgsql-admin@postgresql.org, pw@researchresearch.com Subject: Re: pg_dump being killed by oom killer References: In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Pg-Spam-Score: -2.4 (--) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-admin Precedence: bulk Sender: pgsql-admin-owner@postgresql.org Hello Paul, Recently I've run into similar issue, see my message to this mailing list sent on October 1st, 2013. It happens if there is a large enough amount of rows in pg_largeobject of the relevant database. pg_dump loads metadata (owner, access rights, etc) of each large object deparately until it is out of memory. How many large objects are in your DB? Hope this helps. 29.10.2013 16:17, Paul Warren пишет: > Hi, > > I'm to the lists so bare with me please. > > I have a vm running debian 6 with linux kernel 2.6.32-11-pve, when i run > pg_dump -Fc -U postgres db name > db name.dump > > after so long the process is killed, when I look in the > /var/log/kern.log i see the following entry > Oct 29 12:07:14 www1 kernel: OOM killed process 0 (pg_dump) > vm:5269904kB, rss:5210224kB, swap:0kB > > > The vm has 16 cpu's and is using around 10%, when I run pg_dump it goes > up by 3 / 5 % so not using alot of cpu usage. IT has 30gb of ram and 1gb > of swap, the system uses around 2mb of swap and 15gb of ram, when > pg_dump runs the swap doesn't move but the ram goes up by 3 / 4 gb > before the process is killed. > > The machine had only 20gb of ram so I've increased the ram usage and > still get the same issue. if I run pg_dump on any other db it works > fine, if we run a pg_dump script by table on the failing database it > works fine. > > The backup is going directly to a nas device which has 1.2 tb free. The > vm has aroudn 40gb free as well. > > Any ideas what this could be? it seems to be a memory issue but I can't > seem to see what / why it's happening. > > oh the DB is around 1.5 gb / 2gb in size > > > Thanks > Paul -- Best regards, Klochkov Sergey www.iqbuzz.ru -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin