Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1YBoQW-00043S-D3 for pgsql-admin@arkaria.postgresql.org; Thu, 15 Jan 2015 17:41:48 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.80) (envelope-from ) id 1YBoQV-0000Hk-Q3 for pgsql-admin@arkaria.postgresql.org; Thu, 15 Jan 2015 17:41:47 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:DHE_RSA_AES_256_CBC_SHA256:256) (Exim 4.80) (envelope-from ) id 1YBoQU-0000Hd-NZ for pgsql-admin@postgresql.org; Thu, 15 Jan 2015 17:41:46 +0000 Received: from lists.commandprompt.com ([69.168.55.30]) by magus.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1YBoQL-0006q0-A0 for pgsql-admin@postgresql.org; Thu, 15 Jan 2015 17:41:45 +0000 Received: from [192.168.1.2] (spinlock.commandprompt.com [69.168.55.30]) by lists.commandprompt.com (Postfix) with ESMTPA id 9FF82F9; Thu, 15 Jan 2015 09:41:34 -0800 (PST) Received: from [192.168.1.2] ([67.168.169.165] helo=[192.168.1.2]) by assp.commandprompt.com with ESMTPS(AES128-SHA) (2.1.1); 15 Jan 2015 09:41:34 -0800 Message-ID: <54B7FBD9.7080404@commandprompt.com> Date: Thu, 15 Jan 2015 09:41:45 -0800 From: "Joshua D. Drake" Organization: Command Prompt, Inc. User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: girish R G peetle CC: Eduardo Morras , pgsql-admin Subject: Re: PostgreSQL Dump rate is too slow References: <20150114212058.de1c87d91a851db0bce1f1fa@yahoo.es> <54B6D972.8010304@commandprompt.com> In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-Assp-Version: 2.1.1(11364) on assp.commandprompt.com X-Assp-Client-SSL: yes X-Assp-ID: assp.commandprompt.com m1-43694-13448 X-Assp-Envelope-From: jd@commandprompt.com X-Assp-Intended-For: pgsql-admin@postgresql.org X-Assp-Original-Subject: Re: [ADMIN] PostgreSQL Dump rate is too slow X-Pg-Spam-Score: -1.9 (-) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-admin Precedence: bulk Sender: pgsql-admin-owner@postgresql.org On 01/15/2015 09:21 AM, girish R G peetle wrote: > Hi all, > We tried pg_dump with compression level set to zero on 1TB database. > Dump data rate started with 250GB/hr and gradually dropped to 30 GB/hr > with 2 hours time span. We might see this behavior on standby server > too, which will be undesirable. > > Any explanation on why we see this behavior ? Because you have a long running transaction that is causing bloat to pile up. Using pg_dump on a production database that size is a non-starter. You need a warm/hot standby or snapshot to do this properly. JD -- Command Prompt, Inc. - http://www.commandprompt.com/ 503-667-4564 PostgreSQL Support, Training, Professional Services and Development High Availability, Oracle Conversion, @cmdpromptinc "If we send our children to Caesar for their education, we should not be surprised when they come back as Romans." -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin