Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1YBV5O-0000UX-PN for pgsql-admin@arkaria.postgresql.org; Wed, 14 Jan 2015 21:02:42 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.80) (envelope-from ) id 1YBV5O-000307-8N for pgsql-admin@arkaria.postgresql.org; Wed, 14 Jan 2015 21:02:42 +0000 Received: from makus.postgresql.org ([2001:4800:1501:1::229]) by malur.postgresql.org with esmtps (TLS1.2:DHE_RSA_AES_256_CBC_SHA256:256) (Exim 4.80) (envelope-from ) id 1YBV5M-0002wY-HW for pgsql-admin@postgresql.org; Wed, 14 Jan 2015 21:02:40 +0000 Received: from lists.commandprompt.com ([69.168.55.30]) by makus.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1YBV5H-0000t2-G0 for pgsql-admin@postgresql.org; Wed, 14 Jan 2015 21:02:38 +0000 Received: from [192.168.1.2] (spinlock.commandprompt.com [69.168.55.30]) by lists.commandprompt.com (Postfix) with ESMTPA id 9EB59B3; Wed, 14 Jan 2015 13:02:32 -0800 (PST) Received: from [192.168.1.2] ([67.168.169.165] helo=[192.168.1.2]) by assp.commandprompt.com with ESMTPS(AES128-SHA) (2.1.1); 14 Jan 2015 13:02:32 -0800 Message-ID: <54B6D972.8010304@commandprompt.com> Date: Wed, 14 Jan 2015 13:02:42 -0800 From: "Joshua D. Drake" Organization: Command Prompt, Inc. User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: Eduardo Morras , pgsql-admin@postgresql.org Subject: Re: PostgreSQL Dump rate is too slow References: <20150114212058.de1c87d91a851db0bce1f1fa@yahoo.es> In-Reply-To: <20150114212058.de1c87d91a851db0bce1f1fa@yahoo.es> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Assp-Version: 2.1.1(11364) on assp.commandprompt.com X-Assp-Client-SSL: yes X-Assp-ID: assp.commandprompt.com m1-69352-01250 X-Assp-Envelope-From: jd@commandprompt.com X-Assp-Intended-For: pgsql-admin@postgresql.org X-Assp-Original-Subject: Re: [ADMIN] PostgreSQL Dump rate is too slow X-Pg-Spam-Score: -1.9 (-) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-admin Precedence: bulk Sender: pgsql-admin-owner@postgresql.org On 01/14/2015 12:20 PM, Eduardo Morras wrote: > > On Thu, 8 Jan 2015 11:05:54 +0530 > girish R G peetle wrote: > >> Hi all, >> We have a customer who has 1TB database on a production server. They >> are trying dump based backup of this large database. Following dump >> command is being used. >> Dump rate is around 12 GB/hr, which will take lot of time for the >> backup to complete. This is affecting their production server. >> Is there is a way to increase dump data rate ? >> >> pg_dump -U -Fc -b --port= '' >> > > Do not use pg_dump compression, pipe output to xz > > % pg_dump -U -Fc -b --port= '' | xz -3 dump.xz > > or pipe xz output to other program. > > When I looked for the same problem in 8.3-8.4 versions, the bottleneck was in accessing TOAST tables, it's content was decompressed, dumped and recompressed again, don't know if it has changed in current versions. Don't do this. You are still looking at an extremely slow dump. Instead set up a warm or hot standby or use pg_basebackup. JD -- Command Prompt, Inc. - http://www.commandprompt.com/ 503-667-4564 PostgreSQL Support, Training, Professional Services and Development High Availability, Oracle Conversion, @cmdpromptinc "If we send our children to Caesar for their education, we should not be surprised when they come back as Romans." -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin