From: ktm@rice.edu <ktm@rice.edu>
To: girish R G peetle <giri.anamika0@gmail.com>
Cc: pgsql-admin <pgsql-admin@postgresql.org>
Subject: Re: PostgreSQL Dump rate is too slow
Date: Thu, 8 Jan 2015 07:45:29 -0600
Message-ID: <20150108134529.GE3783@aart.rice.edu> (raw)
In-Reply-To: <CAKKd0663fQtOFMv-hWUDXrFecxmjeUW-=2PtkmTjxnaX-VsRRQ@mail.gmail.com>
References: <CAKKd0663fQtOFMv-hWUDXrFecxmjeUW-=2PtkmTjxnaX-VsRRQ@mail.gmail.com>
List-Unsubscribe: <mailto:majordomo@postgresql.org?body=unsub%20pgsql-admin>
On Thu, Jan 08, 2015 at 11:05:54AM +0530, girish R G peetle wrote:
> Hi all,
> We have a customer who has 1TB database on a production server. They are
> trying dump based backup of this large database. Following dump command is
> being used.
> Dump rate is around 12 GB/hr, which will take lot of time for the backup to
> complete. This is affecting their production server.
> Is there is a way to increase dump data rate ?
>
> pg_dump -U <User> -Fc -b --port=<Port> '<Db-Name>'
>
>
> PostgreSQL version : 9.2.4
> Platform : Linux
>
> Thanks
> Girish
Hi Girish,
The custom format is compressed by default and your dump rate is hamstrung by
the slow compression algorithm being used. I our case for a smaller DB, turning
off compression completely (-Z 0) dropped our time to dump the DB from 6 hours
to about 20 minutes. You can push the uncompressed dump through a faster compression
engine using lzo, snappy or lz4 if you need to have compressed output due to space
limitations.
Regards,
Ken
--
Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-admin@postgresql.org
Cc: ktm@rice.edu, giri.anamika0@gmail.com
Subject: Re: PostgreSQL Dump rate is too slow
In-Reply-To: <20150108134529.GE3783@aart.rice.edu>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox