pg.ddx.io pgsql-performance@postgresql.org mailing list archive
help / color / mirror / Atom feedpg_basebackup running slow
4+ messages / 4 participants
[nested] [flat]
* pg_basebackup running slow
@ 2016-10-14 12:35 Swapnil Vaze <swapvaze28@gmail.com>
2016-10-14 13:21 ` Re: pg_basebackup running slow Samir Magar <samirmagar8@gmail.com>
2016-10-14 13:37 ` Re: pg_basebackup running slow Stephen Frost <sfrost@snowman.net>
0 siblings, 2 replies; 4+ messages in thread
From: Swapnil Vaze @ 2016-10-14 12:35 UTC (permalink / raw)
To: pgsql-performance
Hello,
We are using postgresql 9.2 on redhat linux instance over openstack cloud.
Database is around 441 GB.
We are using below command to take backup:
pg_basebackup -v -D /pgbackup/$bkupdir -Ft -z -c fast
Backup size created is around 84GB.
However, it is taking almost 10 hr 21 minutes to complete.
Looking for speed improvement?
Thanks& Regards,
Vaze Swapnil
^ permalink raw reply [nested|flat] 4+ messages in thread
* Re: pg_basebackup running slow
2016-10-14 12:35 pg_basebackup running slow Swapnil Vaze <swapvaze28@gmail.com>
@ 2016-10-14 13:21 ` Samir Magar <samirmagar8@gmail.com>
2016-10-14 13:37 ` Re: pg_basebackup running slow Michael Paquier <michael.paquier@gmail.com>
1 sibling, 1 reply; 4+ messages in thread
From: Samir Magar @ 2016-10-14 13:21 UTC (permalink / raw)
To: Swapnil Vaze <swapvaze28@gmail.com>; +Cc: pgsql-performance
What is the settings for max_wal_sender?
you can try increasing this parameter to improve backup performance.
Thanks,
Samir Magar
On Fri, Oct 14, 2016 at 6:05 PM, Swapnil Vaze <swapvaze28@gmail.com> wrote:
> Hello,
>
>
>
> We are using postgresql 9.2 on redhat linux instance over openstack cloud.
>
>
>
> Database is around 441 GB.
>
>
>
> We are using below command to take backup:
>
>
>
> pg_basebackup -v -D /pgbackup/$bkupdir -Ft -z -c fast
>
>
>
> Backup size created is around 84GB.
>
>
>
> However, it is taking almost 10 hr 21 minutes to complete.
>
>
>
> Looking for speed improvement?
>
>
>
> Thanks& Regards,
>
> Vaze Swapnil
>
^ permalink raw reply [nested|flat] 4+ messages in thread
* Re: pg_basebackup running slow
2016-10-14 12:35 pg_basebackup running slow Swapnil Vaze <swapvaze28@gmail.com>
2016-10-14 13:21 ` Re: pg_basebackup running slow Samir Magar <samirmagar8@gmail.com>
@ 2016-10-14 13:37 ` Michael Paquier <michael.paquier@gmail.com>
0 siblings, 0 replies; 4+ messages in thread
From: Michael Paquier @ 2016-10-14 13:37 UTC (permalink / raw)
To: Samir Magar <samirmagar8@gmail.com>; +Cc: Swapnil Vaze <swapvaze28@gmail.com>; pgsql-performance
On Fri, Oct 14, 2016 at 10:21 PM, Samir Magar <samirmagar8@gmail.com> wrote:
> What is the settings for max_wal_sender?
> you can try increasing this parameter to improve backup performance.
max_wal_senders has no influence on the performance of a base backup
taken as a base backup is just sent through one single WAL sender
process. What matters here is the network bandwidth.
--
Michael
--
Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-performance
^ permalink raw reply [nested|flat] 4+ messages in thread
* Re: pg_basebackup running slow
2016-10-14 12:35 pg_basebackup running slow Swapnil Vaze <swapvaze28@gmail.com>
@ 2016-10-14 13:37 ` Stephen Frost <sfrost@snowman.net>
1 sibling, 0 replies; 4+ messages in thread
From: Stephen Frost @ 2016-10-14 13:37 UTC (permalink / raw)
To: Swapnil Vaze <swapvaze28@gmail.com>; +Cc: pgsql-performance
Vaze,
* Swapnil Vaze (swapvaze28@gmail.com) wrote:
> We are using postgresql 9.2 on redhat linux instance over openstack cloud.
>
> Database is around 441 GB.
>
> We are using below command to take backup:
>
> pg_basebackup -v -D /pgbackup/$bkupdir -Ft -z -c fast
>
> Backup size created is around 84GB.
>
> However, it is taking almost 10 hr 21 minutes to complete.
>
> Looking for speed improvement?
pg_basebackup is single-threaded and the compression is pretty
CPU-intensive. You could try reducing the compression level, but that
will make the backups larger, of course. Also, there's a limit to how
far that will get you- once you get to "no compression", that's just as
fast as pg_basebackup can run.
If you're interested in a backup tool which can operate in parallel, you
might want to look at pgbackrest.
Thanks!
Stephen
Attachments:
signature.asc (application/pgp-signature, 818B) download
^ permalink raw reply [nested|flat] 4+ messages in thread
end of thread, other threads:[~2016-10-14 13:37 UTC | newest]
Thread overview: 4+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2016-10-14 12:35 pg_basebackup running slow Swapnil Vaze <swapvaze28@gmail.com>
2016-10-14 13:21 ` Samir Magar <samirmagar8@gmail.com>
2016-10-14 13:37 ` Michael Paquier <michael.paquier@gmail.com>
2016-10-14 13:37 ` Stephen Frost <sfrost@snowman.net>
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox