pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Heikki Linnakangas <heikki@enterprisedb.com>
To: Jared Mauch <jared@puck.nether.net>
Cc: pgsql-performance@postgresql.org
Subject: Re: pg_dump performance
Date: Wed, 26 Dec 2007 22:52:08 +0200
Message-ID: <4772BEF8.2030509@enterprisedb.com> (raw)
In-Reply-To: <20071226202230.GA76524@puck.nether.net>
References: <20071226202230.GA76524@puck.nether.net>

Jared Mauch wrote:
> 	pg_dump is utilizing about 13% of the cpu and the
> corresponding postgres backend is at 100% cpu time.
> (multi-core, multi-cpu, lotsa ram, super-fast disk).
> ...
> 	Any tips on getting pg_dump (actually the backend) to perform 
> much closer to 500k/sec or more?  This would also aide me when I upgrade 
> pg versions and need to dump/restore with minimal downtime (as the data 
> never stops coming.. whee).

I would suggest running oprofile to see where the time is spent. There 
might be some simple optimizations that you could do at the source level 
that would help.

Where the time is spent depends a lot on the schema and data. For 
example, I profiled a pg_dump run on a benchmark database a while ago, 
and found that most of the time was spent in sprintf, formatting 
timestamp columns. If you have a lot of timestamp columns that might be 
the bottleneck for you as well, or something else.

Or if you can post the schema for the table you're dumping, maybe we can 
  make a more educated guess.

-- 
   Heikki Linnakangas
   EnterpriseDB   http://www.enterprisedb.com



view thread (10+ messages)  latest in thread

Message-ID: <4772BEF8.2030509@enterprisedb.com>
Permalink:  ../4772BEF8.2030509@enterprisedb.com/
Also on:    postgresql.org/message-id/4772BEF8.2030509@enterprisedb.com

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: heikki@enterprisedb.com, jared@puck.nether.net
  Subject: Re: pg_dump performance
  In-Reply-To: <4772BEF8.2030509@enterprisedb.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox