pg.ddx.io  pgsql-admin@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Bob Lunney <bob_lunney@yahoo.com>
To: Tom Lane <tgl@sss.pgh.pa.us>
Cc: pgsql-admin@postgresql.org <pgsql-admin@postgresql.org>
Subject: Re: Parallel pg_dump on a single database
Date: Fri, 1 Jul 2011 12:29:52 -0700 (PDT)
Message-ID: <1309548592.2550.YahooMailNeo@web39706.mail.mud.yahoo.com> (raw)
In-Reply-To: <2813.1309547390@sss.pgh.pa.us>
References: <877182.59904.qm@web39704.mail.mud.yahoo.com>
	<2813.1309547390@sss.pgh.pa.us>

Tom,

Thanks for the response, but I figured out the error is mine, not pg_dump's.  In short (to minimize my embarrassment!) don't write to the same file from three different pg_dumps. 

The good news is running multiple pg_dumps simultaneously on a single database with exclusive coverage of different table sets works great, and my overall dump times have been reduced to one-fifth the time it takes to run a single pg_dump.  

BTW, I'm using PG 8.4.1, going to 8.4.8 soon, and its working great.  Thanks to all for the excellent database software.


Regards,

Bob Lunney

________________________________
From: Tom Lane <tgl@sss.pgh.pa.us>
To: Bob Lunney <bob_lunney@yahoo.com>
Cc: "pgsql-admin@postgresql.org" <pgsql-admin@postgresql.org>
Sent: Friday, July 1, 2011 2:09 PM
Subject: Re: [ADMIN] Parallel pg_dump on a single database 

Bob Lunney <bob_lunney@yahoo.com> writes:
> Is it possible (or smart!) to run multiple pg_dumps simulataneously on a single database, dumping different parts of the database to different files by using table and schema exclusion?  I'm attempting this and sometimes it works and sometimes when I check the dump files with 
>   pg_restore -Fc <dumpfile> > /dev/null

> I get 

>   pg_restore: [custom archiver] found unexpected block ID (4) when reading data -- expected 4238

That sure sounds like a bug.  What PG version are you using exactly?
Can you provide a more specific description of what you're doing,
so somebody else could reproduce this?

            regards, tom lane



view thread (3+ messages)

Message-ID: <1309548592.2550.YahooMailNeo@web39706.mail.mud.yahoo.com>
Permalink:  ../1309548592.2550.YahooMailNeo@web39706.mail.mud.yahoo.com/
Also on:    postgresql.org/message-id/1309548592.2550.YahooMailNeo@web39706.mail.mud.yahoo.com

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-admin@postgresql.org
  Cc: bob_lunney@yahoo.com, tgl@sss.pgh.pa.us
  Subject: Re: Parallel pg_dump on a single database
  In-Reply-To: <1309548592.2550.YahooMailNeo@web39706.mail.mud.yahoo.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox