pg.ddx.io pgsql-admin@postgresql.org mailing list archivehelp / color / mirror / Atom feed
Parallel pg_dump on a single database 3+ messages / 2 participants [nested] [flat]
* Parallel pg_dump on a single database @ 2011-06-24 21:21 Bob Lunney <bob_lunney@yahoo.com> 2011-07-01 19:09 ` Re: Parallel pg_dump on a single database Tom Lane <tgl@sss.pgh.pa.us> 0 siblings, 1 reply; 3+ messages in thread From: Bob Lunney @ 2011-06-24 21:21 UTC (permalink / raw) To: pgsql-admin Is it possible (or smart!) to run multiple pg_dumps simulataneously on a single database, dumping different parts of the database to different files by using table and schema exclusion? I'm attempting this and sometimes it works and sometimes when I check the dump files with pg_restore -Fc <dumpfile> > /dev/null I get pg_restore: [custom archiver] found unexpected block ID (4) when reading data -- expected 4238 I suspect that locks are colliding sometimes and not others, but I'm not sure. Little help? Thanks in advance, Bob Lunney ^ permalink raw reply [nested|flat] 3+ messages in thread
* Re: Parallel pg_dump on a single database 2011-06-24 21:21 Parallel pg_dump on a single database Bob Lunney <bob_lunney@yahoo.com> @ 2011-07-01 19:09 ` Tom Lane <tgl@sss.pgh.pa.us> 2011-07-01 19:29 ` Re: Parallel pg_dump on a single database Bob Lunney <bob_lunney@yahoo.com> 0 siblings, 1 reply; 3+ messages in thread From: Tom Lane @ 2011-07-01 19:09 UTC (permalink / raw) To: Bob Lunney <bob_lunney@yahoo.com>; +Cc: pgsql-admin Bob Lunney <bob_lunney@yahoo.com> writes: > Is it possible (or smart!) to run multiple pg_dumps simulataneously on a single database, dumping different parts of the database to different files by using table and schema exclusion? I'm attempting this and sometimes it works and sometimes when I check the dump files with > pg_restore -Fc <dumpfile> > /dev/null > I get > pg_restore: [custom archiver] found unexpected block ID (4) when reading data -- expected 4238 That sure sounds like a bug. What PG version are you using exactly? Can you provide a more specific description of what you're doing, so somebody else could reproduce this? regards, tom lane ^ permalink raw reply [nested|flat] 3+ messages in thread
* Re: Parallel pg_dump on a single database 2011-06-24 21:21 Parallel pg_dump on a single database Bob Lunney <bob_lunney@yahoo.com> 2011-07-01 19:09 ` Re: Parallel pg_dump on a single database Tom Lane <tgl@sss.pgh.pa.us> @ 2011-07-01 19:29 ` Bob Lunney <bob_lunney@yahoo.com> 0 siblings, 0 replies; 3+ messages in thread From: Bob Lunney @ 2011-07-01 19:29 UTC (permalink / raw) To: Tom Lane <tgl@sss.pgh.pa.us>; +Cc: pgsql-admin Tom, Thanks for the response, but I figured out the error is mine, not pg_dump's. In short (to minimize my embarrassment!) don't write to the same file from three different pg_dumps. The good news is running multiple pg_dumps simultaneously on a single database with exclusive coverage of different table sets works great, and my overall dump times have been reduced to one-fifth the time it takes to run a single pg_dump. BTW, I'm using PG 8.4.1, going to 8.4.8 soon, and its working great. Thanks to all for the excellent database software. Regards, Bob Lunney ________________________________ From: Tom Lane <tgl@sss.pgh.pa.us> To: Bob Lunney <bob_lunney@yahoo.com> Cc: "pgsql-admin@postgresql.org" <pgsql-admin@postgresql.org> Sent: Friday, July 1, 2011 2:09 PM Subject: Re: [ADMIN] Parallel pg_dump on a single database Bob Lunney <bob_lunney@yahoo.com> writes: > Is it possible (or smart!) to run multiple pg_dumps simulataneously on a single database, dumping different parts of the database to different files by using table and schema exclusion? I'm attempting this and sometimes it works and sometimes when I check the dump files with > pg_restore -Fc <dumpfile> > /dev/null > I get > pg_restore: [custom archiver] found unexpected block ID (4) when reading data -- expected 4238 That sure sounds like a bug. What PG version are you using exactly? Can you provide a more specific description of what you're doing, so somebody else could reproduce this? regards, tom lane ^ permalink raw reply [nested|flat] 3+ messages in thread
end of thread, other threads:[~2011-07-01 19:29 UTC | newest] Thread overview: 3+ messages (download: mbox mbox.gz follow: Atom feed) -- links below jump to the message on this page -- 2011-06-24 21:21 Parallel pg_dump on a single database Bob Lunney <bob_lunney@yahoo.com> 2011-07-01 19:09 ` Tom Lane <tgl@sss.pgh.pa.us> 2011-07-01 19:29 ` Bob Lunney <bob_lunney@yahoo.com>
This inbox is served by DDX for PostgreSQL; see mirroring instructions for how to clone and mirror all data and code used for this inbox