Received: from maia.hub.org (maia-5.hub.org [200.46.204.29]) by mail.postgresql.org (Postfix) with ESMTP id 48711B5DBC1 for ; Fri, 1 Jul 2011 16:30:00 -0300 (ADT) Received: from mail.postgresql.org ([200.46.204.86]) by maia.hub.org (mx1.hub.org [200.46.204.29]) (amavisd-maia, port 10024) with ESMTP id 95764-09 for ; Fri, 1 Jul 2011 19:29:54 +0000 (UTC) X-Greylist: domain auto-whitelisted by SQLgrey-1.7.6 Received: from nm25.bullet.mail.ac4.yahoo.com (nm25.bullet.mail.ac4.yahoo.com [98.139.52.222]) by mail.postgresql.org (Postfix) with SMTP id E8B9DB5DBE5 for ; Fri, 1 Jul 2011 16:29:53 -0300 (ADT) Received: from [98.139.52.188] by nm25.bullet.mail.ac4.yahoo.com with NNFMP; 01 Jul 2011 19:29:53 -0000 Received: from [98.139.52.163] by tm1.bullet.mail.ac4.yahoo.com with NNFMP; 01 Jul 2011 19:29:53 -0000 Received: from [127.0.0.1] by omp1046.mail.ac4.yahoo.com with NNFMP; 01 Jul 2011 19:29:53 -0000 X-Yahoo-Newman-Property: ymail-3 X-Yahoo-Newman-Id: 172732.10412.bm@omp1046.mail.ac4.yahoo.com Received: (qmail 22919 invoked by uid 60001); 1 Jul 2011 19:29:52 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1309548592; bh=bBCLLpnCJmgcqEjlQrM4A4771Cljzu+SU9j8v4T+bws=; h=X-YMail-OSG:Received:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:Cc:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=ygZroReGo36iPeWH29QKaRU+M3y3uN+uC4AlhNd207en3GWZIPNs0mK+IfMd7+NjEcWYk6Ns2+iElkvtCNmpfOFBdY+Q+1+fOV2aLyfctJmA1pDUHJFkKLonkhya2G21l2kzvtdCiO6oBurf9qA5Ef/ZxDw9zR4AaGO4OqV6Ixg= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=X-YMail-OSG:Received:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:Cc:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=FPGxF5p/uvsJJ6fv3qrNv5rZ/iKhd7HaqMgUrVYT9nT4taEcSOo4ziRdbZtx6NK1mFvOknyRtddo9Ia3uJSInRC+QEWFhGuVSeTU5BS//ML8p41HCdag9ghto/mjGCxqBtibEcfdG2yJm81InNXwnhV5T5TarctcEGK8VnCKnuA=; X-YMail-OSG: TyJPX.4VM1nlzkvnMzLRfYp.pji4BHHpfkQsJVno50r4lun GugzPPCkY_QWjP4kf1PBZeCoLZFvb3YMOdJYUKF7pOiYXQORAxZFcH2jAClf .0lvrkMYD7jF73mvb8YBnzPusflGxYpdqYxZ_YffELGsIafAXR1Mx8ffFtKB oOR0VQZK.uVpJbEQkcFC9ntp1xZFktLOtdybScXdg6rYvYynquflCKZpq6.3 6G7zpBd5rk7ayMVmGJGVPEo0RHxbanzx94KWLEWQPL7yylVH.crotR6uaBL3 WKtA_gJOa8vGbyfqCn3gdbqgB6d.QE0aAyUK.kt6g0_EhKJX4JV9XKRFvZyJ xo7qJ13MwVzf0Sok6zh1SFMpWG8CBRlTkBB7Rt1Lcd5vohla7NWh7rtYZa7Z uHM.n1RIzwUD8 Received: from [64.126.29.122] by web39706.mail.mud.yahoo.com via HTTP; Fri, 01 Jul 2011 12:29:52 PDT X-Mailer: YahooMailWebService/0.8.112.307740 References: <877182.59904.qm@web39704.mail.mud.yahoo.com> <2813.1309547390@sss.pgh.pa.us> Message-ID: <1309548592.2550.YahooMailNeo@web39706.mail.mud.yahoo.com> Date: Fri, 1 Jul 2011 12:29:52 -0700 (PDT) From: Bob Lunney Reply-To: Bob Lunney Subject: Re: Parallel pg_dump on a single database To: Tom Lane Cc: "pgsql-admin@postgresql.org" In-Reply-To: <2813.1309547390@sss.pgh.pa.us> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable X-Virus-Scanned: Maia Mailguard 1.0.1 X-Spam-Status: No, hits=-1.909 tagged_above=-10 required=5 tests=BAYES_00=-1.9, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_NONE=-0.0001, T_RP_MATCHES_RCVD=-0.01 X-Spam-Level: X-Archive-Number: 201107/11 X-Sequence-Number: 37790 Tom,=0A=0AThanks for the response, but I figured out the error is mine, not= pg_dump's. =A0In short (to minimize my embarrassment!) don't write to the = same file from three different pg_dumps.=A0=0A=0AThe good news is running m= ultiple pg_dumps simultaneously on a single database with exclusive coverag= e of different table sets works great, and my overall dump times have been = reduced to one-fifth the time it takes to run a single pg_dump. =A0=0A=0ABT= W, I'm using PG 8.4.1, going to 8.4.8 soon, and its working great. =A0Thank= s to all for the excellent database software.=0A=0A=0ARegards,=0A=0ABob Lun= ney=0A=0A________________________________=0AFrom: Tom Lane =0ATo: Bob Lunney =0ACc: "pgsql-admin@postgresql.o= rg" =0ASent: Friday, July 1, 2011 2:09 PM=0ASub= ject: Re: [ADMIN] Parallel pg_dump on a single database =0A=0ABob Lunney writes:=0A> Is it possible (or smart!) to run multiple= pg_dumps simulataneously on a single database, dumping different parts of = the database to different files by using table and schema exclusion?=A0 I'm= attempting this and sometimes it works and sometimes when I check the dump= files with =0A>=A0=A0=A0pg_restore -Fc > /dev/null=0A=0A> I get= =0A=0A>=A0=A0=A0pg_restore: [custom archiver] found unexpected block ID (4= ) when reading data -- expected 4238=0A=0AThat sure sounds like a bug.=A0 W= hat PG version are you using exactly?=0ACan you provide a more specific des= cription of what you're doing,=0Aso somebody else could reproduce this?=0A= =0A=A0=A0=A0 =A0=A0=A0 =A0=A0=A0 regards, tom lane