Received: from localhost (unknown [200.46.204.183])
	by postgresql.org (Postfix) with ESMTP id B22F7650A88
	for <pgsql-patches-postgresql.org@postgresql.org>;
	Sun, 27 Jul 2008 20:03:53 -0300 (ADT)
Received: from postgresql.org ([200.46.204.86])
	by localhost (mx1.hub.org [200.46.204.183]) (amavisd-maia, port 10024)
	with ESMTP id 68485-01 for
	<pgsql-patches-postgresql.org@postgresql.org>;
	Sun, 27 Jul 2008 20:03:38 -0300 (ADT)
Received: from mx3.hub.org (mx3.hub.org [206.223.169.73])
	by postgresql.org (Postfix) with ESMTP id 8B1BE65050E
	for <pgsql-patches@postgresql.org>;
	Sun, 27 Jul 2008 13:57:31 -0300 (ADT)
X-Greylist: from auto-whitelisted by SQLgrey-1.7.6
Received: from lists.commandprompt.com (host-159.commandprompt.net
	[207.173.203.159]) by mx3.hub.org (Postfix) with ESMTP id 070D937B965
	for <pgsql-patches@postgresql.org>;
	Sun, 27 Jul 2008 13:57:30 -0300 (ADT)
Received: from [192.168.1.226] (or-69-34-217-90.sta.embarqhsd.net
	[69.34.217.90]) (authenticated bits=0)
	by lists.commandprompt.com (8.13.8/8.13.8) with ESMTP id m6RGxeGr002198
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO);
	Sun, 27 Jul 2008 09:59:41 -0700
Message-ID: <488CA8ED.6080908@commandprompt.com>
Date: Sun, 27 Jul 2008 09:57:17 -0700
From: "Joshua D. Drake" <jd@commandprompt.com>
Organization: Command Prompt, Inc.
User-Agent: Thunderbird 2.0.0.16 (Windows/20080708)
MIME-Version: 1.0
To: Simon Riggs <simon@2ndquadrant.com>
CC: Tom Lane <tgl@sss.pgh.pa.us>, Stephen Frost <sfrost@snowman.net>,
	pgsql-patches@postgresql.org
Subject: Re: pg_dump additional options for performance
References: <20080721115602.GG18846@tamriel.snowman.net>	
	<1216831237.3894.676.camel@ebony.2ndQuadrant>	
	<1216832987.3894.678.camel@ebony.2ndQuadrant>	
	<20080724032047.GI18846@tamriel.snowman.net>	
	<1216885031.3894.739.camel@ebony.2ndQuadrant>	
	<21687.1216886041@sss.pgh.pa.us>	
	<1216889809.3894.747.camel@ebony.2ndQuadrant>	
	<2818.1217027784@sss.pgh.pa.us>	
	<1217063104.3894.1100.camel@ebony.2ndQuadrant>	
	<23540.1217089204@sss.pgh.pa.us>	
	<20080726164355.GH16005@tamriel.snowman.net>	
	<24327.1217094186@sss.pgh.pa.us>
	<1217095404.16378.184.camel@jd-laptop>
	<1217151454.3894.1225.camel@ebony.2ndQuadrant>
In-Reply-To: <1217151454.3894.1225.camel@ebony.2ndQuadrant>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.0
	(lists.commandprompt.com [207.173.203.159]);
	Sun, 27 Jul 2008 09:59:42 -0700 (PDT)
X-Virus-Scanned: Maia Mailguard 1.0.1
X-Spam-Status: No, hits=0 tagged_above=0 required=5 tests=none
X-Spam-Level: 
X-Archive-Number: 200807/264
X-Sequence-Number: 6958

Simon Riggs wrote:
> On Sat, 2008-07-26 at 11:03 -0700, Joshua D. Drake wrote:
> 
>> 2. We have no concurrency which means, anyone with any database over 50G
>> has unacceptable restore times.
> 
> Agreed.

> Sounds good.
> 
> Doesn't help with the main element of dump time: one table at a time to
> one output file. We need a way to dump multiple tables concurrently,
> ending in multiple files/filesystems.

Agreed but that is a problem I understand with a solution I don't. I am 
all eyes on a way to fix that. One thought I had and please, be gentle 
in response was some sort of async transaction capability. I know that 
libpq has the ability to send async queries. Is it possible to do this:

send async(copy table to foo)
send async(copy table to bar)
send async(copy table to baz)

Where all three copies are happening in the background?

Sincerely,

Joshua D. Drake