pg.ddx.io  pgsql-patches@postgresql.org mailing list archive  

help / color / mirror / Atom feed
From: Joshua D. Drake <jd@commandprompt.com>
To: Simon Riggs <simon@2ndquadrant.com>
Cc: Tom Lane <tgl@sss.pgh.pa.us>
Cc: Stephen Frost <sfrost@snowman.net>
Cc: pgsql-patches@postgresql.org
Subject: Re: pg_dump additional options for performance
Date: Sun, 27 Jul 2008 09:57:17 -0700
Message-ID: <488CA8ED.6080908@commandprompt.com> (raw)
In-Reply-To: <1217151454.3894.1225.camel@ebony.2ndQuadrant>
References: <20080721115602.GG18846@tamriel.snowman.net>
	<1216831237.3894.676.camel@ebony.2ndQuadrant>
	<1216832987.3894.678.camel@ebony.2ndQuadrant>
	<20080724032047.GI18846@tamriel.snowman.net>
	<1216885031.3894.739.camel@ebony.2ndQuadrant>
	<21687.1216886041@sss.pgh.pa.us>
	<1216889809.3894.747.camel@ebony.2ndQuadrant>
	<2818.1217027784@sss.pgh.pa.us>
	<1217063104.3894.1100.camel@ebony.2ndQuadrant>
	<23540.1217089204@sss.pgh.pa.us>
	<20080726164355.GH16005@tamriel.snowman.net>
	<24327.1217094186@sss.pgh.pa.us>
	<1217095404.16378.184.camel@jd-laptop>
	<1217151454.3894.1225.camel@ebony.2ndQuadrant>

Simon Riggs wrote:
> On Sat, 2008-07-26 at 11:03 -0700, Joshua D. Drake wrote:
> 
>> 2. We have no concurrency which means, anyone with any database over 50G
>> has unacceptable restore times.
> 
> Agreed.

> Sounds good.
> 
> Doesn't help with the main element of dump time: one table at a time to
> one output file. We need a way to dump multiple tables concurrently,
> ending in multiple files/filesystems.

Agreed but that is a problem I understand with a solution I don't. I am 
all eyes on a way to fix that. One thought I had and please, be gentle 
in response was some sort of async transaction capability. I know that 
libpq has the ability to send async queries. Is it possible to do this:

send async(copy table to foo)
send async(copy table to bar)
send async(copy table to baz)

Where all three copies are happening in the background?

Sincerely,

Joshua D. Drake




view thread (54+ messages)  latest in thread

Message-ID: <488CA8ED.6080908@commandprompt.com>
Permalink:  ../488CA8ED.6080908@commandprompt.com/
Also on:    postgresql.org/message-id/488CA8ED.6080908@commandprompt.com

 · 

reply
Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-patches@postgresql.org
  Cc: jd@commandprompt.com, simon@2ndquadrant.com, tgl@sss.pgh.pa.us, sfrost@snowman.net
  Subject: Re: pg_dump additional options for performance
  In-Reply-To: <488CA8ED.6080908@commandprompt.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox