pg.ddx.io  pgsql-hackers@postgresql.org mailing list archive  
help / color / mirror / Atom feed
Possible TODO item: copy to/from pipe
36+ messages / 15 participants
[nested] [flat]

* Possible TODO item: copy to/from pipe
@ 2006-05-31 15:03  Tom Lane <tgl@sss.pgh.pa.us>
  0 siblings, 5 replies; 36+ messages in thread

From: Tom Lane @ 2006-05-31 15:03 UTC (permalink / raw)
  To: pgsql-hackers

After re-reading what I just wrote to Andreas about how compression of
COPY data would be better done outside the backend than inside, it
struck me that we are missing a feature that's fairly common in Unix
programs.  Perhaps COPY ought to have the ability to pipe its output
to a shell command, or read input from a shell command.  Maybe something
like

	COPY mytable TO '| gzip >/home/tgl/mytable.dump.gz';

(I'm not wedded to the above syntax, it's just an off-the-cuff thought.)

Of course psql would need the same capability, since the server-side
copy would still be restricted to superusers.

You can accomplish COPY piping now through psql, but it's a bit awkward:

	psql -c "COPY mytable TO stdout" mydb | gzip ...

Thoughts?  Is this worth doing, or is the psql -c approach good enough?

			regards, tom lane



^ permalink  raw  reply  [nested|flat] 36+ messages in thread

* Re: Possible TODO item: copy to/from pipe
@ 2006-05-31 15:26  Andrew Dunstan <andrew@dunslane.net>
  parent: Tom Lane <tgl@sss.pgh.pa.us>
  4 siblings, 0 replies; 36+ messages in thread

From: Andrew Dunstan @ 2006-05-31 15:26 UTC (permalink / raw)
  To: Tom Lane <tgl@sss.pgh.pa.us>; +Cc: pgsql-hackers

Tom Lane wrote:
>
> You can accomplish COPY piping now through psql, but it's a bit awkward:
>
> 	psql -c "COPY mytable TO stdout" mydb | gzip ...
>
> Thoughts?  Is this worth doing, or is the psql -c approach good enough?
>
> 	

I think it's good enough. And there is also

   pg_dump -F c -t bigtable -f bigtable.dump

cheers

andrew



^ permalink  raw  reply  [nested|flat] 36+ messages in thread

* Re: Possible TODO item: copy to/from pipe
@ 2006-05-31 15:28  David Fetter <david@fetter.org>
  parent: Tom Lane <tgl@sss.pgh.pa.us>
  4 siblings, 0 replies; 36+ messages in thread

From: David Fetter @ 2006-05-31 15:28 UTC (permalink / raw)
  To: Tom Lane <tgl@sss.pgh.pa.us>; +Cc: pgsql-hackers

On Wed, May 31, 2006 at 11:03:14AM -0400, Tom Lane wrote:
> After re-reading what I just wrote to Andreas about how compression
> of COPY data would be better done outside the backend than inside,
> it struck me that we are missing a feature that's fairly common in
> Unix programs.  Perhaps COPY ought to have the ability to pipe its
> output to a shell command, or read input from a shell command.
> Maybe something like
> 
> 	COPY mytable TO '| gzip >/home/tgl/mytable.dump.gz';

That's a great syntax :)

Similarly,

COPY mytable FROM 'create_sample_data --table mytable --rows 10000000 |';

would be cool.

> (I'm not wedded to the above syntax, it's just an off-the-cuff
> thought.)

It will be familiar to Perl users, for better or worse.  Come to that,
should the prefixes > and >> also mean their corresponding shell
things?

> Of course psql would need the same capability, since the server-side
> copy would still be restricted to superusers.

Roight.

> You can accomplish COPY piping now through psql, but it's a bit awkward:
> 
> 	psql -c "COPY mytable TO stdout" mydb | gzip ...
> 
> Thoughts?  Is this worth doing, or is the psql -c approach good enough?

I think it's worth doing :)

Cheers,
D
-- 
David Fetter <david@fetter.org> http://fetter.org/
phone: +1 415 235 3778        AIM: dfetter666
                              Skype: davidfetter

Remember to vote!



^ permalink  raw  reply  [nested|flat] 36+ messages in thread

* Re: Possible TODO item: copy to/from pipe
@ 2006-05-31 15:37  Andreas Pflug <pgadmin@pse-consulting.de>
  parent: Tom Lane <tgl@sss.pgh.pa.us>
  4 siblings, 2 replies; 36+ messages in thread

From: Andreas Pflug @ 2006-05-31 15:37 UTC (permalink / raw)
  To: Tom Lane <tgl@sss.pgh.pa.us>; +Cc: pgsql-hackers

Tom Lane wrote:
> After re-reading what I just wrote to Andreas about how compression of
> COPY data would be better done outside the backend than inside, it
> struck me that we are missing a feature that's fairly common in Unix
> programs.  Perhaps COPY ought to have the ability to pipe its output
> to a shell command, or read input from a shell command.  Maybe something
> like
> 
> 	COPY mytable TO '| gzip >/home/tgl/mytable.dump.gz';


> 
> (I'm not wedded to the above syntax, it's just an off-the-cuff thought.)
> 
> Of course psql would need the same capability, since the server-side
> copy would still be restricted to superusers.

Won't help too much, until gzip's output is piped back too, so a 
replacement for COPY .. TO STDOUT COMPRESSED  would be
COPY ... TO '| /bin/gzip |' STDOUT, to enable clients to receive the 
reduced stuff. But clients should be agnostic of server side installed 
tools, and probably not be able to address them directly. Sounds like a 
potential security issue.

Regards,
Andreas



^ permalink  raw  reply  [nested|flat] 36+ messages in thread

* Re: Possible TODO item: copy to/from pipe
@ 2006-05-31 15:41  Andreas Pflug <pgadmin@pse-consulting.de>
  parent: Andreas Pflug <pgadmin@pse-consulting.de>
  1 sibling, 1 reply; 36+ messages in thread

From: Andreas Pflug @ 2006-05-31 15:41 UTC (permalink / raw)
  To: ; +Cc: Tom Lane <tgl@sss.pgh.pa.us>; pgsql-hackers

Andreas Pflug wrote:

> 
> Won't help too much, until gzip's output is piped back too, so a 
> replacement for COPY .. TO STDOUT COMPRESSED  would be
> COPY ... TO '| /bin/gzip |' STDOUT, to enable clients to receive the 
> reduced stuff.

Forgot to mention:
COPY COMPRESSED was also meant to introduce a portable format that's 
efficient for both text and binary data. Relying on some external XYZzip 
version seems not too portable to me.

Regards,
Andreas



^ permalink  raw  reply  [nested|flat] 36+ messages in thread

* Re: Possible TODO item: copy to/from pipe
@ 2006-05-31 15:48  Dave Page <dpage@vale-housing.co.uk>
  0 siblings, 1 reply; 36+ messages in thread

From: Dave Page @ 2006-05-31 15:48 UTC (permalink / raw)
  To: Andreas Pflug <pgadmin@pse-consulting.de>; +Cc: Tom Lane <tgl@sss.pgh.pa.us>; pgsql-hackers

 

> -----Original Message-----
> From: pgsql-hackers-owner@postgresql.org 
> [mailto:pgsql-hackers-owner@postgresql.org] On Behalf Of Andreas Pflug
> Sent: 31 May 2006 16:41
> Cc: Tom Lane; pgsql-hackers@postgresql.org
> Subject: Re: [HACKERS] Possible TODO item: copy to/from pipe
> 
> Andreas Pflug wrote:
> 
> > 
> > Won't help too much, until gzip's output is piped back too, so a 
> > replacement for COPY .. TO STDOUT COMPRESSED  would be
> > COPY ... TO '| /bin/gzip |' STDOUT, to enable clients to 
> receive the 
> > reduced stuff.
> 
> Forgot to mention:
> COPY COMPRESSED was also meant to introduce a portable format that's 
> efficient for both text and binary data. Relying on some 
> external XYZzip 
> version seems not too portable to me.

It does have that advantage. Gzip and others are not particularly
Windows friendly for example.

Regards, Dave.




^ permalink  raw  reply  [nested|flat] 36+ messages in thread

* Re: Possible TODO item: copy to/from pipe
@ 2006-05-31 16:30  Tom Lane <tgl@sss.pgh.pa.us>
  parent: Andreas Pflug <pgadmin@pse-consulting.de>
  0 siblings, 1 reply; 36+ messages in thread

From: Tom Lane @ 2006-05-31 16:30 UTC (permalink / raw)
  To: Andreas Pflug <pgadmin@pse-consulting.de>; +Cc: pgsql-hackers

Andreas Pflug <pgadmin@pse-consulting.de> writes:
> Forgot to mention:
> COPY COMPRESSED was also meant to introduce a portable format that's 
> efficient for both text and binary data. Relying on some external XYZzip 
> version seems not too portable to me.

I dislike putting this into the backend precisely because it's trying to
impose a one-size-fits-all compression solution.  Someone might wish to
use bzip2 instead of gzip, for instance, or tweak the compression level
options of gzip.  It's trivial for the user to do that if the
compression program is separate, not trivial at all if it's wired into
COPY.  Also, a pipe feature would have uses unrelated to compression,
such as on-the-fly analysis or generation of data.

			regards, tom lane



^ permalink  raw  reply  [nested|flat] 36+ messages in thread

* Re: Possible TODO item: copy to/from pipe
@ 2006-05-31 16:35  Andreas Pflug <pgadmin@pse-consulting.de>
  parent: Dave Page <dpage@vale-housing.co.uk>
  0 siblings, 1 reply; 36+ messages in thread

From: Andreas Pflug @ 2006-05-31 16:35 UTC (permalink / raw)
  To: Dave Page <dpage@vale-housing.co.uk>; +Cc: Tom Lane <tgl@sss.pgh.pa.us>; pgsql-hackers

Dave Page wrote:
>  
> 
> 
>>-----Original Message-----
>>From: pgsql-hackers-owner@postgresql.org 
>>[mailto:pgsql-hackers-owner@postgresql.org] On Behalf Of Andreas Pflug
>>Sent: 31 May 2006 16:41
>>Cc: Tom Lane; pgsql-hackers@postgresql.org
>>Subject: Re: [HACKERS] Possible TODO item: copy to/from pipe
>>
>>Andreas Pflug wrote:
>>
>>
>>>Won't help too much, until gzip's output is piped back too, so a 
>>>replacement for COPY .. TO STDOUT COMPRESSED  would be
>>>COPY ... TO '| /bin/gzip |' STDOUT, to enable clients to 
>>
>>receive the 
>>
>>>reduced stuff.
>>
>>Forgot to mention:
>>COPY COMPRESSED was also meant to introduce a portable format that's 
>>efficient for both text and binary data. Relying on some 
>>external XYZzip 
>>version seems not too portable to me.
> 
> 
> It does have that advantage. Gzip and others are not particularly
> Windows friendly for example.

... as most windows programs are pipe agnostic.

Regards,
Andreas



^ permalink  raw  reply  [nested|flat] 36+ messages in thread

* Re: Possible TODO item: copy to/from pipe
@ 2006-05-31 17:17  Joshua D. Drake <jd@commandprompt.com>
  parent: Tom Lane <tgl@sss.pgh.pa.us>
  0 siblings, 1 reply; 36+ messages in thread

From: Joshua D. Drake @ 2006-05-31 17:17 UTC (permalink / raw)
  To: Tom Lane <tgl@sss.pgh.pa.us>; +Cc: Andreas Pflug <pgadmin@pse-consulting.de>; pgsql-hackers

> 
> I dislike putting this into the backend precisely because it's trying to
> impose a one-size-fits-all compression solution.  Someone might wish to
> use bzip2 instead of gzip, for instance, or tweak the compression level
> options of gzip.  It's trivial for the user to do that if the
> compression program is separate, not trivial at all if it's wired into
> COPY.  Also, a pipe feature would have uses unrelated to compression,
> such as on-the-fly analysis or generation of data.

It seems that it would be better to have the options within pg_dump 
which would give the most flexibility.

Sincerely,

Joshua D. Drake

-- 

    === The PostgreSQL Company: Command Prompt, Inc. ===
Sales/Support: +1.503.667.4564 || 24x7/Emergency: +1.800.492.2240
    Providing the most comprehensive  PostgreSQL solutions since 1997
              http://www.commandprompt.com/





^ permalink  raw  reply  [nested|flat] 36+ messages in thread

* Re: Possible TODO item: copy to/from pipe
@ 2006-05-31 17:26  Andreas Pflug <pgadmin@pse-consulting.de>
  parent: Joshua D. Drake <jd@commandprompt.com>
  0 siblings, 1 reply; 36+ messages in thread

From: Andreas Pflug @ 2006-05-31 17:26 UTC (permalink / raw)
  To: Joshua D. Drake <jd@commandprompt.com>; +Cc: Tom Lane <tgl@sss.pgh.pa.us>; pgsql-hackers

Joshua D. Drake wrote:
>>
>> I dislike putting this into the backend precisely because it's trying to
>> impose a one-size-fits-all compression solution.  Someone might wish to
>> use bzip2 instead of gzip, for instance, or tweak the compression level
>> options of gzip.  It's trivial for the user to do that if the
>> compression program is separate, not trivial at all if it's wired into
>> COPY.  Also, a pipe feature would have uses unrelated to compression,
>> such as on-the-fly analysis or generation of data.
> 
> 
> It seems that it would be better to have the options within pg_dump 
> which would give the most flexibility.

What about all other client tools?

My COPY WITH COMPRESSION is not the same as taking a copy file and 
zipping it; it creates a copy file with BinarySignature that has 
compressed bytes in the data part, thus it can be handled by any client 
app that can stream binary copy files from/to the server.

Regards,
Andreas



^ permalink  raw  reply  [nested|flat] 36+ messages in thread

* Re: Possible TODO item: copy to/from pipe
@ 2006-05-31 17:28  Magnus Hagander <mha@sollentuna.net>
  0 siblings, 1 reply; 36+ messages in thread

From: Magnus Hagander @ 2006-05-31 17:28 UTC (permalink / raw)
  To: Andreas Pflug <pgadmin@pse-consulting.de>; Dave Page <dpage@vale-housing.co.uk>; +Cc: Tom Lane <tgl@sss.pgh.pa.us>; pgsql-hackers

> >>>Won't help too much, until gzip's output is piped back too, so a 
> >>>replacement for COPY .. TO STDOUT COMPRESSED  would be 
> COPY ... TO '| 
> >>>/bin/gzip |' STDOUT, to enable clients to
> >>
> >>receive the
> >>
> >>>reduced stuff.
> >>
> >>Forgot to mention:
> >>COPY COMPRESSED was also meant to introduce a portable 
> format that's 
> >>efficient for both text and binary data. Relying on some external 
> >>XYZzip version seems not too portable to me.
> > 
> > 
> > It does have that advantage. Gzip and others are not particularly
> > Windows friendly for example.
> 
> ... as most windows programs are pipe agnostic.

For the record, gzip on win32 works perfectly fine both as a separate
program and running in a pipe. No problem at all. The only issue is that
it's not available by default. (And possible issues with programs
launching it that don't know how to deal with windows style directory
naming)

//Magnus



^ permalink  raw  reply  [nested|flat] 36+ messages in thread

* Re: Possible TODO item: copy to/from pipe
@ 2006-05-31 17:51  Chris Browne <cbbrowne@acm.org>
  parent: Andreas Pflug <pgadmin@pse-consulting.de>
  0 siblings, 1 reply; 36+ messages in thread

From: Chris Browne @ 2006-05-31 17:51 UTC (permalink / raw)
  To: pgsql-hackers

pgadmin@pse-consulting.de (Andreas Pflug) writes:
> Dave Page wrote:
>>
>>>-----Original Message-----
>>> From: pgsql-hackers-owner@postgresql.org
>>> [mailto:pgsql-hackers-owner@postgresql.org] On Behalf Of Andreas
>>> Pflug
>>>Sent: 31 May 2006 16:41
>>>Cc: Tom Lane; pgsql-hackers@postgresql.org
>>>Subject: Re: [HACKERS] Possible TODO item: copy to/from pipe
>>>
>>>Andreas Pflug wrote:
>>>
>>>
>>>> Won't help too much, until gzip's output is piped back too, so a
>>>> replacement for COPY .. TO STDOUT COMPRESSED  would be
>>>> COPY ... TO '| /bin/gzip |' STDOUT, to enable clients to
>>>
>>> receive the
>>>
>>>>reduced stuff.
>>>
>>>Forgot to mention:
>>> COPY COMPRESSED was also meant to introduce a portable format
>>> that's efficient for both text and binary data. Relying on some
>>> external XYZzip version seems not too portable to me.
>> It does have that advantage. Gzip and others are not particularly
>> Windows friendly for example.
>
> ... as most windows programs are pipe agnostic.

Shall we make PostgreSQL less powerful because of that?
-- 
"cbbrowne","@","cbbrowne.com"
http://cbbrowne.com/info/advocacy.html
"Love is like a snowmobile flying over the frozen tundra that suddenly
flips, pinning you underneath.  At night, the ice weasels come."
-- Matt Groening



^ permalink  raw  reply  [nested|flat] 36+ messages in thread

* Re: Possible TODO item: copy to/from pipe
@ 2006-05-31 18:13  Andreas Pflug <pgadmin@pse-consulting.de>
  parent: Chris Browne <cbbrowne@acm.org>
  0 siblings, 2 replies; 36+ messages in thread

From: Andreas Pflug @ 2006-05-31 18:13 UTC (permalink / raw)
  To: Chris Browne <cbbrowne@acm.org>; +Cc: pgsql-hackers

Chris Browne wrote:
> pgadmin@pse-consulting.de (Andreas Pflug) writes:
> 
>>Dave Page wrote:
>>
>>>>-----Original Message-----
>>>>From: pgsql-hackers-owner@postgresql.org
>>>>[mailto:pgsql-hackers-owner@postgresql.org] On Behalf Of Andreas
>>>>Pflug
>>>>Sent: 31 May 2006 16:41
>>>>Cc: Tom Lane; pgsql-hackers@postgresql.org
>>>>Subject: Re: [HACKERS] Possible TODO item: copy to/from pipe
>>>>
>>>>Andreas Pflug wrote:
>>>>
>>>>
>>>>
>>>>>Won't help too much, until gzip's output is piped back too, so a
>>>>>replacement for COPY .. TO STDOUT COMPRESSED  would be
>>>>>COPY ... TO '| /bin/gzip |' STDOUT, to enable clients to
>>>>
>>>>receive the
>>>>
>>>>
>>>>>reduced stuff.
>>>>
>>>>Forgot to mention:
>>>>COPY COMPRESSED was also meant to introduce a portable format
>>>>that's efficient for both text and binary data. Relying on some
>>>>external XYZzip version seems not too portable to me.
>>>
>>>It does have that advantage. Gzip and others are not particularly
>>>Windows friendly for example.
>>
>>... as most windows programs are pipe agnostic.
> 
> 
> Shall we make PostgreSQL less powerful because of that?

I never said that. We shall seek solutions that run painless on most 
popular platforms are useful to users.
I wonder if we'd be able to ship gzip with the windows installer, to 
insure proper integration.

Regards,
Andreas



^ permalink  raw  reply  [nested|flat] 36+ messages in thread

* Re: Possible TODO item: copy to/from pipe
@ 2006-05-31 18:46  Andrew Dunstan <andrew@dunslane.net>
  parent: Andreas Pflug <pgadmin@pse-consulting.de>
  1 sibling, 1 reply; 36+ messages in thread

From: Andrew Dunstan @ 2006-05-31 18:46 UTC (permalink / raw)
  To: Andreas Pflug <pgadmin@pse-consulting.de>; +Cc: Chris Browne <cbbrowne@acm.org>; pgsql-hackers

Andreas Pflug wrote:
> Chris Browne wrote:
>> pgadmin@pse-consulting.de (Andreas Pflug) writes:
>>
>>> Dave Page wrote:
>>>
>>>>> -----Original Message-----
>>>>> From: pgsql-hackers-owner@postgresql.org
>>>>> [mailto:pgsql-hackers-owner@postgresql.org] On Behalf Of Andreas
>>>>> Pflug
>>>>> Sent: 31 May 2006 16:41
>>>>> Cc: Tom Lane; pgsql-hackers@postgresql.org
>>>>> Subject: Re: [HACKERS] Possible TODO item: copy to/from pipe
>>>>>
>>>>> Andreas Pflug wrote:
>>>>>
>>>>>
>>>>>
>>>>>> Won't help too much, until gzip's output is piped back too, so a
>>>>>> replacement for COPY .. TO STDOUT COMPRESSED  would be
>>>>>> COPY ... TO '| /bin/gzip |' STDOUT, to enable clients to
>>>>>
>>>>> receive the
>>>>>
>>>>>
>>>>>> reduced stuff.
>>>>>
>>>>> Forgot to mention:
>>>>> COPY COMPRESSED was also meant to introduce a portable format
>>>>> that's efficient for both text and binary data. Relying on some
>>>>> external XYZzip version seems not too portable to me.
>>>>
>>>> It does have that advantage. Gzip and others are not particularly
>>>> Windows friendly for example.
>>>
>>> ... as most windows programs are pipe agnostic.
>>
>>
>> Shall we make PostgreSQL less powerful because of that?
>
> I never said that. We shall seek solutions that run painless on most 
> popular platforms are useful to users.
> I wonder if we'd be able to ship gzip with the windows installer, to 
> insure proper integration.
>


I wish somebody would explain to me the compelling use case for this. We 
do not have to build every possible capability into Postgres. As Tony 
Hoare said, "Inside every large problem is a small problem struggling to 
get out."

This just seems like creeping featurism to me.

cheers

andrew



^ permalink  raw  reply  [nested|flat] 36+ messages in thread

* Re: Possible TODO item: copy to/from pipe
@ 2006-05-31 19:13  David Fetter <david@fetter.org>
  parent: Andrew Dunstan <andrew@dunslane.net>
  0 siblings, 1 reply; 36+ messages in thread

From: David Fetter @ 2006-05-31 19:13 UTC (permalink / raw)
  To: Andrew Dunstan <andrew@dunslane.net>; +Cc: Andreas Pflug <pgadmin@pse-consulting.de>; Chris Browne <cbbrowne@acm.org>; pgsql-hackers

On Wed, May 31, 2006 at 02:46:29PM -0400, Andrew Dunstan wrote:

> I wish somebody would explain to me the compelling use case for
> this.

As with "in-place upgrades,"[1] the compelling use case is being short
on disk space.  For somebody with a multi-TB (or whatever figure
sounds big this week) PostgreSQL database, it may be impossible to get
space for twice or more that.  Giving people the option to stream
COPYs through a pipe would alleviate a lot of pain.

Cheers,
D

[1]  A feature people seem to think we don't need, although convincing
cases have been made for it.
-- 
David Fetter <david@fetter.org> http://fetter.org/
phone: +1 415 235 3778        AIM: dfetter666
                              Skype: davidfetter

Remember to vote!



^ permalink  raw  reply  [nested|flat] 36+ messages in thread

* Re: Possible TODO item: copy to/from pipe
@ 2006-05-31 19:30  Andrew Dunstan <andrew@dunslane.net>
  parent: David Fetter <david@fetter.org>
  0 siblings, 1 reply; 36+ messages in thread

From: Andrew Dunstan @ 2006-05-31 19:30 UTC (permalink / raw)
  To: David Fetter <david@fetter.org>; +Cc: Andreas Pflug <pgadmin@pse-consulting.de>; Chris Browne <cbbrowne@acm.org>; pgsql-hackers

David Fetter wrote:
> On Wed, May 31, 2006 at 02:46:29PM -0400, Andrew Dunstan wrote:
>
>   
>> I wish somebody would explain to me the compelling use case for
>> this.
>>     
>
> As with "in-place upgrades,"[1] the compelling use case is being short
> on disk space.  For somebody with a multi-TB (or whatever figure
> sounds big this week) PostgreSQL database, it may be impossible to get
> space for twice or more that.  Giving people the option to stream
> COPYs through a pipe would alleviate a lot of pain.
>
> Cheers,
> D
>
> [1]  A feature people seem to think we don't need, although convincing
> cases have been made for it.
>   

But why is that hugely better than piping psql output to gzip?

The Unix philosophy is to use small chains of tools rather than put 
everything into one big tool.

Thus, this is quite unlike inplace upgrade, which I agree would be great 
(and where I would far rather see people spend their efforts), because 
unlike for this "feature" there is no viable alternative.

cheers

andrew



^ permalink  raw  reply  [nested|flat] 36+ messages in thread

* Re: Possible TODO item: copy to/from pipe
@ 2006-05-31 19:55  Dave Page <dpage@vale-housing.co.uk>
  parent: Magnus Hagander <mha@sollentuna.net>
  0 siblings, 1 reply; 36+ messages in thread

From: Dave Page @ 2006-05-31 19:55 UTC (permalink / raw)
  To: Magnus Hagander <mha@sollentuna.net>; Andreas Pflug <pgadmin@pse-consulting.de>; +Cc: Tom Lane <tgl@sss.pgh.pa.us>; pgsql-hackers




On 31/5/06 18:28, "Magnus Hagander" <mha@sollentuna.net> wrote:

>>>>> Won't help too much, until gzip's output is piped back too, so a
>>>>> replacement for COPY .. TO STDOUT COMPRESSED  would be
>> COPY ... TO '| 
>>>>> /bin/gzip |' STDOUT, to enable clients to
>>>> 
>>>> receive the
>>>> 
>>>>> reduced stuff.
>>>> 
>>>> Forgot to mention:
>>>> COPY COMPRESSED was also meant to introduce a portable
>> format that's 
>>>> efficient for both text and binary data. Relying on some external
>>>> XYZzip version seems not too portable to me.
>>> 
>>> 
>>> It does have that advantage. Gzip and others are not particularly
>>> Windows friendly for example.
>> 
>> ... as most windows programs are pipe agnostic.
> 
> For the record, gzip on win32 works perfectly fine both as a separate
> program and running in a pipe. No problem at all. The only issue is that
> it's not available by default. (And possible issues with programs
> launching it that don't know how to deal with windows style directory
> naming)

Exactly my point; how many production Windows servers do you have with gzip
anywhere near them? Andreas' point about pipes is also valid though - it's
simply not the norm on Windows as I found when we were porting Slony
(more.exe barfs at >8MB being pipe in).

Regards, Dave.





^ permalink  raw  reply  [nested|flat] 36+ messages in thread

* Re: Possible TODO item: copy to/from pipe
@ 2006-05-31 19:58  Alvaro Herrera <alvherre@commandprompt.com>
  parent: Andrew Dunstan <andrew@dunslane.net>
  0 siblings, 1 reply; 36+ messages in thread

From: Alvaro Herrera @ 2006-05-31 19:58 UTC (permalink / raw)
  To: Andrew Dunstan <andrew@dunslane.net>; +Cc: David Fetter <david@fetter.org>; Andreas Pflug <pgadmin@pse-consulting.de>; Chris Browne <cbbrowne@acm.org>; pgsql-hackers

Andrew Dunstan wrote:
> David Fetter wrote:

> >As with "in-place upgrades,"[1] the compelling use case is being short
> >on disk space.  For somebody with a multi-TB (or whatever figure
> >sounds big this week) PostgreSQL database, it may be impossible to get
> >space for twice or more that.  Giving people the option to stream
> >COPYs through a pipe would alleviate a lot of pain.
> 
> But why is that hugely better than piping psql output to gzip?

psql output has already travelled over the network.

-- 
Alvaro Herrera                                http://www.CommandPrompt.com/
The PostgreSQL Company - Command Prompt, Inc.



^ permalink  raw  reply  [nested|flat] 36+ messages in thread

* Re: Possible TODO item: copy to/from pipe
@ 2006-05-31 19:58  Dave Page <dpage@vale-housing.co.uk>
  parent: Andreas Pflug <pgadmin@pse-consulting.de>
  1 sibling, 1 reply; 36+ messages in thread

From: Dave Page @ 2006-05-31 19:58 UTC (permalink / raw)
  To: Andreas Pflug <pgadmin@pse-consulting.de>; Chris Browne <cbbrowne@acm.org>; +Cc: pgsql-hackers




On 31/5/06 19:13, "Andreas Pflug" <pgadmin@pse-consulting.de> wrote:

> I wonder if we'd be able to ship gzip with the windows installer, to
> insure proper integration.

'Fraid not. It's GPL'd.

Regards, Dave.




^ permalink  raw  reply  [nested|flat] 36+ messages in thread

* Re: Possible TODO item: copy to/from pipe
@ 2006-05-31 20:08  Steve Atkins <steve@blighty.com>
  parent: Dave Page <dpage@vale-housing.co.uk>
  0 siblings, 1 reply; 36+ messages in thread

From: Steve Atkins @ 2006-05-31 20:08 UTC (permalink / raw)
  To: pgsql-hackers


On May 31, 2006, at 12:58 PM, Dave Page wrote:

>
>
>
> On 31/5/06 19:13, "Andreas Pflug" <pgadmin@pse-consulting.de> wrote:
>
>> I wonder if we'd be able to ship gzip with the windows installer, to
>> insure proper integration.
>
> 'Fraid not. It's GPL'd.

Well, one implementation of it is. zlib is new-bsd-ish, though, and  
includes
minigzip, which should be just fine for use in a pipe on windows.

(Not that that's an argument one way or the other as to whether this
is something we should do).

Cheers,
   Steve






^ permalink  raw  reply  [nested|flat] 36+ messages in thread

* Re: Possible TODO item: copy to/from pipe
@ 2006-05-31 20:08  Magnus Hagander <mha@sollentuna.net>
  0 siblings, 0 replies; 36+ messages in thread

From: Magnus Hagander @ 2006-05-31 20:08 UTC (permalink / raw)
  To: Dave Page <dpage@vale-housing.co.uk>; Andreas Pflug <pgadmin@pse-consulting.de>; Chris Browne <cbbrowne@acm.org>; +Cc: pgsql-hackers

> > I wonder if we'd be able to ship gzip with the windows 
> installer, to 
> > insure proper integration.
> 
> 'Fraid not. It's GPL'd.
> 

Well, if we want to go down that route, we could probably hack up
something simple around zlib. IIRC, there's even sample code in there
for how to write a gzip pipe program...

No, not as convenient, but should be handlable.

//Magnus



^ permalink  raw  reply  [nested|flat] 36+ messages in thread

* Re: Possible TODO item: copy to/from pipe
@ 2006-05-31 20:10  Tom Lane <tgl@sss.pgh.pa.us>
  parent: Andreas Pflug <pgadmin@pse-consulting.de>
  0 siblings, 0 replies; 36+ messages in thread

From: Tom Lane @ 2006-05-31 20:10 UTC (permalink / raw)
  To: Andreas Pflug <pgadmin@pse-consulting.de>; +Cc: Joshua D. Drake <jd@commandprompt.com>; pgsql-hackers

Andreas Pflug <pgadmin@pse-consulting.de> writes:
> My COPY WITH COMPRESSION is not the same as taking a copy file and 
> zipping it; it creates a copy file with BinarySignature that has 
> compressed bytes in the data part, thus it can be handled by any client 
> app that can stream binary copy files from/to the server.

If you mean you're compressing each data field separately, that's surely
a very bad idea.  If you mean you're compressing everything except the
file header, I fail to see the value.  Binary is binary.  I *seriously*
doubt there are clients out there that look for a PGCOPY header before
deciding whether to send the file to the server or not.  And a client
that did know that much about a PGCOPY file would likely spit up on a
critical flag it didn't recognize, anyway.

			regards, tom lane



^ permalink  raw  reply  [nested|flat] 36+ messages in thread

* Re: Possible TODO item: copy to/from pipe
@ 2006-05-31 20:10  Tom Lane <tgl@sss.pgh.pa.us>
  parent: Dave Page <dpage@vale-housing.co.uk>
  0 siblings, 1 reply; 36+ messages in thread

From: Tom Lane @ 2006-05-31 20:10 UTC (permalink / raw)
  To: Dave Page <dpage@vale-housing.co.uk>; +Cc: Magnus Hagander <mha@sollentuna.net>; Andreas Pflug <pgadmin@pse-consulting.de>; pgsql-hackers

Dave Page <dpage@vale-housing.co.uk> writes:
> Exactly my point; how many production Windows servers do you have with gzip
> anywhere near them? Andreas' point about pipes is also valid though - it's
> simply not the norm on Windows as I found when we were porting Slony
> (more.exe barfs at >8MB being pipe in).

I don't see that we should allow Windows' deficiencies to be an argument
against providing a facility that would be useful on all our other platforms.

			regards, tom lane



^ permalink  raw  reply  [nested|flat] 36+ messages in thread

* Re: Possible TODO item: copy to/from pipe
@ 2006-05-31 20:12  Andrew Dunstan <andrew@dunslane.net>
  parent: Alvaro Herrera <alvherre@commandprompt.com>
  0 siblings, 0 replies; 36+ messages in thread

From: Andrew Dunstan @ 2006-05-31 20:12 UTC (permalink / raw)
  To: David Fetter <david@fetter.org>; Andreas Pflug <pgadmin@pse-consulting.de>; Chris Browne <cbbrowne@acm.org>; pgsql-hackers

Alvaro Herrera wrote:
> Andrew Dunstan wrote:
>   
>>
>> But why is that hugely better than piping psql output to gzip?
>>     
>
> psql output has already travelled over the network.
>
>   

As I understand Tom's suggestion, it does not involve compression of 
over the wire data. He suggested that on the server you would be able to do:

  COPY mytable TO '| gzip >/home/tgl/mytable.dump.gz';


and that there could be an equivalent extension on psql's \copy command, as an alternative to doing 


  psql -c "COPY mytable TO stdout" mydb | gzip ...



It's the second piece especially that seems to me unnecessary. 


So I am still unconvinced.



cheers

andrew



^ permalink  raw  reply  [nested|flat] 36+ messages in thread

* Re: Possible TODO item: copy to/from pipe
@ 2006-05-31 20:27  Dave Page <dpage@vale-housing.co.uk>
  parent: Tom Lane <tgl@sss.pgh.pa.us>
  0 siblings, 1 reply; 36+ messages in thread

From: Dave Page @ 2006-05-31 20:27 UTC (permalink / raw)
  To: Tom Lane <tgl@sss.pgh.pa.us>; +Cc: Magnus Hagander <mha@sollentuna.net>; Andreas Pflug <pgadmin@pse-consulting.de>; pgsql-hackers




On 31/5/06 21:10, "Tom Lane" <tgl@sss.pgh.pa.us> wrote:

> Dave Page <dpage@vale-housing.co.uk> writes:
>> Exactly my point; how many production Windows servers do you have with gzip
>> anywhere near them? Andreas' point about pipes is also valid though - it's
>> simply not the norm on Windows as I found when we were porting Slony
>> (more.exe barfs at >8MB being pipe in).
> 
> I don't see that we should allow Windows' deficiencies to be an argument
> against providing a facility that would be useful on all our other platforms.

It's not about a primarily GUI based OS not being able to do everything a
traditionally command line based OS can do on the command line, it's about
providing a solution that will work on either and remain portable. Whilst I
agree with your objection to using pg_lzcompress, I for one would rather see
a builtin solution that I know will work whatever platform/box I'm on
without having to go and download additional tools.

Regards, Dave. 




^ permalink  raw  reply  [nested|flat] 36+ messages in thread

* Re: Possible TODO item: copy to/from pipe
@ 2006-05-31 20:51  Martijn van Oosterhout <kleptog@svana.org>
  parent: Steve Atkins <steve@blighty.com>
  0 siblings, 1 reply; 36+ messages in thread

From: Martijn van Oosterhout @ 2006-05-31 20:51 UTC (permalink / raw)
  To: Steve Atkins <steve@blighty.com>; +Cc: pgsql-hackers

On Wed, May 31, 2006 at 01:08:28PM -0700, Steve Atkins wrote:
> On May 31, 2006, at 12:58 PM, Dave Page wrote:
> >On 31/5/06 19:13, "Andreas Pflug" <pgadmin@pse-consulting.de> wrote:
> >
> >>I wonder if we'd be able to ship gzip with the windows installer, to
> >>insure proper integration.
> >
> >'Fraid not. It's GPL'd.
> 
> Well, one implementation of it is. zlib is new-bsd-ish, though, and
> includes minigzip, which should be just fine for use in a pipe on
> windows.

Even then it's not relevent. The Windows Installer is already GPL'd by
the fact it includes readline. zlib is indeed straight BSD like.

Have a nice day,
-- 
Martijn van Oosterhout   <kleptog@svana.org>   http://svana.org/kleptog/
> From each according to his ability. To each according to his ability to litigate.

Attachments:

  signature.asc (application/pgp-signature, 188B) download

^ permalink  raw  reply  [nested|flat] 36+ messages in thread

* Re: Possible TODO item: copy to/from pipe
@ 2006-05-31 20:54  Andreas Pflug <pgadmin@pse-consulting.de>
  parent: Dave Page <dpage@vale-housing.co.uk>
  0 siblings, 0 replies; 36+ messages in thread

From: Andreas Pflug @ 2006-05-31 20:54 UTC (permalink / raw)
  To: Dave Page <dpage@vale-housing.co.uk>; +Cc: Tom Lane <tgl@sss.pgh.pa.us>; Magnus Hagander <mha@sollentuna.net>; pgsql-hackers

Dave Page wrote:

>  It's not about a primarily GUI based OS not being able to do
>  everything a traditionally command line based OS can do on the
>  command line, it's about providing a solution that will work on
>  either and remain portable. Whilst I agree with your objection to
>  using pg_lzcompress,

Well, pg_lzcompress is in the backend for more than 6 years now, strange 
the objections arise now. However, a replacement for it might be a good 
idea, since apparently the fastest gzip algorithm is 3x faster for 10% 
better compression. TOAST write performance would probably profit 
significantly from a better algorithm.

I wonder what other use-cases exist for server side copy filters beyond 
compression.

Regards,
Andreas




^ permalink  raw  reply  [nested|flat] 36+ messages in thread

* Re: Possible TODO item: copy to/from pipe
@ 2006-05-31 21:20  Magnus Hagander <mha@sollentuna.net>
  0 siblings, 2 replies; 36+ messages in thread

From: Magnus Hagander @ 2006-05-31 21:20 UTC (permalink / raw)
  To: Martijn van Oosterhout <kleptog@svana.org>; Steve Atkins <steve@blighty.com>; +Cc: pgsql-hackers

> > >>I wonder if we'd be able to ship gzip with the windows 
> installer, to 
> > >>insure proper integration.
> > >
> > >'Fraid not. It's GPL'd.
> > 
> > Well, one implementation of it is. zlib is new-bsd-ish, though, and 
> > includes minigzip, which should be just fine for use in a pipe on 
> > windows.
> 
> Even then it's not relevent. The Windows Installer is already 
> GPL'd by the fact it includes readline. zlib is indeed 
> straight BSD like.

Uh. The installer does *not* include readline.

We do include PostGIS, but the PostGIS people themselves don't consider
us GPLed because of that ;-) 

Everything else is != GPL.

//Magnus



^ permalink  raw  reply  [nested|flat] 36+ messages in thread

* Re: Possible TODO item: copy to/from pipe
@ 2006-05-31 21:48  Joshua D. Drake <jd@commandprompt.com>
  parent: Magnus Hagander <mha@sollentuna.net>
  1 sibling, 0 replies; 36+ messages in thread

From: Joshua D. Drake @ 2006-05-31 21:48 UTC (permalink / raw)
  To: Magnus Hagander <mha@sollentuna.net>; +Cc: Martijn van Oosterhout <kleptog@svana.org>; Steve Atkins <steve@blighty.com>; pgsql-hackers


> Uh. The installer does *not* include readline.
> 
> We do include PostGIS, but the PostGIS people themselves don't consider
> us GPLed because of that ;-) 
> 

That is a tad different. PostgreSQL does not link to Postgis. Readline 
does :)


Sincerely,

Joshua D. Drake

> Everything else is != GPL.
> 
> //Magnus
> 
> ---------------------------(end of broadcast)---------------------------
> TIP 6: explain analyze is your friend
> 


-- 

    === The PostgreSQL Company: Command Prompt, Inc. ===
Sales/Support: +1.503.667.4564 || 24x7/Emergency: +1.800.492.2240
    Providing the most comprehensive  PostgreSQL solutions since 1997
              http://www.commandprompt.com/





^ permalink  raw  reply  [nested|flat] 36+ messages in thread

* Re: Possible TODO item: copy to/from pipe
@ 2006-06-01 05:42  Martijn van Oosterhout <kleptog@svana.org>
  parent: Magnus Hagander <mha@sollentuna.net>
  1 sibling, 0 replies; 36+ messages in thread

From: Martijn van Oosterhout @ 2006-06-01 05:42 UTC (permalink / raw)
  To: Magnus Hagander <mha@sollentuna.net>; +Cc: Steve Atkins <steve@blighty.com>; pgsql-hackers

On Wed, May 31, 2006 at 11:20:21PM +0200, Magnus Hagander wrote:
> Uh. The installer does *not* include readline.

Terribly sorry, I misinterpreted the thread about it at the beginning
of the year.

http://archives.postgresql.org/pgsql-hackers/2006-02/msg00539.php

Have a nice day,
-- 
Martijn van Oosterhout   <kleptog@svana.org>   http://svana.org/kleptog/
> From each according to his ability. To each according to his ability to litigate.

Attachments:

  signature.asc (application/pgp-signature, 188B) download

^ permalink  raw  reply  [nested|flat] 36+ messages in thread

* Re: Possible TODO item: copy to/from pipe
@ 2006-06-01 08:42  Dawid Kuroczko <qnex42@gmail.com>
  parent: Tom Lane <tgl@sss.pgh.pa.us>
  4 siblings, 0 replies; 36+ messages in thread

From: Dawid Kuroczko @ 2006-06-01 08:42 UTC (permalink / raw)
  To: Tom Lane <tgl@sss.pgh.pa.us>; +Cc: pgsql-hackers

On 5/31/06, Tom Lane <tgl@sss.pgh.pa.us> wrote:
> After re-reading what I just wrote to Andreas about how compression of
> COPY data would be better done outside the backend than inside, it
> struck me that we are missing a feature that's fairly common in Unix
> programs.  Perhaps COPY ought to have the ability to pipe its output
> to a shell command, or read input from a shell command.  Maybe something
> like
>
>         COPY mytable TO '| gzip >/home/tgl/mytable.dump.gz';
>
> (I'm not wedded to the above syntax, it's just an off-the-cuff thought.)
>
> Of course psql would need the same capability, since the server-side
> copy would still be restricted to superusers.
>
> You can accomplish COPY piping now through psql, but it's a bit awkward:
>
>         psql -c "COPY mytable TO stdout" mydb | gzip ...
>
> Thoughts?  Is this worth doing, or is the psql -c approach good enough?

You can accomplish it now with help of FIFOs, like

\! mkfifo /tmp/psqlfifo
\! chmod 666 /tmp/psqlfifo
-- I know 666 is a dangerous number. ;)
\! gzip -9 < /tmp/psqlfifo > /tmp/psqlcopy.gz
COPY foo TO '/tmp/psqlfifo';

...though ability to pipe "directly" is desirable feature.

   Regards,
       Dawid



^ permalink  raw  reply  [nested|flat] 36+ messages in thread

* Re: Possible TODO item: copy to/from pipe
@ 2006-06-01 12:52  Mark Woodward <pgsql@mohawksoft.com>
  parent: Tom Lane <tgl@sss.pgh.pa.us>
  4 siblings, 0 replies; 36+ messages in thread

From: Mark Woodward @ 2006-06-01 12:52 UTC (permalink / raw)
  To: Tom Lane <tgl@sss.pgh.pa.us>; +Cc: pgsql-hackers

> After re-reading what I just wrote to Andreas about how compression of
> COPY data would be better done outside the backend than inside, it
> struck me that we are missing a feature that's fairly common in Unix
> programs.  Perhaps COPY ought to have the ability to pipe its output
> to a shell command, or read input from a shell command.  Maybe something
> like
>
> 	COPY mytable TO '| gzip >/home/tgl/mytable.dump.gz';
>
> (I'm not wedded to the above syntax, it's just an off-the-cuff thought.)
>
> Of course psql would need the same capability, since the server-side
> copy would still be restricted to superusers.
>
> You can accomplish COPY piping now through psql, but it's a bit awkward:
>
> 	psql -c "COPY mytable TO stdout" mydb | gzip ...
>
> Thoughts?  Is this worth doing, or is the psql -c approach good enough?


To be honest, I don't see much benefit in it. You can already accomplish
what you want to accomplish easily enough.

If you want to muck with COPY, I'd like to see it accept a query as:

psql -c "COPY select * from mytable where foo='bar' TO stdout" mydb | gzip
...






^ permalink  raw  reply  [nested|flat] 36+ messages in thread

* Re: Possible TODO item: copy to/from pipe
@ 2006-06-04 00:09  Bruce Momjian <pgman@candle.pha.pa.us>
  parent: Martijn van Oosterhout <kleptog@svana.org>
  0 siblings, 0 replies; 36+ messages in thread

From: Bruce Momjian @ 2006-06-04 00:09 UTC (permalink / raw)
  To: Martijn van Oosterhout <kleptog@svana.org>; +Cc: Steve Atkins <steve@blighty.com>; pgsql-hackers

Martijn van Oosterhout wrote:
-- Start of PGP signed section.
> On Wed, May 31, 2006 at 01:08:28PM -0700, Steve Atkins wrote:
> > On May 31, 2006, at 12:58 PM, Dave Page wrote:
> > >On 31/5/06 19:13, "Andreas Pflug" <pgadmin@pse-consulting.de> wrote:
> > >
> > >>I wonder if we'd be able to ship gzip with the windows installer, to
> > >>insure proper integration.
> > >
> > >'Fraid not. It's GPL'd.
> > 
> > Well, one implementation of it is. zlib is new-bsd-ish, though, and
> > includes minigzip, which should be just fine for use in a pipe on
> > windows.
> 
> Even then it's not relevent. The Windows Installer is already GPL'd by
> the fact it includes readline. zlib is indeed straight BSD like.

I assume gzip would be binary in the installer.  Does putting a GPL
binary in the installer make the entire thing GPL?  I don't think so.

-- 
  Bruce Momjian   http://candle.pha.pa.us
  EnterpriseDB    http://www.enterprisedb.com

  + If your life is a hard drive, Christ can be your backup. +



^ permalink  raw  reply  [nested|flat] 36+ messages in thread

* Re: Possible TODO item: copy to/from pipe
@ 2006-06-04 00:12  Bruce Momjian <pgman@candle.pha.pa.us>
  parent: Andreas Pflug <pgadmin@pse-consulting.de>
  1 sibling, 1 reply; 36+ messages in thread

From: Bruce Momjian @ 2006-06-04 00:12 UTC (permalink / raw)
  To: Andreas Pflug <pgadmin@pse-consulting.de>; +Cc: Tom Lane <tgl@sss.pgh.pa.us>; pgsql-hackers

Andreas Pflug wrote:
> Tom Lane wrote:
> > After re-reading what I just wrote to Andreas about how compression of
> > COPY data would be better done outside the backend than inside, it
> > struck me that we are missing a feature that's fairly common in Unix
> > programs.  Perhaps COPY ought to have the ability to pipe its output
> > to a shell command, or read input from a shell command.  Maybe something
> > like
> > 
> > 	COPY mytable TO '| gzip >/home/tgl/mytable.dump.gz';

For use case, consider this:

 	COPY mytable TO '| rsh x@y.com > test ';

so you can COPY to another server directly.

-- 
  Bruce Momjian   http://candle.pha.pa.us
  EnterpriseDB    http://www.enterprisedb.com

  + If your life is a hard drive, Christ can be your backup. +



^ permalink  raw  reply  [nested|flat] 36+ messages in thread

* Re: Possible TODO item: copy to/from pipe
@ 2006-06-04 12:07  Andreas Pflug <pgadmin@pse-consulting.de>
  parent: Bruce Momjian <pgman@candle.pha.pa.us>
  0 siblings, 1 reply; 36+ messages in thread

From: Andreas Pflug @ 2006-06-04 12:07 UTC (permalink / raw)
  To: Bruce Momjian <pgman@candle.pha.pa.us>; +Cc: Tom Lane <tgl@sss.pgh.pa.us>; pgsql-hackers

Bruce Momjian wrote:
>
> For use case, consider this:
>
>  	COPY mytable TO '| rsh x@y.com > test ';
>
> so you can COPY to another server directly.
>   
Why not rsh psql -c "\copy foobar to test" ?

Regards,
Andreas




^ permalink  raw  reply  [nested|flat] 36+ messages in thread

* Re: Possible TODO item: copy to/from pipe
@ 2006-06-04 21:39  Greg Stark <gsstark@mit.edu>
  parent: Andreas Pflug <pgadmin@pse-consulting.de>
  0 siblings, 0 replies; 36+ messages in thread

From: Greg Stark @ 2006-06-04 21:39 UTC (permalink / raw)
  To: Andreas Pflug <pgadmin@pse-consulting.de>; +Cc: Bruce Momjian <pgman@candle.pha.pa.us>; Tom Lane <tgl@sss.pgh.pa.us>; pgsql-hackers

Andreas Pflug <pgadmin@pse-consulting.de> writes:

> Bruce Momjian wrote:
> >
> > For use case, consider this:
> >
> >  	COPY mytable TO '| rsh x@y.com > test ';
> >
> > so you can COPY to another server directly.
> >
> Why not rsh psql -c "\copy foobar to test" ?

Who knows? The sysadmin could have any reason to prefer one to the other. 

One that comes to mind is that he or she may want to automate this and may be
happier granting password-free access to a filesystem server that just holds
encrypted backups than to the live production database.

-- 
greg




^ permalink  raw  reply  [nested|flat] 36+ messages in thread


end of thread, other threads:[~2006-06-04 21:39 UTC | newest]

Thread overview: 36+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2006-05-31 15:03 Possible TODO item: copy to/from pipe Tom Lane <tgl@sss.pgh.pa.us>
2006-05-31 15:26 ` Andrew Dunstan <andrew@dunslane.net>
2006-05-31 15:28 ` David Fetter <david@fetter.org>
2006-05-31 15:37 ` Andreas Pflug <pgadmin@pse-consulting.de>
2006-05-31 15:41   ` Andreas Pflug <pgadmin@pse-consulting.de>
2006-05-31 16:30     ` Tom Lane <tgl@sss.pgh.pa.us>
2006-05-31 17:17       ` Joshua D. Drake <jd@commandprompt.com>
2006-05-31 17:26         ` Andreas Pflug <pgadmin@pse-consulting.de>
2006-05-31 20:10           ` Tom Lane <tgl@sss.pgh.pa.us>
2006-06-04 00:12   ` Bruce Momjian <pgman@candle.pha.pa.us>
2006-06-04 12:07     ` Andreas Pflug <pgadmin@pse-consulting.de>
2006-06-04 21:39       ` Greg Stark <gsstark@mit.edu>
2006-06-01 08:42 ` Dawid Kuroczko <qnex42@gmail.com>
2006-06-01 12:52 ` Mark Woodward <pgsql@mohawksoft.com>
2006-05-31 15:48 Re: Possible TODO item: copy to/from pipe Dave Page <dpage@vale-housing.co.uk>
2006-05-31 16:35 ` Andreas Pflug <pgadmin@pse-consulting.de>
2006-05-31 17:51   ` Chris Browne <cbbrowne@acm.org>
2006-05-31 18:13     ` Andreas Pflug <pgadmin@pse-consulting.de>
2006-05-31 18:46       ` Andrew Dunstan <andrew@dunslane.net>
2006-05-31 19:13         ` David Fetter <david@fetter.org>
2006-05-31 19:30           ` Andrew Dunstan <andrew@dunslane.net>
2006-05-31 19:58             ` Alvaro Herrera <alvherre@commandprompt.com>
2006-05-31 20:12               ` Andrew Dunstan <andrew@dunslane.net>
2006-05-31 19:58       ` Dave Page <dpage@vale-housing.co.uk>
2006-05-31 20:08         ` Steve Atkins <steve@blighty.com>
2006-05-31 20:51           ` Martijn van Oosterhout <kleptog@svana.org>
2006-06-04 00:09             ` Bruce Momjian <pgman@candle.pha.pa.us>
2006-05-31 17:28 Re: Possible TODO item: copy to/from pipe Magnus Hagander <mha@sollentuna.net>
2006-05-31 19:55 ` Dave Page <dpage@vale-housing.co.uk>
2006-05-31 20:10   ` Tom Lane <tgl@sss.pgh.pa.us>
2006-05-31 20:27     ` Dave Page <dpage@vale-housing.co.uk>
2006-05-31 20:54       ` Andreas Pflug <pgadmin@pse-consulting.de>
2006-05-31 20:08 Re: Possible TODO item: copy to/from pipe Magnus Hagander <mha@sollentuna.net>
2006-05-31 21:20 Re: Possible TODO item: copy to/from pipe Magnus Hagander <mha@sollentuna.net>
2006-05-31 21:48 ` Joshua D. Drake <jd@commandprompt.com>
2006-06-01 05:42 ` Martijn van Oosterhout <kleptog@svana.org>

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox