From: PFC <lists@peufeu.com>
To: Harald Armin Massa <haraldarminmassa@gmail.com>
To: Rainer Bauer <usenet@munnin.com>
Cc: pgsql-performance@postgresql.org
Subject: Re: Data transfer very slow when connected via DSL
Date: Fri, 22 Jun 2007 12:45:13 +0200
Message-ID: <op.tubj5nq5cigqcu@apollo13> (raw)
In-Reply-To: <7be3f35d0706220324n1b8a41e1q7d235970044da689@mail.gmail.com>
References: <s7tk73d57kvb3f4ph1kmkvhdfe0kak5a1r@4ax.com>
<7be3f35d0706210801p732f2e73o147e3cbc0dc98153@mail.gmail.com>
<d1el7392q4eab7uqud2ci3ihn2fqkusjms@4ax.com>
<7be3f35d0706220324n1b8a41e1q7d235970044da689@mail.gmail.com>
>> I did not find a solution so far; and for bulk data transfers I now
>> >programmed a workaround.
>>
>> But that is surely based on some component installed on the server,
>> isn't
>> it?
>>
>
> Correct. I use a pyro-remote server. On request this remote server copies
> the relevant rows into a temporary table, uses a copy_to Call to push
> them
> into a StringIO-Objekt (that's Pythons version of "In Memory File"),
> serializes that StringIO-Objekt, does a bz2-compression and transfers the
> whole block via VPN.
>
> I read on in this thread, and I scheduled to check on psycopg2 and what
> it is doing with cursors.
What about a SSH tunnel using data compression ?
If you fetch all rows from a query in one go, would it be fast ?
Also, PG can now COPY from a query, so you don't really need the temp
table...
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-performance@postgresql.org
Cc: lists@peufeu.com, haraldarminmassa@gmail.com, usenet@munnin.com
Subject: Re: Data transfer very slow when connected via DSL
In-Reply-To: <op.tubj5nq5cigqcu@apollo13>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox