Received: from localhost (maia-5.hub.org [200.46.204.182]) by postgresql.org (Postfix) with ESMTP id 8B2919FB821 for ; Fri, 22 Jun 2007 09:45:20 -0300 (ADT) Received: from postgresql.org ([200.46.204.71]) by localhost (mx1.hub.org [200.46.204.182]) (amavisd-maia, port 10024) with ESMTP id 65793-03 for ; Fri, 22 Jun 2007 09:45:10 -0300 (ADT) X-Greylist: domain auto-whitelisted by SQLgrey-1.7.5 Received: from nz-out-0506.google.com (nz-out-0506.google.com [64.233.162.237]) by postgresql.org (Postfix) with ESMTP id EDB099FB7F7 for ; Fri, 22 Jun 2007 09:45:14 -0300 (ADT) Received: by nz-out-0506.google.com with SMTP id m22so779637nzf for ; Fri, 22 Jun 2007 05:45:13 -0700 (PDT) DKIM-Signature: a=rsa-sha1; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:references; b=tGBpFBI6XuFnf0hMcuzKxUOjHeiZBJN7SNIKgHVcufKrzmy/zFbITcOHD90v6JM4M7fIcQMIjL8yISDaudbnv+MooYknJcEXCKuy1EwpUlKbf+VmzFVWsODBzX2G1cADxdU8aorm1eAHg9Pwxhh0qqylgfzsgh+Z+78BfxDy2OM= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:references; b=tSiwXA6ZtTgW47x3WQtimQaiNgTbHiRLf4qR4shoxWSMJeXhLY4SFqZkWjbMKhBx4Jw/MzBn5zL+JvQ0K3wyq5wRFzd8oNN2rYbivDv6DNTyjmqtkAUJaqBaYfMjcJ+jUGhzuKT4C6RHfiYLG8ga9vM8jJq43Q01wg4Wf9wL5ME= Received: by 10.114.133.1 with SMTP id g1mr2947684wad.1182516312991; Fri, 22 Jun 2007 05:45:12 -0700 (PDT) Received: by 10.114.112.16 with HTTP; Fri, 22 Jun 2007 05:45:12 -0700 (PDT) Message-ID: <7be3f35d0706220545uaaa957ey3b1ca083ba895c39@mail.gmail.com> Date: Fri, 22 Jun 2007 14:45:12 +0200 From: "Harald Armin Massa" To: PFC Subject: Re: Data transfer very slow when connected via DSL Cc: "Rainer Bauer" , pgsql-performance@postgresql.org In-Reply-To: MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_115576_30027209.1182516312948" References: <7be3f35d0706210801p732f2e73o147e3cbc0dc98153@mail.gmail.com> <7be3f35d0706220324n1b8a41e1q7d235970044da689@mail.gmail.com> X-Virus-Scanned: Maia Mailguard 1.0.1 X-Archive-Number: 200706/533 X-Sequence-Number: 25566 ------=_Part_115576_30027209.1182516312948 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: quoted-printable Content-Disposition: inline PFC, > Correct. I use a pyro-remote server. On request this remote server copies > > the relevant rows into a temporary table, uses a copy_to Call to push > > them > > into a StringIO-Objekt (that's Pythons version of "In Memory File"), > > serializes that StringIO-Objekt, does a bz2-compression and transfers > the > > whole block via VPN. > > What about a SSH tunnel using data compression ? Setup on multiple Windows Workstations in multiple Installations is not possible. > If you fetch all rows from a query in one go, would it be fast ? I tried the same copy_to via VPN. It took 10-50x the time it took locally. >Also, PG can now COPY from a query, so you don't really need the temp table... I know, but was stuck to 8.1 on some servers. Best wishes, Harald --=20 GHUM Harald Massa persuadere et programmare Harald Armin Massa Spielberger Stra=DFe 49 70435 Stuttgart 0173/9409607 fx 01212-5-13695179 - EuroPython 2007 will take place in Vilnius, Lithuania from Monday 9th July to Wednesday 11th July. See you there! ------=_Part_115576_30027209.1182516312948 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline PFC,

= > Correct. I use a pyro-remote server. On request this remote server cop= ies
> the relevant rows into a temporary table, uses a copy_to Call to p= ush
> them
> into a StringIO-Objekt (that's Pythons version= of "In Memory File"),
> serializes that StringIO-Objekt, d= oes a bz2-compression and transfers the
> whole block via VPN.

>  &nbs= p;    What about a SSH tunnel using data compression ?
Se= tup on multiple Windows Workstations in multiple Installations is not possi= ble.

> If you fetch all rows from a query in one go, would it be = fast ?
I tried the same copy_to via VPN. It took 10-50x the time it took local= ly.

>Also, PG can now COPY from a query, so you don't really = need the temp table...
I know, but was stuck to 8.1 on some servers.=20

Best wishes,

Harald

--
GHUM Harald Ma= ssa
persuadere et programmare
Harald Armin Massa
Spielberger Stra= =DFe 49
70435 Stuttgart
0173/9409607
fx 01212-5-13695179
-
EuroPython 2007 will take place in Vilnius, Lithuania from Monday 9th July = to Wednesday 11th July. See you there!
------=_Part_115576_30027209.1182516312948--