Received: from localhost (maia-2.hub.org [200.46.204.187]) by postgresql.org (Postfix) with ESMTP id EAAF89FB4EB for ; Fri, 22 Jun 2007 07:24:25 -0300 (ADT) Received: from postgresql.org ([200.46.204.71]) by localhost (mx1.hub.org [200.46.204.187]) (amavisd-maia, port 10024) with ESMTP id 65961-01 for ; Fri, 22 Jun 2007 07:24:15 -0300 (ADT) X-Greylist: domain auto-whitelisted by SQLgrey-1.7.5 Received: from wa-out-1112.google.com (wa-out-1112.google.com [209.85.146.183]) by postgresql.org (Postfix) with ESMTP id 807F89FB4E5 for ; Fri, 22 Jun 2007 07:24:19 -0300 (ADT) Received: by wa-out-1112.google.com with SMTP id k40so766373wah for ; Fri, 22 Jun 2007 03:24:17 -0700 (PDT) DKIM-Signature: a=rsa-sha1; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:references; b=UFJD4IXTfgefNhpOb7JHX8WcJzTPWe/IbH47dgpCuR84x4Kz0HeaeOfQgWb9BtR1d1xjoYPFN0Gu15kd0fCrb5sga4x44Igv0nXqbRmqaF2s1Y/a6YaIw3umayQ1ZSBW5UNInssS0SpQMzpCrgBzmw5e/ZAgPHEmDyRymsH4nEQ= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:references; b=qK4bFP98LvHktytW3M/YAX8/LqWeE5CeEH38qK9lCvYDCpXWQNk6FLoan5C1tzB32SXAHvcc+5Yn7K9lrsXp52hqew253ektULQ7w0yLRG2FsjrVScAFmWAIh936+8dOmWwRVMDyyG4UmUwk5I+IgJk2fyEulC0ev2LpyT01h+g= Received: by 10.114.112.1 with SMTP id k1mr2848337wac.1182507856504; Fri, 22 Jun 2007 03:24:16 -0700 (PDT) Received: by 10.114.112.16 with HTTP; Fri, 22 Jun 2007 03:24:16 -0700 (PDT) Message-ID: <7be3f35d0706220324n1b8a41e1q7d235970044da689@mail.gmail.com> Date: Fri, 22 Jun 2007 12:24:16 +0200 From: "Harald Armin Massa" To: "Rainer Bauer" Subject: Re: Data transfer very slow when connected via DSL Cc: pgsql-performance@postgresql.org In-Reply-To: MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_114580_20341236.1182507856455" References: <7be3f35d0706210801p732f2e73o147e3cbc0dc98153@mail.gmail.com> X-Virus-Scanned: Maia Mailguard 1.0.1 X-Archive-Number: 200706/521 X-Sequence-Number: 25554 ------=_Part_114580_20341236.1182507856455 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: quoted-printable Content-Disposition: inline Rainer, >I did not find a solution so far; and for bulk data transfers I now > >programmed a workaround. > > But that is surely based on some component installed on the server, isn't > it? > Correct. I use a pyro-remote server. On request this remote server copies the relevant rows into a temporary table, uses a copy_to Call to push them into a StringIO-Objekt (that's Pythons version of "In Memory File"), serializes that StringIO-Objekt, does a bz2-compression and transfers the whole block via VPN. I read on in this thread, and I scheduled to check on psycopg2 and what it is doing with cursors. Harald --=20 GHUM Harald Massa persuadere et programmare Harald Armin Massa Spielberger Stra=DFe 49 70435 Stuttgart 0173/9409607 fx 01212-5-13695179 - EuroPython 2007 will take place in Vilnius, Lithuania from Monday 9th July to Wednesday 11th July. See you there! ------=_Part_114580_20341236.1182507856455 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline Rainer,

>I did not find a solution so far; and for bulk data transfers I now<= br> >programmed a workaround.

But that is surely based on some compon= ent installed on the server, isn't it?

Correc= t. I use a pyro-remote server. On request this remote server copies the rel= evant rows into a temporary table, uses a copy_to Call to push them into a = StringIO-Objekt (that's Pythons version of "In Memory File"),= serializes that StringIO-Objekt, does a bz2-compression and transfers the = whole block via VPN.

I read on in this thread, and I scheduled to check on psycopg2 and = what it is doing with cursors.

Harald

--
GHUM Harald Mass= a
persuadere et programmare
Harald Armin Massa
Spielberger Stra=DF= e 49
70435 Stuttgart
0173/9409607
fx 01212-5-13695179
-
EuroPyt= hon 2007 will take place in Vilnius, Lithuania from Monday 9th July to Wedn= esday 11th July. See you there!
------=_Part_114580_20341236.1182507856455--