X-Original-To: pgsql-performance-postgresql.org@localhost.postgresql.org Received: from localhost (unknown [200.46.204.144]) by svr1.postgresql.org (Postfix) with ESMTP id 11F703A460C for ; Mon, 1 Nov 2004 18:50:07 +0000 (GMT) Received: from svr1.postgresql.org ([200.46.204.71]) by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024) with ESMTP id 25746-06 for ; Mon, 1 Nov 2004 18:49:52 +0000 (GMT) Received: from davinci.ethosmedia.com (server226.ethosmedia.com [209.128.84.226]) by svr1.postgresql.org (Postfix) with ESMTP id B4CB93A3B79 for ; Mon, 1 Nov 2004 18:49:52 +0000 (GMT) Received: from [63.195.55.98] (account josh@agliodbs.com HELO spooky) by davinci.ethosmedia.com (CommuniGate Pro SMTP 4.1.8) with ESMTP id 6591439; Mon, 01 Nov 2004 10:51:19 -0800 From: Josh Berkus Organization: Aglio Database Solutions To: pgsql-performance@postgresql.org Subject: Re: psql large RSS (1.6GB) Date: Mon, 1 Nov 2004 10:49:06 -0800 User-Agent: KMail/1.6.2 Cc: Tom Lane , Bruce Momjian , Gavin Sherry , Dustin Sallings , TTK Ciar References: <200411011404.iA1E4i407690@candle.pha.pa.us> <14203.1099324987@sss.pgh.pa.us> In-Reply-To: <14203.1099324987@sss.pgh.pa.us> MIME-Version: 1.0 Content-Disposition: inline Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Message-Id: <200411011049.06770.josh@agliodbs.com> X-Virus-Scanned: by amavisd-new at hub.org X-Spam-Status: No, hits=0.0 tagged_above=0.0 required=5.0 tests= X-Spam-Level: X-Archive-Number: 200411/7 X-Sequence-Number: 8961 Tom, > Far more useful would be some sort of streaming API to let the > application process the rows as they arrive, or at least fetch the rows > in small batches (the V3 protocol supports the latter even without any > explicit use of a cursor). =C2=A0I'm not sure if this can be bolted onto = the > existing libpq framework reasonably, but that's the direction I'd prefer > to go in. I think that TelegraphCQ incorporates this. However, I'm not sure whether= =20 it's a portable component; it may be too tied in to their streaming query=20 engine. They have talked about porting their "background query" patch for= =20 PSQL, though ... =2D-=20 Josh Berkus Aglio Database Solutions San Francisco