X-Original-To: pgsql-performance-postgresql.org@localhost.postgresql.org Received: from localhost (unknown [200.46.204.144]) by svr1.postgresql.org (Postfix) with ESMTP id B1E803A45E8 for ; Mon, 1 Nov 2004 16:03:47 +0000 (GMT) Received: from svr1.postgresql.org ([200.46.204.71]) by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024) with ESMTP id 70925-08 for ; Mon, 1 Nov 2004 16:03:44 +0000 (GMT) Received: from sss.pgh.pa.us (sss.pgh.pa.us [66.207.139.130]) by svr1.postgresql.org (Postfix) with ESMTP id BB4CA3A45C6 for ; Mon, 1 Nov 2004 16:03:43 +0000 (GMT) Received: from sss2.sss.pgh.pa.us (tgl@localhost [127.0.0.1]) by sss.pgh.pa.us (8.13.1/8.13.1) with ESMTP id iA1G378r014204; Mon, 1 Nov 2004 11:03:07 -0500 (EST) To: Bruce Momjian Cc: Gavin Sherry , Dustin Sallings , TTK Ciar , pgsql-performance@postgresql.org Subject: Re: psql large RSS (1.6GB) In-reply-to: <200411011404.iA1E4i407690@candle.pha.pa.us> References: <200411011404.iA1E4i407690@candle.pha.pa.us> Comments: In-reply-to Bruce Momjian message dated "Mon, 01 Nov 2004 09:04:44 -0500" Date: Mon, 01 Nov 2004 11:03:07 -0500 Message-ID: <14203.1099324987@sss.pgh.pa.us> From: Tom Lane X-Virus-Scanned: by amavisd-new at hub.org X-Spam-Status: No, hits=0.0 tagged_above=0.0 required=5.0 tests= X-Spam-Level: X-Archive-Number: 200411/5 X-Sequence-Number: 8959 Bruce Momjian writes: > No, I don't remember hearing this discussed and I don't think most > people would want libpq spilling to disk by default. Far more useful would be some sort of streaming API to let the application process the rows as they arrive, or at least fetch the rows in small batches (the V3 protocol supports the latter even without any explicit use of a cursor). I'm not sure if this can be bolted onto the existing libpq framework reasonably, but that's the direction I'd prefer to go in. regards, tom lane