X-Original-To: pgsql-performance-postgresql.org@localhost.postgresql.org Received: from localhost (unknown [200.46.204.144]) by svr1.postgresql.org (Postfix) with ESMTP id A3ABC3A4539 for ; Mon, 1 Nov 2004 14:05:30 +0000 (GMT) Received: from svr1.postgresql.org ([200.46.204.71]) by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024) with ESMTP id 33252-04 for ; Mon, 1 Nov 2004 14:05:18 +0000 (GMT) Received: from candle.pha.pa.us (candle.pha.pa.us [207.106.42.251]) by svr1.postgresql.org (Postfix) with ESMTP id F3C683A4530 for ; Mon, 1 Nov 2004 14:05:18 +0000 (GMT) Received: (from pgman@localhost) by candle.pha.pa.us (8.11.6/8.11.6) id iA1E4i407690; Mon, 1 Nov 2004 09:04:44 -0500 (EST) From: Bruce Momjian Message-Id: <200411011404.iA1E4i407690@candle.pha.pa.us> Subject: Re: psql large RSS (1.6GB) In-Reply-To: To: Gavin Sherry Date: Mon, 1 Nov 2004 09:04:44 -0500 (EST) Cc: Dustin Sallings , TTK Ciar , pgsql-performance@postgresql.org X-Mailer: ELM [version 2.4ME+ PL108 (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-Virus-Scanned: by amavisd-new at hub.org X-Spam-Status: No, hits=0.0 tagged_above=0.0 required=5.0 tests= X-Spam-Level: X-Archive-Number: 200411/4 X-Sequence-Number: 8958 Gavin Sherry wrote: > On Sat, 30 Oct 2004, Dustin Sallings wrote: > > > > If the solution is to just write a little client that uses perl > > > DBI to fetch rows one at a time and write them out, that's doable, > > > but it would be nice if psql could be made to "just work" without > > > the monster RSS. > > > > It wouldn't make a difference unless that driver implements the > > underlying protocol on its own. > > Even though we can tell people to make use of cursors, it seems that > memory usage for large result sets should be addressed. A quick search of > the archives does not reveal any discussion about having libpq spill to > disk if a result set reaches some threshold. Has this been canvassed in > the past? No, I don't remember hearing this discussed and I don't think most people would want libpq spilling to disk by default. -- Bruce Momjian | http://candle.pha.pa.us pgman@candle.pha.pa.us | (610) 359-1001 + If your life is a hard drive, | 13 Roberts Road + Christ can be your backup. | Newtown Square, Pennsylvania 19073