Date: Thu, 04 Nov 2010 14:38:23 +0000
From: Nick Matheson <Nick.D.Matheson@noaa.gov>
Subject: Re: Simple (hopefully) throughput question?
In-reply-to: <4CD19E84.7070204@squeakycode.net>
To: Andy Colson <andy@squeakycode.net>
Cc: pgsql-performance@postgresql.org
Message-id: <4CD2C55F.3040307@noaa.gov>
MIME-version: 1.0
Content-type: text/plain; charset=ISO-8859-1; format=flowed
Content-transfer-encoding: 7BIT
User-Agent: Thunderbird 2.0.0.24 (X11/20101005)
References: <4CD1853F.2010800@noaa.gov> <4CD19E84.7070204@squeakycode.net>

Andy-
> I have no idea if this would be helpful or not, never tried it, but 
> when you fire off "select * from bigtable" pg will create the entire 
> resultset in memory (and maybe swap?) and then send it all to the 
> client in one big lump.  You might try a cursor and fetch 100-1000 at 
> a time from the cursor.  No idea if it would be faster or slower.
I am pretty sure we have tried paged datasets and didn't see any 
improvement. But we will put this on our list of things to double check, 
better safe than sorry you know.

Thanks,

Nick