pg.ddx.io  pgsql-interfaces@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Hannu Krosing <hannu@trust.ee>
To: Matthew Hagerty <matthew@venux.net>
Cc: pgsql-interfaces@postgreSQL.org
Subject: Re: [INTERFACES] Dealing with large query results
Date: Mon, 08 Feb 1999 23:25:32 +0200
Message-ID: <36BF564C.D1A9F8FA@trust.ee> (raw)
References: <4.1.19990208145905.00a0b8d0@mail.venux.net>

Matthew Hagerty wrote:
> 
> Greetings,
> 
> I keep seeing reference to an 8K limit on query results.  So how to deal
> with query results greater than 8K?  Am I under the wrong impression that
> when you run a query from, say libpq, that each retch row is returned only
> when you execute a fetchrow?  Or is the whole query stuffed in to a buffer
> which has an 8K limit?

the current 8K limit is for queries (and unrelatedly single rows), 
not query _results_
 
> I have to deal with some queries that create a huge result, and/or doing
> reports requires a large result set.  How can I deal with these larger results?

If you dont want to digest a huge result, you can do a 

DECLARE CURSOR - FETCH -FETCH - FETCH - CLOSE CURSOR thing to get it in
pieces

(needs to be inside BEGIN TRANSACTION - END TRANSACTION)
 
> I'll probably get flamed for asking this one but, how can I step through a
> table?  Hey, sometimes you just have to do it.

See above.

Actually postgres is quite happy to return gigabytes of data, if you
have 
the resources (disk space, memory, time ;)

--------------
Hannu



view thread (3+ messages)

Message-ID: <36BF564C.D1A9F8FA@trust.ee>
Permalink:  ../36BF564C.D1A9F8FA@trust.ee/
Also on:    postgresql.org/message-id/36BF564C.D1A9F8FA@trust.ee

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-interfaces@postgresql.org
  Cc: hannu@trust.ee, matthew@venux.net
  Subject: Re: [INTERFACES] Dealing with large query results
  In-Reply-To: <36BF564C.D1A9F8FA@trust.ee>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox