pg.ddx.io  pgsql-php@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Marco Dieckhoff <marco.dieckhoff@googlemail.com>
To: pgsql-php@postgresql.org
Subject: Re: large resultset
Date: Tue, 15 Jun 2010 11:49:57 +0200
Message-ID: <4C174CC5.5080708@googlemail.com> (raw)
In-Reply-To: <8f468dc246fb6075f2a1f46b09f71a6d@xs4all.nl>
References: <AANLkTinXSz6PsoTyPhryAHsN3V-M0v-m3sTCLTJSJttO@mail.gmail.com>
	<AANLkTimP7qSASY3dRA09p6e35CzRLo8pOyZ6J5_5Bisx@mail.gmail.com>
	<8f468dc246fb6075f2a1f46b09f71a6d@xs4all.nl>

Am 15.06.2010 11:40, schrieb vinny:
> On Tue, 15 Jun 2010 10:33:05 +0100, Thom Brown<thombrown@gmail.com>
> wrote:
>    
>> On 15 June 2010 09:31, AI Rumman  wrote:
>>   How to return large resutlset (almost 2 millions record) in php?
>>
>>
>> Obviously that wouldn't do by itself, but it's quite simple to loop over
>> a result set.
>>      
> If that's the case surely you'd use some SQL to merge the data into one
> long string and return it in a single record.
> Looping over two million results is going to take a while, not to mention
> quite a bit of memory.
> v.
>    

huh?

Returning one large record containg the information of two million 
records will almost certainly fill up your memory.
First the memory of the sql server, in order to process the combination 
of two million records, and if that's even successfull, the memory of 
the server processing php.

Looping may take "a little" longer, but as only one row at a time is 
fetched, it should be the least possible memory use.

In most cases, you don't want to process every two million datasets in 
php anyway.
You may want to aggregate the data or maybe use created functions on the 
sql server.


regards,
Marco




view thread (14+ messages)  latest in thread

Message-ID: <4C174CC5.5080708@googlemail.com>
Permalink:  ../4C174CC5.5080708@googlemail.com/
Also on:    postgresql.org/message-id/4C174CC5.5080708@googlemail.com

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients from your mail client; the link fills in
  the headers below: reply via email
  Some clients, webmail especially, drop In-Reply-To and References from
  a link, and the reply then starts a new thread: use the mbox below.

  To: pgsql-php@postgresql.org
  Cc: marco.dieckhoff@googlemail.com
  Subject: Re: large resultset
  In-Reply-To: <4C174CC5.5080708@googlemail.com>
  References: <AANLkTinXSz6PsoTyPhryAHsN3V-M0v-m3sTCLTJSJttO@mail.gmail.com> <AANLkTimP7qSASY3dRA09p6e35CzRLo8pOyZ6J5_5Bisx@mail.gmail.com> <8f468dc246fb6075f2a1f46b09f71a6d@xs4all.nl> <4C174CC5.5080708@googlemail.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox