pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Pierre-Frédéric Caillaud <lists@boutiquenumerique.com>
To: pgsql-performance@postgresql.org
Subject: Re: Help with extracting large volumes of records across related tables
Date: Mon, 13 Sep 2004 16:00:35 +0200
Message-ID: <opsd9qi9udcq72hf@musicbox> (raw)
In-Reply-To: <005801c49997$d4a91a20$6e01a8c0@a31p005>
References: <005801c49997$d4a91a20$6e01a8c0@a31p005>


	Thanks for the thanks !

	Generally, when grouping stuff together, it is a good idea to have two  
sorted lists, and to scan them simultaneously. I have already used this  
solution several times outside of Postgres, and it worked very well (it  
was with Berkeley DB and there were 3 lists to scan in order). The fact  
that Python can very easily virtualize these lists using generators makes  
it possible to do it without consuming too much memory.

> Pierre-Frederic, Paul,
>
> Thanks for your fast response (especially for the python code and
> performance figure) - I'll chase this up as a solution - looks most
> promising!
>
> Cheers,
>
> Damien
>
>
> ---------------------------(end of broadcast)---------------------------
> TIP 6: Have you searched our list archives?
>
>                http://archives.postgresql.org
>





view thread (7+ messages)

Message-ID: <opsd9qi9udcq72hf@musicbox>
Permalink:  ../opsd9qi9udcq72hf@musicbox/
Also on:    postgresql.org/message-id/opsd9qi9udcq72hf@musicbox

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: lists@boutiquenumerique.com
  Subject: Re: Help with extracting large volumes of records across related tables
  In-Reply-To: <opsd9qi9udcq72hf@musicbox>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox