X-Original-To: pgsql-performance-postgresql.org@localhost.postgresql.org Received: from localhost (unknown [200.46.204.144]) by svr1.postgresql.org (Postfix) with ESMTP id 033BE329E01 for ; Mon, 13 Sep 2004 14:04:47 +0100 (BST) Received: from svr1.postgresql.org ([200.46.204.71]) by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024) with ESMTP id 81174-08 for ; Mon, 13 Sep 2004 13:04:39 +0000 (GMT) Received: from boutiquenumerique.com (gailleton-2-82-67-9-10.fbx.proxad.net [82.67.9.10]) by svr1.postgresql.org (Postfix) with ESMTP id 71984329DB0 for ; Mon, 13 Sep 2004 14:04:42 +0100 (BST) Received: (qmail 490 invoked from network); 13 Sep 2004 15:04:51 +0200 Received: from unknown (HELO musicbox) (192.168.0.2) by gailleton-2-82-67-9-10.fbx.proxad.net with SMTP; 13 Sep 2004 15:04:51 +0200 Date: Mon, 13 Sep 2004 15:05:43 +0200 To: pgsql-performance@postgresql.org Subject: Re: Help with extracting large volumes of records across related tables References: <004b01c49986$228c3d60$6e01a8c0@a31p005> <20040913131023.A6743@bacon> From: =?iso-8859-15?Q?Pierre-Fr=E9d=E9ric_Caillaud?= Organization: =?iso-8859-15?Q?La_Boutique_Num=E9rique?= Content-Type: text/plain; format=flowed; delsp=yes; charset=iso-8859-15 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Message-ID: In-Reply-To: <20040913131023.A6743@bacon> User-Agent: Opera M2/7.53 (Linux, build 737) X-Virus-Scanned: by amavisd-new at hub.org X-Spam-Status: No, hits=0.0 tagged_above=0.0 required=5.0 tests= X-Spam-Level: X-Archive-Number: 200409/86 X-Sequence-Number: 8214 My simple python program dumps 1653992 items in 1654000 categories in : real 3m12.029s user 1m36.720s sys 0m2.220s It was running on the same machine as postgresql (AthlonXP 2500). I Ctrl-C'd it before it dumped all the database but you get an idea. If you don't know Python and Generators, have a look !