Received: from localhost (wm.hub.org [200.46.204.128]) by postgresql.org (Postfix) with ESMTP id CAA1E9FA088 for ; Tue, 3 Oct 2006 05:20:57 -0300 (ADT) Received: from postgresql.org ([200.46.204.71]) by localhost (mx1.hub.org [200.46.204.128]) (amavisd-new, port 10024) with ESMTP id 27827-02 for ; Tue, 3 Oct 2006 08:20:52 +0000 (UTC) X-Greylist: from auto-whitelisted by SQLgrey- Received: from mail.logix-tt.com (mail.logix-tt.com [212.211.145.186]) by postgresql.org (Postfix) with ESMTP id 306B19FB1EE for ; Tue, 3 Oct 2006 05:20:52 -0300 (ADT) Received: from kingfisher.intern.logix-tt.com (84-72-188-217.dclient.hispeed.ch [84.72.188.217]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.logix-tt.com (Postfix) with ESMTP id AE65D65978; Tue, 3 Oct 2006 10:23:15 +0200 (CEST) Received: from [127.0.0.1] (localhost [127.0.0.1]) by kingfisher.intern.logix-tt.com (Postfix) with ESMTP id F25C018151EB9; Tue, 3 Oct 2006 10:20:45 +0200 (CEST) Message-ID: <45221D5D.2020003@logix-tt.com> Date: Tue, 03 Oct 2006 10:20:45 +0200 From: Markus Schaber Organization: Logical Tracking and Tracing International AG, Switzerland User-Agent: Thunderbird 1.5.0.5 (X11/20060812) MIME-Version: 1.0 To: Carlo Stonebanks Cc: pgsql-performance@postgresql.org Subject: Re: Performace Optimization for Dummies References: <1159527507.2767.294.camel@holly> In-Reply-To: X-Enigmail-Version: 0.94.0.0 Content-Type: text/plain; charset=ISO-8859-15 Content-Transfer-Encoding: 7bit X-Virus-Scanned: Maia Mailguard 1.0.1 X-Spam-Status: No, hits=0.135 tagged_above=0 required=5 tests=FORGED_RCVD_HELO X-Spam-Level: X-Archive-Number: 200610/25 X-Sequence-Number: 21154 Hi, Carlo, Carlo Stonebanks wrote: >> Trying to achieve a high level of data quality in one large project is >> not often possible. Focus on the most critical areas of checking and get >> that working first with acceptable performance, then layer on additional >> checks while tuning. The complexity of the load programs you have also >> means they are susceptible to introducing data quality problems rather >> than removing them, so an incremental approach will also aid debugging >> of the load suite. > > I couldn't agree more. I still think that using a PL in the backend might be more performant than having an external client, alone being the SPI interface more efficient compared to the network serialization for external applications. HTH, Markus -- Markus Schaber | Logical Tracking&Tracing International AG Dipl. Inf. | Software Development GIS Fight against software patents in Europe! www.ffii.org www.nosoftwarepatents.org