Received: from localhost (unknown [200.46.204.183]) by developer.postgresql.org (Postfix) with ESMTP id 184A12E0033 for ; Wed, 4 Jun 2008 17:10:47 -0300 (ADT) Received: from developer.postgresql.org ([200.46.204.71]) by localhost (mx1.hub.org [200.46.204.183]) (amavisd-maia, port 10024) with ESMTP id 45831-05 for ; Wed, 4 Jun 2008 17:10:38 -0300 (ADT) X-Greylist: from auto-whitelisted by SQLgrey-1.7.6 Received: from ptb-relay03.plus.net (ptb-relay03.plus.net [212.159.14.214]) by developer.postgresql.org (Postfix) with ESMTP id 57B012E0038 for ; Wed, 4 Jun 2008 17:10:41 -0300 (ADT) Received: from [80.229.150.39] (helo=pd600.barnhouse) by ptb-relay03.plus.net with esmtp (Exim) id 1K3zJe-0006uc-Sp; Wed, 04 Jun 2008 21:10:39 +0100 Received: from [192.168.0.87] (unknown [192.168.0.87]) by pd600.barnhouse (Postfix) with ESMTP id 296A94E1C2B; Wed, 4 Jun 2008 21:17:23 +0100 (BST) Message-ID: <4846F7F1.1050408@mansionfamily.plus.com> Date: Wed, 04 Jun 2008 21:15:45 +0100 From: James Mansion Organization: MsgWare User-Agent: Thunderbird 2.0.0.14 (Windows/20080421) MIME-Version: 1.0 To: Matthew Wakeling CC: andrew klassen , pgsql-performance@postgresql.org Subject: Re: insert/update tps slow with indices on table > 1M rows References: <691681.3510.qm@web37304.mail.mud.yahoo.com> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Plusnet-Relay: 1aac9a3bc1efca50e2198302ffcd82d8 X-Virus-Scanned: Maia Mailguard 1.0.1 X-Archive-Number: 200806/27 X-Sequence-Number: 30377 Matthew Wakeling wrote: > If you're running a "work queue" architecture, that probably means you > only have one thread doing all the updates/inserts? It might be worth > going multi-threaded, and issuing inserts and updates through more > than one connection. Postgres is designed pretty well to scale > performance by the number of simultaneous connections. That would explain a disappointing upper limit on insert rate, but not any sort of cliff for the rate. Nor, really, any material slowdown, if the single thread implies that we're stuck on round trip latency as a material limiting factor. James