X-Original-To: pgsql-performance-postgresql.org@localhost.postgresql.org Received: from localhost (unknown [200.46.204.144]) by svr1.postgresql.org (Postfix) with ESMTP id CEEF6536C1 for ; Tue, 5 Apr 2005 00:28:32 +0100 (BST) Received: from svr1.postgresql.org ([200.46.204.71]) by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024) with ESMTP id 07948-03 for ; Mon, 4 Apr 2005 23:28:22 +0000 (GMT) Received: from rproxy.gmail.com (rproxy.gmail.com [64.233.170.207]) by svr1.postgresql.org (Postfix) with ESMTP id A5FD05366D for ; Tue, 5 Apr 2005 00:28:21 +0100 (BST) Received: by rproxy.gmail.com with SMTP id j1so1330783rnf for ; Mon, 04 Apr 2005 16:28:25 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:references; b=SS15FlNIbczgMaP3vC78qu5k/TrRylKBdjvzqJeLgkskog5FuxMMGZwwmxvMgqJhl3CxZoX3ixKlUgucNxKseQ+MvC03t55DyHhdXeJ+hnnzWADSla20kl69/OHtGF6T3zigh2hUulyKUtdcwJsQM0VLbQBzhAM+mLq+27m3+CQ= Received: by 10.38.15.55 with SMTP id 55mr5586964rno; Mon, 04 Apr 2005 16:28:25 -0700 (PDT) Received: by 10.38.126.31 with HTTP; Mon, 4 Apr 2005 16:28:25 -0700 (PDT) Message-ID: Date: Mon, 4 Apr 2005 23:28:25 +0000 From: Mike Rylander Reply-To: Mike Rylander To: Simon Riggs Subject: Re: Sustained inserts per sec ... ? Cc: pgsql-performance@postgresql.org In-Reply-To: <1112654640.16721.859.camel@localhost.localdomain> Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit References: <20050401140421.P18194@ganymede.hub.org> <59d991c4050401125956d6069d@mail.gmail.com> <59d991c40504040648457808e9@mail.gmail.com> <1112644015.16721.790.camel@localhost.localdomain> <59d991c4050404125611ad5af8@mail.gmail.com> <1112645479.16721.806.camel@localhost.localdomain> <59d991c405040413184699cfe1@mail.gmail.com> <1112648303.16721.816.camel@localhost.localdomain> <59d991c4050404140333bff1ed@mail.gmail.com> <1112654640.16721.859.camel@localhost.localdomain> X-Virus-Scanned: by amavisd-new at hub.org X-Spam-Status: No, hits=0.065 tagged_above=0 required=5 tests=AWL, RCVD_BY_IP X-Spam-Level: X-Archive-Number: 200504/71 X-Sequence-Number: 11468 If I'm getting the point of this thread correctly, have a huge amount of data in one table degrades INSERT/COPY performance even with just a PKEY index. If that's about the size of it, read on. If not, ignore me because I missed something. On Apr 4, 2005 10:44 PM, Simon Riggs wrote: > Before I start to tunnel-vision on a particular coincidence... > Don't worry too much about tunnel vision. I see the same thing every day with multi-million row tables. The bigger the table gets (with only a pkey index) the slower the inserts go. If I start over (truncate, drop/create table), or if I point the initial load at a new table, everything gets speedy. I've always figured it was a function of table size and learned to live with it... > How much memory have you got on the system? On mine, 16G > How much of that have you allocated to various tasks? shared buffers: 15000 > What else is happening on your system? Nothing on mine. > Tell us more about disk set-up and other hardware related things. 6-disk RAID10 on a Compaq SmartArray 6404 with 256M BB cache, WAL on 2-disk mirror on built in SmartArray5 controller. -- Mike Rylander mrylander@gmail.com GPLS -- PINES Development Database Developer http://open-ils.org