X-Original-To: pgsql-performance-postgresql.org@localhost.postgresql.org Received: from localhost (unknown [200.46.204.2]) by svr1.postgresql.org (Postfix) with ESMTP id 92DE4D1B50D for ; Fri, 14 Nov 2003 13:38:40 +0000 (GMT) Received: from svr1.postgresql.org ([200.46.204.71]) by localhost (neptune.hub.org [200.46.204.2]) (amavisd-new, port 10024) with ESMTP id 80821-09 for ; Fri, 14 Nov 2003 09:38:12 -0400 (AST) Received: from jefftrout.com (h00a0cc4084e5.ne.client2.attbi.com [24.128.241.68]) by svr1.postgresql.org (Postfix) with SMTP id 0D2A3D1B51C for ; Fri, 14 Nov 2003 09:38:08 -0400 (AST) Received: (qmail 90440 invoked from network); 14 Nov 2003 13:38:10 -0000 Received: from localhost (HELO squeegit) (threshar@127.0.0.1) by localhost with SMTP; 14 Nov 2003 13:38:10 -0000 Date: Fri, 14 Nov 2003 08:37:55 -0500 From: Jeff To: Slavisa Garic Cc: pgsql-performance@postgresql.org Subject: Re: INSERT extremely slow with large data sets (fwd) Message-Id: <20031114083755.67841110.threshar@torgo.978.org> In-Reply-To: References: X-Mailer: Sylpheed version 0.9.7 (GTK+ 1.2.10; i686-pc-linux-gnu) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Virus-Scanned: by amavisd-new at postgresql.org X-Archive-Number: 200311/108 X-Sequence-Number: 4668 On Fri, 14 Nov 2003 20:38:33 +1100 (EST) Slavisa Garic wrote: > Any help would be greatly appreciated even pointing me in the right > direction where to ask this question. By the way I designed the > database this way as my application that uses PGSQL a lot during the > execution so there was a huge need for fast SELECTs. Our experiments > are getting larger and larger every day so fast inserts would be good > as well. > First, you need to upgrade to 7.3.4, 7.4 is prefable if a dump/reload is not too bad. Standard set of questions: 1. Any foreign keys 2. are these inserts batched into transactions 3. CPU usage? 4. OS? 5. PG config? [shared_buffers, effective_cache_size, etc] 6. IO saturation? Also, try searching the archives. lots of juicy info there too. -- Jeff Trout http://www.jefftrout.com/ http://www.stuarthamm.net/