Received: from localhost (postgresql.org [64.49.215.8]) by postgresql.org (Postfix) with ESMTP id 9200147580B for ; Sun, 8 Sep 2002 19:38:28 -0400 (EDT) Received: from fileserver.mwk.co.nz (unknown [210.55.107.146]) by postgresql.org (Postfix) with ESMTP id 3FF79475FEA for ; Sun, 8 Sep 2002 19:38:26 -0400 (EDT) Received: from termsrvr (unknown [172.31.31.4]) by fileserver.mwk.co.nz (Postfix) with SMTP id 1ADAFC15D for ; Mon, 9 Sep 2002 11:38:15 +1200 (NZST) Message-ID: <005601c25791$03ca28d0$041f1fac@termsrvr> From: "John huttley" To: "pgsql-interfaces" References: Subject: Need for speed Date: Mon, 9 Sep 2002 11:39:46 +1200 MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 5.50.4807.1700 X-MimeOLE: Produced By Microsoft MimeOLE V5.50.4910.0300 X-Virus-Scanned: by AMaViS new-20020517 X-Archive-Number: 200209/49 X-Sequence-Number: 3110 Hello, I'm writing an application in C and speed is critical. I'm doing inserts into 2 tables, both with only a few char fields. 1 insert using 'INSERT' 5 inserts using 'COPY' and there is a BEGIN and COMMIT around them. There are as few indexes as I can have and still query effectively. I cannot drop and recreate the indexes, since there will be asynchronous queries. I can't get more than 97 of these transactions per second. There will be 100 Million transactions or more. presently 150,000. So I would like x10 speed increase!! Postmaster shows 50->65% usage, system idle is 10->15% (700Mhz Althon, 386Mb RAM) vmstat shows about 20 Blks/in and 1500 Blks/out per sec. The disk is a 10000RPM SCSI. How can I get more speed? Should I try and get more inserts into each transaction? (Do BEGIN/COMMIT in separate thread with timer) Do you think its worth the effort to make that remaining INSERT into a COPY? Would managing a pool of asynchronous calls improve the speed? What about this fast path thing? it looks very complicated and under documented.. Any advice greatfully received, Regards John