X-Original-To: pgsql-performance-postgresql.org@localhost.postgresql.org Received: from localhost (unknown [200.46.204.144]) by svr1.postgresql.org (Postfix) with ESMTP id E49548B9F87 for ; Wed, 9 Feb 2005 15:00:37 +0000 (GMT) Received: from svr1.postgresql.org ([200.46.204.71]) by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024) with ESMTP id 03000-09 for ; Wed, 9 Feb 2005 15:00:23 +0000 (GMT) Received: from m-monitor.net (unknown [207.44.134.28]) by svr1.postgresql.org (Postfix) with ESMTP id EBAF48B9D0A for ; Wed, 9 Feb 2005 15:00:25 +0000 (GMT) Received: (qmail 19445 invoked from network); 9 Feb 2005 15:00:26 -0000 Received: from 203-173-49-188.dyn.iinet.net.au (HELO ?127.0.0.1?) (203.173.49.188) by ev1s-207-44-134-28.ev1servers.net with SMTP; 9 Feb 2005 15:00:26 -0000 Message-ID: <420A2580.3040404@meerkatsoft.com> Date: Thu, 10 Feb 2005 02:00:16 +1100 From: Alex User-Agent: Mozilla Thunderbird 0.9 (Windows/20041103) X-Accept-Language: en-us, en MIME-Version: 1.0 To: John A Meinel Cc: pgsql-performance@postgresql.org Subject: Re: How can I make use of both CPUs in a dual processor References: <420A1D9B.1040801@meerkatsoft.com> <420A22E7.5010501@arbash-meinel.com> In-Reply-To: <420A22E7.5010501@arbash-meinel.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: by amavisd-new at hub.org X-Spam-Status: No, hits=0.038 tagged_above=0 required=5 tests=AWL, FORGED_RCVD_HELO X-Spam-Level: X-Archive-Number: 200502/138 X-Sequence-Number: 10467 Thanks John. Well as I mentioned. I have a Dual AMD Opteron 64 2.4ghz, 15k rpm SCSI Disks, 4GB of memory. Disks are pretty fast and memory should be more than enough. Currently we dont have many concurrent connections. I run PG 8.0.1 on Fedora Core 3 When I now run the batch job, one CPU runs in the 80-90% the other in 5-10% max. John A Meinel wrote: > Alex wrote: > >> Hi, >> we just got a new dual processor machine and I wonder if there is a >> way to utilize both processors. >> >> Our DB server is basically fully dedicated to postgres. (its a dual >> amd with 4gb mem.) >> >> I have a batch job that periodically loads about 8 million records >> into a table. >> for this I drop the indices, truncate the table, use the copy to >> insert the data, recreate the indices (4 indices), vacuum the table. >> >> That is all done through a perl batch job. >> >> While I am doing this, I noticed that only one CPU is really used. >> >> So here are my questions: >> >> Is there a way to utilize both CPUs >> > For postgres, you get a max of 1 CPU per connection, so to use both, > you need 2 CPU's. > >> Is it possible to split up the import file and run 2 copy processes >> >> Is it possible to create 2 indices at the same time >> > You'd want to be a little careful. Postgres uses work_mem for vacuum > and index creation, so if you have 2 processes doing it, just make > sure you aren't running out of RAM and going to swap. > >> Would I actually gain anything from that, or is the bottleneck >> somewhere else ? >> > More likely, the bottleneck would be disk I/O. Simply because it is > almost always disk I/O. However, without knowing your configuration, > how much CPU is used during the operation, etc, it's hard to say. > >> (perl is a given here for the batch job) >> >> If anyone has some experience or ideas... any hints or help on this >> would be appreciated. >> >> Thanks >> Alex >> > Sorry I wasn't a lot of help. You should probably post your postgres > version, and more information about how much CPU load there is while > your load is running. > > John > =:-> >