Received: from makus.postgresql.org ([98.129.198.125]) by malur.postgresql.org with esmtp (Exim 4.72) (envelope-from ) id 1TGFq2-0006PG-8n for pgsql-admin@postgresql.org; Mon, 24 Sep 2012 21:05:10 +0000 Received: from larissa.perathoner.de ([85.10.209.172]) by makus.postgresql.org with esmtp (Exim 4.72) (envelope-from ) id 1TGFpz-0001Vd-SF for pgsql-admin@postgresql.org; Mon, 24 Sep 2012 21:05:09 +0000 Received: from p5b00312e.dip.t-dialin.net ([91.0.49.46] helo=[192.168.178.39]) by larissa.perathoner.de with esmtpsa (TLS1.0:RSA_AES_256_CBC_SHA1:32) (Exim 4.72) (envelope-from ) id 1TGFpw-0001F7-Hl; Mon, 24 Sep 2012 23:05:05 +0200 Message-ID: <5060CAFF.8040203@perathoner.de> Date: Mon, 24 Sep 2012 23:05:03 +0200 From: Marcello Perathoner User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:10.0.6esrpre) Gecko/20120817 Icedove/10.0.6 MIME-Version: 1.0 To: Dennis Brouwer CC: pgsql-admin@postgresql.org References: In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-SA-Exim-Connect-IP: 91.0.49.46 X-SA-Exim-Rcpt-To: dennis.brouwer@m4n.nl, pgsql-admin@postgresql.org X-SA-Exim-Mail-From: marcello@perathoner.de X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on larissa.perathoner.de X-Spam-Level: X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.3.1 Subject: Re: CPU causes 100% load in user space when ntp client runs and postgresql is under heavy load X-SA-Exim-Version: 4.2.1 (built Mon, 22 Mar 2010 06:26:47 +0000) X-SA-Exim-Scanned: Yes (on larissa.perathoner.de) X-Pg-Spam-Score: -2.7 (--) X-Archive-Number: 201209/138 X-Sequence-Number: 40079 On 09/24/2012 03:53 PM, Dennis Brouwer wrote: > Last week I was repeatedly able to run all these tests on the database > without any issue but recently, all of a sudden at random, some of the > queries performed a factor 100 less. It may take hours to complete the > transaction. At the same moment we see a dramatic decrease in IO and the > CPU is nearly 100% busy in user space. > > After days of testing I may have found the cause: the ntp client. If I stop > the ntp client the problem vanishes. Any chance you are hitting this known linux bug in conjunction with a misconfigured ntp server? ie. does a # date -s now fix the cpu load? http://blog.mozilla.org/it/2012/06/30/mysql-and-the-leap-second-high-cpu-and-the-fix/comment-page-1/#comment-1471 http://serverfault.com/questions/403732/anyone-else-experiencing-high-rates-of-linux-server-crashes-during-a-leap-second -- Marcello Perathoner webmaster@gutenberg.org