Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.72) (envelope-from ) id 1U7bFi-0004ub-Tf for pgsql-performance@arkaria.postgresql.org; Tue, 19 Feb 2013 00:40:11 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.72) (envelope-from ) id 1U7bFh-00061B-Ah for pgsql-performance@arkaria.postgresql.org; Tue, 19 Feb 2013 00:40:09 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtp (Exim 4.72) (envelope-from ) id 1U7bFg-000610-97 for pgsql-performance@postgresql.org; Tue, 19 Feb 2013 00:40:08 +0000 Received: from outmail149085.authsmtp.co.uk ([62.13.149.85]) by magus.postgresql.org with esmtp (Exim 4.72) (envelope-from ) id 1U7bFc-0000a2-DZ for pgsql-performance@postgresql.org; Tue, 19 Feb 2013 00:40:07 +0000 Received: from mail-c233.authsmtp.com (mail-c233.authsmtp.com [62.13.128.233]) by punt9.authsmtp.com (8.14.2/8.14.2/Kp) with ESMTP id r1J0e1CV000738; Tue, 19 Feb 2013 00:40:01 GMT Received: from [172.47.23.103] (70-36-143-10.dsl.dynamic.sonic.net [70.36.143.10]) (authenticated bits=0) by mail.authsmtp.com (8.14.2/8.14.2/) with ESMTP id r1J0dxFc053250; Tue, 19 Feb 2013 00:39:59 GMT Message-ID: <5122C9D9.9040909@agliodbs.com> Date: Mon, 18 Feb 2013 16:39:53 -0800 From: Josh Berkus Organization: PostgreSQL Experts Inc. User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/20130106 Thunderbird/17.0.2 MIME-Version: 1.0 To: Scott Marlowe CC: postgres performance list Subject: Re: High CPU usage / load average after upgrading to Ubuntu 12.04 References: <60B572D9298D944580F7D51195DD30804357FA4ABF@VMBX125.ihostexchange.net> <60B572D9298D944580F7D51195DD30804357FA4B60@VMBX125.ihostexchange.net> <60B572D9298D944580F7D51195DD30804357FA4C11@VMBX125.ihostexchange.net> <511BE879.8080706@agliodbs.com> <511C2F10.3080409@agliodbs.com> <60B572D9298D944580F7D51195DD30804357FA4DE2@VMBX125.ihostexchange.net> <511D2F11.6040706@agliodbs.com> <60B572D9298D944580F7D51195DD308043580CAA0B@VMBX125.ihostexchange.net> <511D79FE.7060705@agliodbs.com> <60B572D9298D944580F7D51195DD308043580CAA87@VMBX125.ihostexchange.net> <511E7DC0.4090506@agliodbs.com> <5122C507.7060303@agliodbs.com> In-Reply-To: X-Enigmail-Version: 1.5 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Server-Quench: e47bb942-7a2c-11e2-a49c-0025907707a1 X-AuthReport-Spam: If SPAM / abuse - report it at: http://www.authsmtp.com/abuse X-AuthRoute: OCdyZgscClZXSx8a IioLCC5HRQ8+YBZL BAkGMA9GIUINWEQL c1ADfx19PVdbHwkA AHYLW15QUFdxWS1y axRSaxtcZklQXgV1 UktWQhwQFX9oVVR3 VR4bURt3d0tCf310 KxNmWSIJVUB4aEEs QB1JFGxTZ3oxbGlM TUBYdQZdcARNfhgU ax4dAXkdCgVyBAwf JSoGdxAwMjUXAxxo ChwWJF0fCQFDGjk1 S1gLAzg1FEIIDyw9 MxE8YkMEE1wYPkQ0 PhM9XholOQIUFhA8 VxgXRncFT/D/ X-Authentic-SMTP: 61633136333939.1021:706 X-AuthFastPath: 0 (Was 255) X-AuthSMTP-Origin: 70.36.143.10/23 X-AuthVirus-Status: No virus detected - but ensure you scan with your own anti-virus system. X-Pg-Spam-Score: -2.6 (--) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-performance Precedence: bulk Sender: pgsql-performance-owner@postgresql.org Scott, > So do you have generally slow IO, or is it fsync behavior etc? All tests except pgBench show this system as superfast. Bonnie++ and DD tests are good (200 to 300mb/s), and test_fsync shows 14K/second. Basically it has no issues until checkpoint kicks in, at which time the entire system basically halts for the duration of the checkpoint. For that matter, if I run a pgbench and halt it just before checkpoint kicks in, I get around 12000TPS, which is what I'd expect on this system. At this point, we've tried 3.2.0.26, 3.2.0.27, 3.4.0, and tried updating the RAID driver, and changing the IO scheduler. Nothing seems to affect the behavior. Testing using Ext4 (instead of XFS) next. -- Josh Berkus PostgreSQL Experts Inc. http://pgexperts.com -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance