pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  

help / color / mirror / Atom feed
From: Jeff Frost <jeff@pgexperts.com>
To: pgsql-performance@postgresql.org
Subject: Re: High CPU usage / load average after upgrading to Ubuntu 12.04
Date: Mon, 25 Feb 2013 14:30:00 -0800
Message-ID: <512BE5E8.1040702@pgexperts.com> (raw)
In-Reply-To: <51259102.9040707@agliodbs.com>
References: <60B572D9298D944580F7D51195DD30804357FA4ABF@VMBX125.ihostexchange.net>
	<511BE879.8080706@agliodbs.com>
	<511C2F10.3080409@agliodbs.com>
	<60B572D9298D944580F7D51195DD30804357FA4DE2@VMBX125.ihostexchange.net>
	<511D2F11.6040706@agliodbs.com>
	<60B572D9298D944580F7D51195DD308043580CAA0B@VMBX125.ihostexchange.net>
	<511D79FE.7060705@agliodbs.com>
	<60B572D9298D944580F7D51195DD308043580CAA87@VMBX125.ihostexchange.net>
	<CAOR=d=3CqRL5jrFRTSg9kFdcJzKpx3TJSsoDwRqpPUO=ENoFRQ@mail.gmail.com>
	<511E7DC0.4090506@agliodbs.com>
	<CAOR=d=2cEi=ibGS4DCrFAWq8VtCz6XEYDsMyarBX=evshLWgKg@mail.gmail.com>
	<5122C507.7060303@agliodbs.com>
	<CAOR=d=3bXmMmTvh3cKCizhwsijxg6wh6ADC053w-dbkC3e_zCQ@mail.gmail.com>
	<5122FF50.8030903@catalyst.net.nz>
	<5123BB94.7030603@agliodbs.com>
	<512409AF.8010308@agliodbs.com>
	<CAOR=d=1u4vtxNX+xoMrX+-1G9DUu6QOZnLXu1moS2+XO1FX=WA@mail.gmail.com>
	<512551D2.9090407@agliodbs.com>
	<CAOR=d=1uh=MvS+fC0b-Q8ravmUwCz5301xZ4w3S-Y6gj8Hg71w@mail.gmail.com>
	<51259102.9040707@agliodbs .com>
List-Unsubscribe:  <mailto:majordomo@postgresql.org?body=unsub%20pgsql-performance>

On 02/20/13 19:14, Josh Berkus wrote:
>> Sounds to me like your IO system is stalling on fsyncs or something
>> like that.  On machines with plenty of IO cranking up completion
>> target usuall smooths things out. 
> It certainly seems like it does.  However, I can't demonstrate the issue
> using any simpler tool than pgbench ... even running four test_fsyncs in
> parallel didn't show any issues, nor do standard FS testing tools.
>

We were really starting to think that the system had an IO problem that we
couldn't tickle with any synthetic tools.  Then one of our other customers who
upgraded to Ubuntu 12.04 LTS and is also experiencing issues came across the
following LKML thread regarding pdflush on 3.0+ kernels:

https://lkml.org/lkml/2012/10/9/210

So, I went and built a couple custom kernels with this patch removed:

https://patchwork.kernel.org/patch/825212/

and the bad behavior stopped.   Best performance was with a 3.5 kernel with
the patch removed.



-- 
Jeff Frost <jeff@pgexperts.com>
CTO, PostgreSQL Experts, Inc.
Phone: 1-888-PG-EXPRT x506
FAX: 415-762-5122
http://www.pgexperts.com/ 



-- 
Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-performance



view thread (33+ messages)  latest in thread

Message-ID: <512BE5E8.1040702@pgexperts.com>
Permalink:  ../512BE5E8.1040702@pgexperts.com/
Also on:    postgresql.org/message-id/512BE5E8.1040702@pgexperts.com

 · 

reply
Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: jeff@pgexperts.com
  Subject: Re: High CPU usage / load average after upgrading to Ubuntu 12.04
  In-Reply-To: <512BE5E8.1040702@pgexperts.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox