Received: from maia.hub.org (unknown [200.46.208.211]) by mail.postgresql.org (Postfix) with ESMTP id 8B29C633CC8 for ; Tue, 13 Apr 2010 15:21:35 -0300 (ADT) Received: from mail.postgresql.org ([200.46.204.86]) by maia.hub.org (mx1.hub.org [200.46.208.211]) (amavisd-maia, port 10024) with ESMTP id 27647-06 for ; Tue, 13 Apr 2010 18:21:21 +0000 (UTC) X-Greylist: domain auto-whitelisted by SQLgrey-1.7.6 Received: from mail-bw0-f216.google.com (mail-bw0-f216.google.com [209.85.218.216]) by mail.postgresql.org (Postfix) with ESMTP id E4EDE635A10 for ; Tue, 13 Apr 2010 15:14:11 -0300 (ADT) Received: by bwz8 with SMTP id 8so4553829bwz.3 for ; Tue, 13 Apr 2010 11:14:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :from:date:received:message-id:subject:to:cc:content-type :content-transfer-encoding; bh=wgSBzaCxdAS4AWLr43qlvGsSRsi288RSZB6J7YwhMZY=; b=jc95phHF5qyIdSDjFGEFXx+ZedevmBLxpywujHMNuqzw3p3uvrKA9tdq+X02NFFscU UwiWKJM9uAQR31rEirgJE+7UrpJcJaTgftT9vn8bp7IyvPhQm5mlbNOHBfDkCvJ99tEu /RXVlbF68jPiIi9FWBBpNuedN5BTiQLfEaDtg= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type:content-transfer-encoding; b=VdkYABjXCccZyDQuX86PlMGkj/bvtSJ5cmwlU0AUhel7IOm2bk6H0QHUkNTv8XsZCZ //0i0bj36HQCJ1lnG/l3Y8dFamQZ5eZdGNy4CuQDy0MEPVlA7xKdI5iTSmK6dHMy7Qd4 O/ykHf/vQNnNmj3fnMAyoZGJFqTXAVt4oLxXw= MIME-Version: 1.0 Received: by 10.86.9.9 with HTTP; Tue, 13 Apr 2010 11:13:50 -0700 (PDT) In-Reply-To: <20100413170105.GA29571@chris-laptop.a2hosting.com> References: <20100413170105.GA29571@chris-laptop.a2hosting.com> From: =?ISO-8859-1?Q?C=E9dric_Villemain?= Date: Tue, 13 Apr 2010 20:13:50 +0200 Received: by 10.86.6.39 with SMTP id 39mr5291897fgf.4.1271182450295; Tue, 13 Apr 2010 11:14:10 -0700 (PDT) Message-ID: Subject: Re: stats collector suddenly causing lots of IO To: Chris Cc: pgsql-performance@postgresql.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Virus-Scanned: Maia Mailguard 1.0.1 X-Spam-Status: No, hits=-1.861 tagged_above=-10 required=5 tests=AWL=0.039, BAYES_00=-1.9 X-Spam-Level: X-Archive-Number: 201004/168 X-Sequence-Number: 38418 2010/4/13 Chris : > I have a lot of centos servers which are running postgres. =A0Postgres is= n't used > that heavily on any of them, but lately, the stats collector process keep= s > causing tons of IO load. =A0It seems to happen only on servers with cento= s 5. > The versions of postgres that are running are: > > 8.1.18 > 8.2.6 > 8.3.1 > 8.3.5 > 8.3.6 > 8.3.7 > 8.3.8 > 8.3.9 > 8.4.2 > 8.4.3 > > I've tried turning off everything under RUNTIME STATISTICS in postgresql.= conf > except track_counts (since auto vacuum says it needs it), but it seems to= have > little affect on the IO caused by the stats collector. > > Has anyone else noticed this? =A0Have there been recent kernel changes > that could cause this that anyone knows about? =A0Since we haven't touche= d > postgres on these boxes since they were setup initially, I'm a bit baffle= d as > to what might be causing the problem, and why I can't make it go away sho= rt of > kill -STOP. > > Any suggestions would be much appreciated! stats file is writed to disk every 500ms (can be change while building postgres) but it have been improved in 8.4 and should be write only if needed. In 8.4 you can change the directory where to write the stat file with the config param : stats_temp_directory Perhaps have a test and change the filesystem (you might want to try a ramdisk and another fs - ext3 -XFS-ext4 depending of your kernel) and see if it does change something in your IO load. Anyway it looks like it is centos 5 relative so what is your curernt running kernel ? (and what FS ) > > > -- > Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org= ) > To make changes to your subscription: > http://www.postgresql.org/mailpref/pgsql-performance > --=20 C=E9dric Villemain