Received: from maia.hub.org (maia-3.hub.org [200.46.204.243]) by mail.postgresql.org (Postfix) with ESMTP id 83175B5DC11 for ; Mon, 5 Sep 2011 11:15:31 -0300 (ADT) Received: from mail.postgresql.org ([200.46.204.86]) by maia.hub.org (mx1.hub.org [200.46.204.243]) (amavisd-maia, port 10024) with ESMTP id 92816-04 for ; Mon, 5 Sep 2011 14:15:25 +0000 (UTC) X-Greylist: from auto-whitelisted by SQLgrey-1.7.6 Received: from elizabeth.gransy.com (elizabeth.gransy.com [89.187.132.199]) by mail.postgresql.org (Postfix) with ESMTP id 0B936B5DC0F for ; Mon, 5 Sep 2011 11:15:24 -0300 (ADT) Received: from sq.gransy.com (localhost [127.0.0.1]) by elizabeth.gransy.com (Postfix) with ESMTP id DCA3A15E42EF; Mon, 5 Sep 2011 16:15:23 +0200 (CEST) Received: from 46.135.156.5 (SquirrelMail authenticated user tv@fuzzy.cz) by sq.gransy.com with HTTP; Mon, 5 Sep 2011 16:15:23 +0200 Message-ID: <785367bd0412b17bcd89350bcd703de6.squirrel@sq.gransy.com> In-Reply-To: <4E64D3D3.8000205@squeakycode.net> References: <4E61D6B4.9090804@ai.wu.ac.at> <33fadeb6ac1bade5ef01bd08d1fd7807.squirrel@sq.gransy.com> <4E64D3D3.8000205@squeakycode.net> Date: Mon, 5 Sep 2011 16:15:23 +0200 Subject: Re: Sudden drop in DBb performance From: "Tomas Vondra" To: "Andy Colson" Cc: "Tomas Vondra" , "Gerhard Wohlgenannt" , pgsql-performance@postgresql.org, "Heinz-Peter Lang" , "Gerhard Wohlgenannt" , "Weichselbraun, Albert" User-Agent: SquirrelMail/1.4.21 MIME-Version: 1.0 Content-Type: text/plain;charset=utf-8 Content-Transfer-Encoding: 8bit X-Priority: 3 (Normal) Importance: Normal X-Virus-Scanned: Maia Mailguard 1.0.1 X-Spam-Status: No, hits=-1.9 tagged_above=-10 required=5 tests=BAYES_00=-1.9 X-Spam-Level: X-Archive-Number: 201109/37 X-Sequence-Number: 44813 On 5 Září 2011, 15:51, Andy Colson wrote: > On 09/05/2011 02:48 AM, Tomas Vondra wrote: >> That seems a bit slow ... 27MB/s for writes and 41MB/s forreads is ait >> slow with 8 drives. >> >> Tomas >> >> > > Agreed, that's really slow. A single SATA drive will get 60 MB/s. Did > you run Bonnie while the VM's were up and running? > > root@host:~# vmstat > procs -----------memory---------- ---swap-- -----io---- -system-- > ----cpu---- > r b swpd free buff cache si so bi bo in cs us sy > id wa > 0 0 0 308024 884812 40512932 0 0 464 168 353 92 4 > 2 84 9 > > > Only one line? That does not help much. Can you run it as 'vmstat 2' and > let it run while a few slow queries are performed? Then paste all the > lines? And maybe a few lines from "iostat -x 2" too. BTW what kind of raid is it? Is it hw or sw based? Have you checked health of the drives? Are you sure there's nothing else using the drives (e.g. one of the VMs, rebuild of the array or something like that)? Tomas