Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.72) (envelope-from ) id 1UMuwf-0000GJ-E9 for pgsql-performance@arkaria.postgresql.org; Tue, 02 Apr 2013 06:43:49 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.72) (envelope-from ) id 1UMuwe-000753-IC for pgsql-performance@arkaria.postgresql.org; Tue, 02 Apr 2013 06:43:48 +0000 Received: from makus.postgresql.org ([2001:4800:7903:4::125]) by malur.postgresql.org with esmtp (Exim 4.72) (envelope-from ) id 1UMuwd-00074x-FR for pgsql-performance@postgresql.org; Tue, 02 Apr 2013 06:43:47 +0000 Received: from [2404:130:0:10::40:2] (helo=mail.catalyst.net.nz) by makus.postgresql.org with esmtp (Exim 4.72) (envelope-from ) id 1UMuwY-0002tG-Cw for pgsql-performance@postgresql.org; Tue, 02 Apr 2013 06:43:45 +0000 Received: from localhost (localhost [127.0.0.1]) by mail.catalyst.net.nz (Postfix) with ESMTP id 409B5328AF; Tue, 2 Apr 2013 19:43:36 +1300 (NZDT) X-Virus-Scanned: Debian amavisd-new at catalyst.net.nz Received: from mail.catalyst.net.nz ([127.0.0.1]) by localhost (bertrand.catalyst.net.nz [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id fhqoNkC74MKK; Tue, 2 Apr 2013 19:43:35 +1300 (NZDT) Received: from [192.168.1.64] (122-60-64-230.jetstream.xtra.co.nz [122.60.64.230]) (Authenticated sender: mark.kirkwood) by mail.catalyst.net.nz (Postfix) with ESMTPSA id 62DF4325F0; Tue, 2 Apr 2013 19:43:35 +1300 (NZDT) Message-ID: <515A7E16.5080005@catalyst.net.nz> Date: Tue, 02 Apr 2013 19:43:34 +1300 From: Mark Kirkwood User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/20130311 Thunderbird/17.0.4 MIME-Version: 1.0 To: Armand du Plessis CC: Jeff Janes , pgsql-performance Subject: Re: Problems with pg_locks explosion References: <515A2223.5080204@catalyst.net.nz> <515A79BC.9020006@catalyst.net.nz> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Host-Lookup-Failed: Reverse DNS lookup failed for 2404:130:0:10::40:2 (failed) X-Pg-Spam-Score: -1.1 (-) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-performance Precedence: bulk Sender: pgsql-performance-owner@postgresql.org Also it is worth checking what your sysctl vm.zone_reclaim_mode is set to - if 1 then override to 0. As Jeff mentioned, this gotcha for larger cpu number machines has been discussed at length on this list - but still traps us now and again! Cheers Mark On 02/04/13 19:33, Armand du Plessis wrote: > I had my reservations about my almost 0% IO usage on the raid0 array as > well. I'm looking at the numbers in atop and it doesn't seem to reflect > the aggregate of the volumes as one would expect. I'm just happy I am > seeing numbers on the volumes, they're not too bad. > > One thing I was wondering, as a last possible IO resort. Provisioned EBS > volumes requires that you maintain a wait queue of 1 for every 200 > provisioned IOPS to get reliable IO. My wait queue hovers between 0-1 > and with the 1000 IOPS it should be 5. Even thought about artificially > pushing more IO to the volumes but I think Jeff's right, there's some > internal kernel voodoo at play here. I have a feeling it'll be under > control with pg_pool (if I can just get the friggen setup there right) > and then I'll have more time to dig into it deeper. > > Apologies to the kittens for the interrupting your leave :) > -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance