Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1Yi6yl-0004Vg-EQ for pgsql-performance@arkaria.postgresql.org; Tue, 14 Apr 2015 19:58:39 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.80) (envelope-from ) id 1Yi6yk-0002xj-Pu for pgsql-performance@arkaria.postgresql.org; Tue, 14 Apr 2015 19:58:38 +0000 Received: from makus.postgresql.org ([2001:4800:1501:1::229]) by malur.postgresql.org with esmtps (TLS1.2:DHE_RSA_AES_256_CBC_SHA256:256) (Exim 4.80) (envelope-from ) id 1Yi6yj-0002xd-Tk for pgsql-performance@postgresql.org; Tue, 14 Apr 2015 19:58:38 +0000 Received: from mx-out.zmailcloud.com ([192.198.85.98] helo=mx-out-1.zmailcloud.com) by makus.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1Yi6yg-000053-QB for pgsql-performance@postgresql.org; Tue, 14 Apr 2015 19:58:36 +0000 Received: from smtp.01.com (smtp.01.com [10.10.0.43]) by mx-out-1.zmailcloud.com (Postfix) with ESMTP id 4285D563D15 for ; Tue, 14 Apr 2015 14:58:34 -0500 (CDT) Received: from localhost (localhost [127.0.0.1]) by smtp-out-2.01.com (Postfix) with ESMTP id 38D8D6052C for ; Tue, 14 Apr 2015 14:58:34 -0500 (CDT) X-Virus-Scanned: amavisd-new at smtp-out-2.01.com Received: from smtp.01.com ([127.0.0.1]) by localhost (smtp-out-2.01.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id w4qlatXO6qII for ; Tue, 14 Apr 2015 14:58:34 -0500 (CDT) Received: from smtp.01.com (localhost [127.0.0.1]) by smtp-out-2.01.com (Postfix) with ESMTP id E873F60523 for ; Tue, 14 Apr 2015 14:58:33 -0500 (CDT) Received: from localhost (localhost [127.0.0.1]) by smtp-out-2.01.com (Postfix) with ESMTP id D86206052E for ; Tue, 14 Apr 2015 14:58:33 -0500 (CDT) X-Virus-Scanned: amavisd-new at smtp-out-2.01.com Received: from smtp.01.com ([127.0.0.1]) by localhost (smtp-out-2.01.com [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id HhMnv5CiDK9O for ; Tue, 14 Apr 2015 14:58:33 -0500 (CDT) Received: from [172.47.23.104] (50-0-190-244.dsl.dynamic.fusionbroadband.com [50.0.190.244]) by smtp-out-2.01.com (Postfix) with ESMTPSA id 7B5EC60523 for ; Tue, 14 Apr 2015 14:58:33 -0500 (CDT) Message-ID: <552D7168.3090909@agliodbs.com> Date: Tue, 14 Apr 2015 12:58:32 -0700 From: Josh Berkus Organization: PostgreSQL Experts Inc. User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: pgsql-performance@postgresql.org Subject: Re: Some performance testing? References: <1247A199-6C8E-48FC-ADAA-BCA7DE5F90C3@skogoglandskap.no> In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Pg-Spam-Score: -1.9 (-) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-performance Precedence: bulk Sender: pgsql-performance-owner@postgresql.org Scott, > Can confirm that for pg purposes, 3.2 is basically broken in some not > to great ways. We've had servers that were overloaded at load factors > of 20 or 30 drop down to 5 or less with just a change from 3.2 to > 3.11/3.13 on ubuntu 12.04 That's correct, and 3.5 shares the same problems. The underlying issue was that 3.X was tweaked to be MUCH more aggressive about cache-clearing, to the point where it would be evicting data from the FS cache which had just been read in and hadn't even been used yet. For some reason, this aggressive eviction got worse the more processes on the system which were using the FS cache, so where you really see it is when you have more processes with cache than you have cores. It's pretty easy to demonstrate just using pgbench, with a database larger than RAM, and 2X as many clients as cores. You'll see that kernels 3.2 and 3.5 will do 3X to 5X as much IO for the same workload as 3.10 and later will do. Greame, On 04/09/2015 04:01 AM, Graeme B. Bell wrote:> performance with 2.6: (pgbench, size 100, 32 clients) > > 48 651 transactions per second (read only) > 6 504 transactions per second (read-write) > > > performance with 3.18 (pgbench, size 100, 32 clients) > > 129 303 transactions per second (read only) > 16 895 transactions (read-write) Thanks for that data! I'm glad to see that 3.18 has improved so much. -- Josh Berkus PostgreSQL Experts Inc. http://pgexperts.com -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance