X-Original-To: pgsql-performance-postgresql.org@localhost.postgresql.org Received: from localhost (unknown [200.46.204.144]) by svr1.postgresql.org (Postfix) with ESMTP id 67D7753A02; Wed, 6 Apr 2005 09:12:01 +0100 (BST) Received: from svr1.postgresql.org ([200.46.204.71]) by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024) with ESMTP id 63572-06; Wed, 6 Apr 2005 08:11:56 +0000 (GMT) Received: from cmailm3.svr.pol.co.uk (cmailm3.svr.pol.co.uk [195.92.193.19]) by svr1.postgresql.org (Postfix) with ESMTP id CAE6353A2A; Wed, 6 Apr 2005 09:11:55 +0100 (BST) Received: from modem-3774.leopard.dialup.pol.co.uk ([217.135.158.190] helo=192.168.0.102) by cmailm3.svr.pol.co.uk with esmtp (Exim 4.41) id 1DJ5di-0008UR-6U; Wed, 06 Apr 2005 09:11:54 +0100 Subject: Re: Sustained inserts per sec ... ? From: Simon Riggs To: Christopher Petrilli Cc: Tom Lane , jd@commandprompt.com, "Marc G. Fournier" , pgsql-performance@postgresql.org In-Reply-To: <59d991c405040515555c77d1e@mail.gmail.com> References: <20050401140421.P18194@ganymede.hub.org> <1112388818.3487.34.camel@jd2.commandprompt.com> <59d991c4050401125956d6069d@mail.gmail.com> <59d991c40504040648457808e9@mail.gmail.com> <26454.1112629979@sss.pgh.pa.us> <59d991c405040409094e7bbd17@mail.gmail.com> <26669.1112631807@sss.pgh.pa.us> <59d991c40504041846bc39a6@mail.gmail.com> <5217.1112668589@sss.pgh.pa.us> <1112730509.16721.918.camel@localhost.localdomain> <59d991c405040515555c77d1e@mail.gmail.com> Content-Type: text/plain Organization: 2nd Quadrant Date: Wed, 06 Apr 2005 09:09:58 +0100 Message-Id: <1112774998.16721.1000.camel@localhost.localdomain> Mime-Version: 1.0 X-Mailer: Evolution 2.0.2 (2.0.2-3) Content-Transfer-Encoding: 7bit X-Virus-Scanned: by amavisd-new at hub.org X-Spam-Status: No, hits=0.048 tagged_above=0 required=5 tests=AWL, FORGED_RCVD_HELO X-Spam-Level: X-Archive-Number: 200504/92 X-Sequence-Number: 11489 On Tue, 2005-04-05 at 18:55 -0400, Christopher Petrilli wrote: > On Apr 5, 2005 3:48 PM, Simon Riggs wrote: > > B-trees aren't unique to PostgreSQL; the explanation developed here > > would work equally well for any database system that used tree-based > > indexes. Do we still think that MySQL can do this when PostgreSQL > > cannot? How? > > > > Do we have performance test results showing the same application load > > without the degradation? We don't need to look at the source code to > > measure MySQL performance... > > http://www.amber.org/~petrilli/diagrams/comparison_mysql_pgsql.png > > That chart shows MySQL (using INSERT against MyISAM tables) and > PostgreSQL (using COPY) running with the exact same code otherwise. > Note that MySQL does hit a bit of a wall, but nothing as drastic as > PostgreSQL and actually maintains something "more flat". The red and > blue dashed lines are the 95th percentile point. Interesting comparison. Any chance of separating the graphs as well, I'm interested in the detail on both graphs. Could you estimate the apparent periodicity on the PostgreSQL graphs? > My suspicion is that what we're seeing is WAL issues, not particularly > index issues. The indices just fill up the WAL faster because there's > more data. This is a wag basically, but it would seem to explain the > difference. In both cases, the indices were identical. Five on each. Let's test the shared_buffers theory. Would you mind loading only 5M rows per table, but load the same amount of data overall? That should keep us within the comparable zone overall. Best Regards, Simon Riggs