Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1XB84S-0001as-3D for pgsql-performance@arkaria.postgresql.org; Sat, 26 Jul 2014 19:55:56 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.80) (envelope-from ) id 1XB84R-0005tg-GN for pgsql-performance@arkaria.postgresql.org; Sat, 26 Jul 2014 19:55:55 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:DHE_RSA_AES_256_CBC_SHA256:256) (Exim 4.80) (envelope-from ) id 1XB84Q-0005tZ-CH for pgsql-performance@postgresql.org; Sat, 26 Jul 2014 19:55:54 +0000 Received: from smtp-outbound-1.vmware.com ([208.91.2.12]) by magus.postgresql.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.80) (envelope-from ) id 1XB84K-000537-GS for pgsql-performance@postgresql.org; Sat, 26 Jul 2014 19:55:53 +0000 Received: from sc9-mailhost2.vmware.com (sc9-mailhost2.vmware.com [10.113.161.72]) by smtp-outbound-1.vmware.com (Postfix) with ESMTP id 69FDA28293; Sat, 26 Jul 2014 12:55:42 -0700 (PDT) Received: from EX13-CAS-013.vmware.com (EX13-CAS-013.vmware.com [10.113.191.65]) by sc9-mailhost2.vmware.com (Postfix) with ESMTP id 64964B0488; Sat, 26 Jul 2014 12:55:42 -0700 (PDT) Received: from EX13-MBX-017.vmware.com (10.113.191.37) by EX13-MBX-008.vmware.com (10.113.191.28) with Microsoft SMTP Server (TLS) id 15.0.775.38; Sat, 26 Jul 2014 12:55:30 -0700 Received: from EX13-MBX-013.vmware.com (10.113.191.33) by EX13-MBX-017.vmware.com (10.113.191.37) with Microsoft SMTP Server (TLS) id 15.0.775.38; Sat, 26 Jul 2014 12:55:29 -0700 Received: from EX13-MBX-013.vmware.com ([fe80::b82b:d0bb:9cd7:392e]) by EX13-MBX-013.vmware.com ([fe80::b82b:d0bb:9cd7:392e%15]) with mapi id 15.00.0775.031; Sat, 26 Jul 2014 12:55:11 -0700 From: Reza Taheri To: Ryan Johnson , "pgsql-performance@postgresql.org" Subject: Re: High rate of transaction failure with the Serializable Isolation Level Thread-Topic: High rate of transaction failure with the Serializable Isolation Level Thread-Index: AQHPqFHVx3JypHx58U+0ZXroXUnibJuyxa9g Date: Sat, 26 Jul 2014 19:55:11 +0000 Message-ID: <20fd404f0e9c42f1b9847c35c1dc546c@EX13-MBX-013.vmware.com> References: <53D0923B.7050501@2ndquadrant.com> <93e2642196e646adbcf5780d3cf54685@EX13-MBX-013.vmware.com> <53D1B31B.8070909@2ndquadrant.com> <80d78b6fec064f14aa025c1ca86c8099@EX13-MBX-013.vmware.com> <53D2CDA3.8050707@cs.utoronto.ca> In-Reply-To: <53D2CDA3.8050707@cs.utoronto.ca> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.113.160.246] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Pg-Spam-Score: -6.9 (------) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-performance Precedence: bulk Sender: pgsql-performance-owner@postgresql.org Hi Ryan, That's a very good point. We are looking at dbt5. One question: what throug= hput rate, and how many threads of execution did you use for dbt5? The fai= lure rates I reported were at ~120 tps with 15 trade-result threads. Thanks, Reza > -----Original Message----- > From: pgsql-performance-owner@postgresql.org [mailto:pgsql- > performance-owner@postgresql.org] On Behalf Of Ryan Johnson > Sent: Friday, July 25, 2014 2:36 PM > To: pgsql-performance@postgresql.org > Subject: Re: High rate of transaction failure with the Serializable Isola= tion > Level >=20 > On 25/07/2014 2:58 PM, Reza Taheri wrote: > > Hi Craig, > > > >> According to the attached SQL, each frame is a separate phase in the > operation and performs many different operations. > >> There's a *lot* going on here, so identifying possible > >> interdependencies isn't something I can do in a ten minute skim read o= ver > my morning coffee. > > You didn't think I was going to bug you all with a trivial problem, > > did you? :-) :-) > > > > Yes, I am going to have to take an axe to the code and see what pops ou= t. > Just to put this in perspective, the transaction flow and its statements = are > borrowed verbatim from the TPC-E benchmark. There have been dozens of > TPC-E disclosures with MS SQL Server, and there are Oracle and DB2 kits t= hat, > although not used in public disclosures for various non-technical reasons= , are > used internally in by the DB and server companies. These 3 products, and > perhaps more, were used extensively in the prototyping phase of TPC-E. > > > > So, my hope is that if there is a "previously unidentified interdepende= ncy > between transactions" as you point out, it will be due to a mistake we ma= de > in coding this for PGSQL. Otherwise, we will have a hard time convincing = all > the council member companies that we need to change the schema or the > business logic to make the kit work with PGSQL. > > > > Just pointing out my uphill battle!! > You might compare against dbt-5 [1], just to see if the same problem occu= rs. I > didn't notice such high abort rates when I ran that workload a few weeks > ago. Just make sure to use the latest commit, because the "released" vers= ion > has fatal bugs. >=20 > [1] > https://urldefense.proofpoint.com/v1/url?u=3Dhttps://github.com/petergeog > hegan/dbt5&k=3DoIvRg1%2BdGAgOoM1BIlLLqw%3D%3D%0A&r=3Db9TKmA0CPjr > oD2HLPTHU27nI9PJr8wgKO2rU9QZyZZU%3D%0A&m=3D6E%2F9fWJPMGjpMyP > xtY0nsamLLW%2FNsTXu7FP9Wzauj10%3D%0A&s=3Db3f269216d419410f3f07bb > 774a27b7d377744c9d423df52a3e62324d9279958 >=20 > Ryan >=20 >=20 >=20 > -- > Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) > To make changes to your subscription: > https://urldefense.proofpoint.com/v1/url?u=3Dhttp://www.postgresql.org/m > ailpref/pgsql- > performance&k=3DoIvRg1%2BdGAgOoM1BIlLLqw%3D%3D%0A&r=3Db9TKmA0CP > jroD2HLPTHU27nI9PJr8wgKO2rU9QZyZZU%3D%0A&m=3D6E%2F9fWJPMGjpMy > PxtY0nsamLLW%2FNsTXu7FP9Wzauj10%3D%0A&s=3D45ab94ce068dbe28956af > 8bb3f999e9a91138dd1e3c3345c036e87e902da1ef1 --=20 Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance