Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1ZnTPG-00013e-Lo for pgsql-performance@arkaria.postgresql.org; Sat, 17 Oct 2015 15:28:26 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.84) (envelope-from ) id 1ZnTPG-0002Z7-7N for pgsql-performance@arkaria.postgresql.org; Sat, 17 Oct 2015 15:28:26 +0000 Received: from makus.postgresql.org ([174.143.35.229]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84) (envelope-from ) id 1ZnTPE-0002Yi-9o for pgsql-performance@postgresql.org; Sat, 17 Oct 2015 15:28:24 +0000 Received: from mail-by2on0095.outbound.protection.outlook.com ([207.46.100.95] helo=na01-by2-obe.outbound.protection.outlook.com) by makus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84) (envelope-from ) id 1ZnTN7-0006TU-2e for pgsql-performance@postgresql.org; Sat, 17 Oct 2015 15:26:15 +0000 Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=Jim.Nasby@bluetreble.com; Received: from decina.attlocal.net (2602:306:ce8b:3460:545a:23e1:cd6e:cb39) by BY2PR11MB0677.namprd11.prod.outlook.com (10.163.111.19) with Microsoft SMTP Server (TLS) id 15.1.293.16; Sat, 17 Oct 2015 15:26:08 +0000 Subject: Re: One long transaction or multiple short transactions? To: "Graeme B. Bell" , Laurent Martelli , "pgsql-performance@postgresql.org list" References: <002a01d0ffe4$2c630e60$85292b20$@stonebanks.ca> <003d01d0ffe4$9ae8f890$d0bae9b0$@stonebanks.ca> <00fe01d10159$8e731980$ab594c80$@stonebanks.ca> <56176288.9040500@enercoop.org> <884892BF-DD42-4E0A-8973-3A691E25E450@skogoglandskap.no> From: Jim Nasby Message-ID: <56226889.4050609@BlueTreble.com> Date: Sat, 17 Oct 2015 10:26:01 -0500 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9; rv:38.0) Gecko/20100101 Thunderbird/38.3.0 MIME-Version: 1.0 In-Reply-To: <884892BF-DD42-4E0A-8973-3A691E25E450@skogoglandskap.no> Content-Type: text/plain; charset="windows-1252"; format=flowed Content-Transfer-Encoding: 7bit X-Originating-IP: [2602:306:ce8b:3460:545a:23e1:cd6e:cb39] X-ClientProxiedBy: BY1PR13CA0014.namprd13.prod.outlook.com (25.162.107.152) To BY2PR11MB0677.namprd11.prod.outlook.com (25.163.111.19) X-Microsoft-Exchange-Diagnostics: 1; BY2PR11MB0677; 2:PWSsU/rvMKwrXJlxUDswVDmj+VZEU5y1Oec/OHNiKRIdxmB1Hgpw4BGxJv8AZjh4ADnAfzD64Q489RxRN/2fbJA7xR1q2unfNF2JSIyzMuMSqRavO2Cpush9tSY1JwLR4nyA1Buufxh3KfjrI9BzVtVSPrcMZwTQ6f5keb9Uk10=; 3:5l8tT918+z1zX5IQqm6aSSdj3PuH/44I8GIj7EgqY5v8KPyKDExdxF4Yhg3B5HWQUehyPx29VFoAcrU6tNR4vRYODkluwpkzv+12xf21E+5/il1ZU5aYRjpAZHVjJhezLvdw8Y/AO0AxviQI1Ym9mg==; 25:DksInFjMI4y3weoc7GIC9MLekrST6WEg57z4RFGf/YLe2hilWeEPfB+OHeqlJ1C1FNy8Qjtszdmw7kX2EYedsBB2o4J3icHAcHmNDtIZp9MVoe6Hoteugs59WapjTDmLJZhVPclkMvol+S8w6bs42Fapg2y3s9COtCVnVemfiGaFFGjPIlXCDQbyYUwuFwd/QMSdtjnL349Q7x1OKiPmqOJ8LsFGXDnK3zUM//2aGDh7xoM/YNYoAVHwSr2qftlflyr7i+BWiDjZP+7gGu25OA== X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:BY2PR11MB0677; X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:; X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(601004)(2401047)(520078)(5005006)(8121501046)(3002001); SRVR:BY2PR11MB0677; BCL:0; PCL:0; RULEID:; SRVR:BY2PR11MB0677; X-Microsoft-Exchange-Diagnostics: 1; BY2PR11MB0677; 4:eNtGdxSnJqtl9d/LfdEd30K8XHCxZExOIZhvsQnfhEpPe5ohsgTxbQGsUDm+dCVsijJUVHNk7S3lkeuruRln7ZK/0MJzs1LiEjgnwKkvsrRp7htCGWbHu9oDWdFZL5vhk/6TfRaSY9A8GoXd7paD0oGHGSG42pPO8+EW9gX9WSoNBENbL9blVD3a2O+L17uFWvH40fi9nOy5TsqOSXHZEvmIxlRjQJ/e/b+qTx8YbL5ojYbfZrwtH9SAJ6n4OuKN6eL0dE0cV/zzg6fhi1grn5UyIIOzrkgvntxetun/Vwvix9zrTLgWAjdPMYk58KTVOnZu7VbPgiTcmwRzndZ1ynDC4lXy6O0foeElyWCHwRw= X-Forefront-PRVS: 07326CFBC4 X-Forefront-Antispam-Report: SFV:NSPM; SFS:(10009020)(979002)(6009001)(377454003)(199003)(479174004)(24454002)(189002)(5008740100001)(46102003)(81156007)(87976001)(5007970100001)(83506001)(59896002)(5001920100001)(65956001)(50986999)(47776003)(105586002)(106356001)(86362001)(69596002)(42186005)(64706001)(92566002)(76176999)(99136001)(53416004)(4001350100001)(5001960100002)(122386002)(5001770100001)(65806001)(5004730100002)(117636001)(2950100001)(189998001)(50466002)(101416001)(19580395003)(64126003)(40100003)(97736004)(65816999)(15975445007)(93886004)(551934003)(54356999)(77096005)(87266999)(23746002)(36756003)(107886002)(3826002)(85282002)(62816006)(336755003)(18886065003)(969003)(989001)(999001)(1009001)(1019001); DIR:OUT; SFP:1101; SCL:1; SRVR:BY2PR11MB0677; H:decina.attlocal.net; FPR:; SPF:None; PTR:InfoNoRecords; A:1; MX:1; LANG:en; Received-SPF: None (protection.outlook.com: bluetreble.com does not designate permitted sender hosts) X-Microsoft-Exchange-Diagnostics: =?Windows-1252?Q?1; BY2PR11MB0677; 23:vNhcx5X1cDnihLB/9XJX3htELuVPEXrWpJ/8O?= =?Windows-1252?Q?5Cp32qcNprz3240JwT4c4V6wVZkG9pMVAAcuGlrv30t0pOrT3FiD/NNL?= =?Windows-1252?Q?OtV1/vJzpfjiR/e7dphZAW2NmemG0Yt2H8e8ZchLdlmch2y6B0Hk3yfl?= =?Windows-1252?Q?Rf3uOa9t17pEqcbO5GAfuIdURaC4HG5TLaoGxCpYLmYP6nmSOCHIFcEC?= =?Windows-1252?Q?jwEHFVm7uLNDFnty40MmoDnoEs0Izk91bBTEBSPZ7H6cLyryFUYZrBXY?= =?Windows-1252?Q?O2CvYFzOUSzhbjRqkVX0yyiyuaIpykALztQyRWzTQuGxfSnmNrDMiBCf?= =?Windows-1252?Q?zrmsq5TUmSwNt3d4aQg4NnUlvpCIQ9GRNzoFnEHwpCDilgfwp1+aOTvJ?= =?Windows-1252?Q?KVSfR0KkiYW4IRKt20lhYgyoVewVLC9gCXUU5zesBfW9qDRh6Yy1J27F?= =?Windows-1252?Q?4oqbUN/a8EjNgfEQG+zqaIH3o7XnX5CskUNLY7qECnDKtc6mb0eMflmi?= =?Windows-1252?Q?bCYZAVVcaHAcpd38i31PmcqeR7le2Mv4mHTzkmgAOc21G+u8Vw9pq3Du?= =?Windows-1252?Q?fKkb/4UJjajhEMRo/3swqGF2D5ulwQG6F3JJv2BEVihJBqQFNpu6Nens?= =?Windows-1252?Q?CkiM4lyrdG5zXtTgbsu7FeqFcviL/wZyF8FhYAeyv8QWlkirvv8NRkVz?= =?Windows-1252?Q?l8kntymUxGqSq78meLY0ibHuhBW/1HbRtspljbpxX0vTfUQt+lMdgZ7+?= =?Windows-1252?Q?C7q1r0qTMwrg2qKfwm0rCfOlstWxzK39rW1yFrKDXy88srJSEmPRDJt5?= =?Windows-1252?Q?bo3XJEkw+ins396iNkO6hm+a6N2Hr7FCqcC8pKd77SnU40FHMhkVLsjA?= =?Windows-1252?Q?D8FXKyKPh+Q/jWbrnqv4VdEopaimJW1hzPHN4/vQguyPLngqF0yXDK2b?= =?Windows-1252?Q?Noc3SYuDwyeuJk/Fr9KjPCB52OPsew/9BFQebr5hlMVQThNXhZKldVFY?= =?Windows-1252?Q?G7w1GCw4U8v9HzXOtY+ypReC7o6Z6XtvPhi1nBYvEwnWHinMbdy1lwBJ?= =?Windows-1252?Q?G6pPHk/N3KIc7hBSn+QjPfC7ncVtZfcvGu6OxFwP6zbmdPYwjxMmuod1?= =?Windows-1252?Q?XXHmVQ0f/6KjaxPDa6xX0lO0pCJ/8exsxUb2UsTB+cm0HAxLt/YEFpKt?= =?Windows-1252?Q?oXv/G75fbm5QTFrrD7gBrAOrnsh8/qMXUbWkk8r1hOzXpGFugcHSnjUe?= =?Windows-1252?Q?thW8o5/xal4U5UveZcH3be7+Fu+Gcuqy6X51YGn1pmq17aUsPEdEtL6A?= =?Windows-1252?Q?uBPIJfMiJGLlOlraVsOu7QRUn6pQSFxYPz6y1jg+XbvNlPWtjc4U2iyz?= =?Windows-1252?Q?fGK8IDFLJDtRjiO1JgGawwndWPhqSkXtGE4oFlD5SXdgZp8B55/hVi02?= =?Windows-1252?Q?5cWVVClPK5PF6Eor++io/i2o5wHsAzjmL+eeeMPFtMe3vI7KbgVrOyoQ?= =?Windows-1252?Q?1yt40ADeA3bXQ9YMuQptZJOjCrcnQW/EbXgvCMZspSKZEP8Rgq0loCKH?= =?Windows-1252?Q?uOobO6AVOgj5pnF1N2y8PLfgIIbwLKMyAa6zqznyFyfUSQA54u/ImJX+?= =?Windows-1252?Q?JBReM9dNddQr47IENVFIMgipJJ52xlcWOC+OPa/FQ2CGVL2YssDYHgTl?= =?Windows-1252?Q?PErBP2g7jNKubYAUryG6U1qEUmUvIJCABqzqeT5jiUvQal0ryin?= X-Microsoft-Exchange-Diagnostics: 1; BY2PR11MB0677; 5:cmy8JLzolYje6uN2WDY40I4CT5JVw9a+2YSQOCwJFR4DzTrI/HbNhVmjlq1cv4B+o4cBVJIBEkPJe9INcn7KUpjRMHk7LZKSaHsGeFL5YmwIR2SndmXq1XsNLkc5HMDOyzC/Mw68pXuQEBgHHDTOuQ==; 24:NAGvvlbC8py0vQcUWwfvSPZs3TlA5yyzgpAaxZcGwHAAoe2YX37kMBMbUJPaMbApDXPn4CvzzC7D39FZBqUa/ljGS6eLYoc/xYydGxw+dhU=; 20:Axm5tmFJsPDJKxa4FWQI4hUkUWy86md1Ue+jR9Xy7U2Z6MA0SYCbD1WmcdIdVj1TpoG/4ZTgS+6QoqWe/YsXyw== SpamDiagnosticOutput: 1:23 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: bluetreble.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 17 Oct 2015 15:26:08.1527 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: BY2PR11MB0677 X-Pg-Spam-Score: -1.9 (-) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-performance Precedence: bulk Sender: pgsql-performance-owner@postgresql.org On 10/9/15 3:33 AM, Graeme B. Bell wrote: > >> I don't think inserts can cause contention on the server. Insert do not lock tables during the transaction. You may have contention on sequence but it won't vary with transaction size. > > Perhaps there could be a trigger on inserts which creates some lock contention? Except inserts *do* take a lot of locks, just not user-level locks. Operations like finding a page to insert into, seeing if that page is in shared buffers, loading the page into shared buffers, modifying a shared buffer, getting the relation extension lock if you need to add a new page. Then there's a whole pile of additional locking you could be looking at for inserting into any indexes. Now, most of the locks I described up there are transaction-aware, but there's other things happening at a transaction level that could alter that locking. So it wouldn't surprise me if you're seeing radically different behavior based on transaction duration. Also, it sounds like perhaps longer transactions are involving more tables? Is this a star schema you're dealing with? -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance