Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.84_2) (envelope-from ) id 1aiZMb-0005ZT-En for pgsql-hackers@arkaria.postgresql.org; Wed, 23 Mar 2016 03:21:41 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.84_2) (envelope-from ) id 1aiZMa-0000c5-Hf for pgsql-hackers@arkaria.postgresql.org; Wed, 23 Mar 2016 03:21:40 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1aiZMZ-0000by-BS for pgsql-hackers@postgresql.org; Wed, 23 Mar 2016 03:21:39 +0000 Received: from mail-bn1bon0093.outbound.protection.outlook.com ([157.56.111.93] helo=na01-bn1-obe.outbound.protection.outlook.com) by magus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1aiZMU-0003bi-Km for pgsql-hackers@postgresql.org; Wed, 23 Mar 2016 03:21:38 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=BlueTreble.onmicrosoft.com; s=selector1-bluetreble-com; h=From:To:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=iIlac2CGKxGaKMDAWUx5RGqtSferzQcM4CbK9yr8VKE=; b=afJxgKGD/l5kUeam2os17E/I5gzmababDUYXip9oj3gbfdICdyHZz+hgl/86sxbzYWiAzeVs934+4Gp7+nHoDcQ0afihFPJdO9uF6QFAIZpvkyiSLddJcjBJqGVjrmHRwdPHPXq9haTWyAcTRMz0qk1OWAqLBNAd5I/gvaw8MsQ= Authentication-Results: postgresql.org; dkim=none (message not signed) header.d=none;postgresql.org; dmarc=none action=none header.from=BlueTreble.com; Received: from decina.local (70.113.16.71) by BLUPR11MB0675.namprd11.prod.outlook.com (10.163.216.145) with Microsoft SMTP Server (TLS) id 15.1.434.16; Wed, 23 Mar 2016 03:21:26 +0000 Subject: Re: Speed up Clog Access by increasing CLOG buffers To: Amit Kapila , Andres Freund References: <56E7032D.6060908@pgmasters.net> <20160322105221.GD3790@awork2.anarazel.de> <20160322125957.GH3790@awork2.anarazel.de> CC: David Steele , Robert Haas , Thom Brown , Simon Riggs , Jesper Pedersen , pgsql-hackers From: Jim Nasby Message-ID: <56F20BAF.10803@BlueTreble.com> Date: Tue, 22 Mar 2016 22:21:19 -0500 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9; rv:38.0) Gecko/20100101 Thunderbird/38.6.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset="utf-8"; format=flowed Content-Transfer-Encoding: 7bit X-Originating-IP: [70.113.16.71] X-ClientProxiedBy: BY2PR06CA027.namprd06.prod.outlook.com (10.141.250.145) To BLUPR11MB0675.namprd11.prod.outlook.com (25.163.216.145) X-MS-Office365-Filtering-Correlation-Id: 57852950-3ed8-411f-75cf-08d352ca3a47 X-Microsoft-Exchange-Diagnostics: 1;BLUPR11MB0675;2:VjJi5Fpl3kIoLGP16hybN1H4E9PhIBmLU0vWIxzjSLSZVrj6YADZuDJaasnzPbLPLpbecmjXLerfSrzDUhpLQpOaZbrLLRIDLdAZcfy0PU+CRCnMZV36aEt6hfjCKBMKo1e69tRecUCWUzVwY9VbBBeLxY3eQFwdwlCkumm5dXTolRJ1NVXr4usNbBv6LYpp;3:moI1T6ILgdglm015APJj8lVUjptwTUoT+YMsbu65wkQ860syVnAhsOHXFFnG5FdxGe4XdwE/7jXVa2BT539nHMswGwi70aeWTl0EvedKtbOWWvXMxWX7SnmaYzkW5ilM;25:WIiSGGJbYmbxpW/9zG50Dzc5oZk8hAnHWi2zdVpIwszSwta80p3sbOG8peftfT5I+qwUNGXCcXMFqEL14ZZVh/DV4i+qyMs9RyRcm7FTzRu5/ElJHqd+ypuExPYcP+OUmng9CafNYAY0N2JRIOBtIYcqxTNLvFLgSmSpPNn31WUSz4xlC6K8yAOjdlXzhiuC84+67sFq4hjHF5ADo0ZE+NPkKev95Q1lGcNdSwrESMTwKKj//Ncsllm5+CwPioAbTpuc+Q09O6GHcGQV/sQExiX7iHkjwbbZ6ImRrf1TyoicBTdu28w6zg7VcrcnK8YSjP3+RgbdOMwG4fY16c8yxny0qtA6hRNemA8Tvx0VUWjWTuMjrYoS67zhwVBrqz0j7HFHE+LsYuca/3tvXQsswOxRwF24nsxYEYm4AwcXuUL6xFtGhamsl9l2qaHJzYK5ErfPg7FOqJjSeLrpKGJFqLMJ1+noPcE5rQwYQSOb4vuoPwJrxFGVow/1YrrVRaFZ8SjctNCeAfFgtUUXXVSLw1eFWLzAE5C5iZNO7dzAFS0U6Cx4bw3Gn6x3rmP8m4jr+oiCdIkwvge8DtfWFMGhcg== X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:BLUPR11MB0675; X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:; X-Exchange-Antispam-Report-CFA-Test: BCL:0;PCL:0;RULEID:(6040046)(601004)(2401047)(5005006)(8121501046)(3002001)(10201501046)(6041046)(6043046);SRVR:BLUPR11MB0675;BCL:0;PCL:0;RULEID:;SRVR:BLUPR11MB0675; X-Microsoft-Exchange-Diagnostics: 1;BLUPR11MB0675;4:EEWMxWLALa6dfhtNh2QJ3hHHc3w2q6sL+i1aFbFGcZsnVK29590EZnVJF4vA+oP1tN9xqf8+BrMFTrg2QibBYom9npUvyM7friIfI1X0ERpawg7AMPrJJUN78swA07t1rBvPLl2+CZr43UYOdZLVpsGqjcW2GTDxG/whEq5q6neyBUiiLhKtigP3Fn1UeUAZ/LkchiUJWBEPYk6EgQRiINXhxQj97PVNjNABRtSUyL7swhPptINRmR8tRHDbYxY1gVPGdMGMcDiJA0i+bPUnIo5uGcAkSCPOrRITQtvQjp+t5h2dBRl/PNwIywuV7qbQK3mnp0TxFERP5AC3FQcO3xhk5VdtZCibNKeJLGMPoU8+dQEazjQ3HWTKQ5mAyAhV8g8nLIIeJTSRu69IljdKKqFMWGmPIHgPWw/qgcwQVEU= X-Forefront-PRVS: 08902E536D X-Forefront-Antispam-Report: SFV:NSPM;SFS:(10009020)(4630300001)(6009001)(377454003)(24454002)(5001770100001)(5004730100002)(4001350100001)(86362001)(42186005)(36756003)(81166005)(23676002)(189998001)(77096005)(15975445007)(65816999)(76176999)(64126003)(50466002)(551934003)(93886004)(3846002)(83506001)(33656002)(6116002)(65956001)(586003)(4326007)(1096002)(2906002)(2950100001)(47776003)(54356999)(50986999)(19580395003)(5008740100001)(66066001)(230700001)(92566002)(65806001)(85282002)(18886065003);DIR:OUT;SFP:1101;SCL:1;SRVR:BLUPR11MB0675;H:decina.local;FPR:;SPF:None;MLV:sfv;LANG:en; X-Microsoft-Exchange-Diagnostics: =?utf-8?B?MTtCTFVQUjExTUIwNjc1OzIzOlFOZTU4Slk4YTNDVWNjOEE3OXVIMmJxdkdi?= =?utf-8?B?WmhDemFueUVZcGpJYlpDaXFweDBOdkJQU2ljb0ZCb3U5TFRNOURtQVh1Mys3?= =?utf-8?B?SzRycVZmZWZ1bTBVL0lNRWN0OTRFdE5xbGs4ZkExb0JqNVdMczhvMCtvdmhk?= =?utf-8?B?OTEwWVB5TThDYVBPd0Y5OVlQekV5cjl1dEQzRm1LRXp0OE9lc3ROU2J6cExI?= =?utf-8?B?ZEpQQVFNdWljaVF5Z3RUazNmOU1QaXFhcUVGU0wybzNsMmw4TDJaeFN2OTVZ?= =?utf-8?B?dlMzYmQyeWgrbm5zWGV2MUdpcnE1aDNJZjVuNmpjK0E4S280ckl5Q2pDb0J5?= =?utf-8?B?K21ndmVMYzFIaEpLcWRlSzBDRDM4SGZnMmtXR3E0MXcvdHowWjdxNWREVjcv?= =?utf-8?B?YUN6eU80RUlkbnBTMHBsWTg3aHBPbUlwaUVQUXhBTlEvWWxCT1lONGxoOG53?= =?utf-8?B?bWZHbmV5aDZaNFhOZzYwNXcrSDFENDRjNnF2NFYzVGFKK2EwV1FnUzZybkd4?= =?utf-8?B?d2JoZCtpV2pOcUJpSVZZcncrRi9KUS9jVUIrTnVFMzdzUTdXNlA5WldCTFow?= =?utf-8?B?UkhMRWNFOFl6TTNWRTNxZHRWamRxeGFCUkF4Qnh3KzM0bGdYZkNzdHNWa3Nr?= =?utf-8?B?cVVSQlRTc2xJWUJiRjlDdjFZMjBWK0IxaUxXS1IwbVNDSlBzLzh5V3RXS0Ux?= =?utf-8?B?T2RuRFBadGgyUzc1aFNpVDlnMTNJcHJXSjczYmozTGRjSDg3d2NJZTFJMXFm?= =?utf-8?B?T2dIaDkrODZEc1c2YnExN1Q4REcxNUFobkVGWVNWcGpXUmtKWlkyUXNaNkpD?= =?utf-8?B?YWdubFBaZzlpK1VQSG5FVVdzZnR3eGZSYW5jZmtJQ0t6TjdSei9yTWxjdldq?= =?utf-8?B?RlpvUTVFUUM2cmRZMHNYTjViSHVvMWZ1UW1iZFZCS0p5MGtOdDBGZ3ptNEtL?= =?utf-8?B?ZU9RcndBdFA0Um9mRmsrNzlvMS93SHlpeUpxOHZ6S2tKcUc2OXFEVTlQNmRt?= =?utf-8?B?dGMzRVE5bkQxcVVOR1M4WDBwbnliU2prU0dQQnBWT3puMlJJSXRzRUpiaFpM?= =?utf-8?B?R2s0cmp5QWxzT2RFVG9IaERvQTVSZm5UaDR3ZUM2TDNMeWRmcldYb01CdVZT?= =?utf-8?B?bGJJWm94aWkvVkpJK0pYYVB6TTB1ZmdYY2JDVk95dTMyT1E2WURWM2NXcitL?= =?utf-8?B?Z3BoaVBNRlJnSXpXdUlpeWQxUmpXUEpTK09VL285WU5LaElrNEZZS2gzb0Ja?= =?utf-8?B?dXVDTTVuM2RjaG91V2tuWEJmK2FsbzI4V0VjTXphd1NqTXNnZ1E4S2ZLUzY0?= =?utf-8?B?MldGMHNsL0s5TXBBVEhBU1dTWlVNV2lnL3BjWFV0eEpScnYreVFELzVFWm93?= =?utf-8?B?K1FkR1dxSzN1UUQ4VmxzQnIxSTBVSkRNVElEcmYyUW40L0RKWEJOZFZJY2JH?= =?utf-8?B?VFN0WVk2Z1lCMnptN0MwelBhdi9HT1djcFVERFM0V29odjhReHlJaXdzRm1n?= =?utf-8?Q?g8Kfg87J6HXBKqQxlfkEvaEUY=3D?= X-Microsoft-Exchange-Diagnostics: 1;BLUPR11MB0675;5:QM9VmHCADUmTur/AZPUGCJ1dg/fWHFRk7WcbMInoYepCO2QrvoOhevq7lc90eG/4pNtp7aP3GMal7xHw7XG93FY9qeQXgWFwwlQ+fhhFMlVxEsO5ejaKNbZhZxVwvW4MnBY/M+R1/bmn63s72EWjdw==;24:ko0OJtG7P7ZFWkRyv8yZhOgFW592CBhmeA9iJgtC2ZFd0CMQF1Gu6AKSTaxwjmlI2opcL64dGc9PPt7pAYf40JEoiz68+w5usLF/7c41xzc= SpamDiagnosticOutput: 1:23 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: bluetreble.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 23 Mar 2016 03:21:26.8066 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: BLUPR11MB0675 X-Pg-Spam-Score: -1.9 (-) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-hackers Precedence: bulk Sender: pgsql-hackers-owner@postgresql.org On 3/22/16 9:36 AM, Amit Kapila wrote: > > > Note, that we are doing it only when a transaction has less than > equal to > > > 64 sub transactions. > > > > So? > > > > They should fall on one page, unless they are heavily interleaved as > pointed by you. I think either subtransactions are present or not, this > patch won't help for bigger transactions. FWIW, the use case that comes to mind here is the "upsert" example in the docs. AFAIK that's going to create a subtransaction every time it's called, regardless if whether it performs actual DML. I've used that in places that would probably have moderately high concurrency, and I suspect I'm not alone in that. That said, it wouldn't surprise me if plpgsql overhead swamps an effect this patch has, so perhaps it's a moot point. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers