Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1ZeqrG-0006GM-0l for pgsql-hackers@arkaria.postgresql.org; Wed, 23 Sep 2015 20:41:42 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.84) (envelope-from ) id 1ZeqrF-0001no-IQ for pgsql-hackers@arkaria.postgresql.org; Wed, 23 Sep 2015 20:41:41 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84) (envelope-from ) id 1ZeqrE-0001n1-7Q for pgsql-hackers@postgresql.org; Wed, 23 Sep 2015 20:41:40 +0000 Received: from mail-by2on0100.outbound.protection.outlook.com ([207.46.100.100] helo=na01-by2-obe.outbound.protection.outlook.com) by magus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84) (envelope-from ) id 1ZeqrB-0002J0-Ad for pgsql-hackers@postgresql.org; Wed, 23 Sep 2015 20:41:39 +0000 Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=Jim.Nasby@bluetreble.com; Received: from decina.local (70.113.16.71) by CY1PR11MB0684.namprd11.prod.outlook.com (10.163.236.22) with Microsoft SMTP Server (TLS) id 15.1.274.16; Wed, 23 Sep 2015 20:41:30 +0000 Subject: Re: Less than ideal error reporting in pg_stat_statements To: Peter Geoghegan , Tom Lane References: <5601D354.5000703@BlueTreble.com> <15898.1442965225@sss.pgh.pa.us> CC: Pg Hackers From: Jim Nasby Message-ID: <56030E72.9070104@BlueTreble.com> Date: Wed, 23 Sep 2015 15:41:22 -0500 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset="utf-8"; format=flowed Content-Transfer-Encoding: 7bit X-Originating-IP: [70.113.16.71] X-ClientProxiedBy: BY1PR15CA0009.namprd15.prod.outlook.com (25.162.17.147) To CY1PR11MB0684.namprd11.prod.outlook.com (25.163.236.22) X-Microsoft-Exchange-Diagnostics: 1; CY1PR11MB0684; 2:YuHVcz8R+StWxO0RIJi/p4uijTOloRaoDB/zuKvl04QUbfvWsnmSW124AYZv85WKdDI5/kE9fZV9M6JXt4S0ZvpI+jRUaaqE4G9uvHilMUM2LgLWJABfiFZbSnRdgPt2knLdSjLpakx6RiJLpkYN6SWqNyXDa4b4ycolnT8hLBg=; 3:GGGBK+iNd+s4wL4aio64MyBiVlOZVx3ZmEJEzewM9pV4rtkbHNKe+KpOz85jc3xuWt8HqaHeme/NIwDJJWfN8ETDhF5lfI97BZKgNVOvY062DpWqIedKFCVdeI9lAR+5ltzcMII5MYAHgG3GnExH3A==; 25:DkAfcHZLklJopM14u9/k5XgR+ny1ZPmB8z6ddb7rtDDwzs7UyeD4MdNYZYmqVOQc6inzTvo1RtV5M2NwRLZ6Y68Uy9QwZULNHvtcSmooy2wsECo+ciM6DVhjN0Uxsgms6ZkczMQJSt35/lMVMdl1/EJxEc52gXAXiTokP1W99xvJMVEjSgkhL82ZpU/OGiwyjKR4WxugVo/KQvIBtifF5yj7gcrgtkVSAViM9Q4S6kJBXYwo8tiOtdDVfXB7bFpW8OTz0PodfED3ROiA5ACJSQ== X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:CY1PR11MB0684; X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:; X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(601004)(2401047)(8121501046)(5005006)(520078)(3002001); SRVR:CY1PR11MB0684; BCL:0; PCL:0; RULEID:; SRVR:CY1PR11MB0684; X-Microsoft-Exchange-Diagnostics: 1; CY1PR11MB0684; 4:Gl/ut/WEZNjPyk+GgZCP6HC5qRI4BeZykw9LoJyE85ssd0HvC2j6x2SPgRhZEhzLKhDZ/ao6oj12nV1tEsoYWgS25Slnce0NOjnKc7aWuHxs7e/zxBHLVTIFWOO3CCLBftOi65BERGohAfq2IEnrE3v6HVbnFaZkaUc8p+e8hiIuBK3pbFDFb6935t2GLez/Iys6LlTLCf9nfcy4ENkJqwRkVj+kFmpCqediw3bps3JbIczv7uM/70QdzjoYZY+47yuugf6Lg+ceXvu3S8jImTfb2WzyhS0NnSP4p+EJMNS1dCmoeFQEhQOoMQUJPT/1CMViwl13u+iEMLMceqRpc5ONln6wi/X9LozxJA7miX0= X-Forefront-PRVS: 07083FF734 X-Forefront-Antispam-Report: SFV:NSPM; SFS:(10009020)(6009001)(377454003)(199003)(189002)(479174004)(24454002)(65956001)(93886004)(62966003)(64126003)(68736005)(46102003)(77096005)(92566002)(80316001)(50466002)(19580395003)(86362001)(2950100001)(83506001)(105586002)(47776003)(40100003)(106356001)(4001350100001)(101416001)(87266999)(23676002)(87976001)(33656002)(122386002)(5007970100001)(42186005)(59896002)(99136001)(64706001)(97736004)(76176999)(189998001)(5001770100001)(77156002)(5001860100001)(5001960100002)(65816999)(81156007)(4001540100001)(36756003)(5004730100002)(5001830100001)(54356999)(65806001)(50986999)(66066001)(15975445007)(85282002)(336755003)(18886065003); DIR:OUT; SFP:1101; SCL:1; SRVR:CY1PR11MB0684; H:decina.local; FPR:; SPF:None; PTR:InfoNoRecords; A:1; MX:1; LANG:en; Received-SPF: None (protection.outlook.com: bluetreble.com does not designate permitted sender hosts) X-Microsoft-Exchange-Diagnostics: =?utf-8?B?MTtDWTFQUjExTUIwNjg0OzIzOis2aFFZNGxEUlBDQnkyQ3VQWlBGZElyOEpF?= =?utf-8?B?Y0pLdTFRVUN1VlJUZXJ0OS9TUUJWeDI3NithQWFLQ1FCWnpLNGpXeXI3RGNs?= =?utf-8?B?N0IwUTNPbGJaaC9XcTEyMytRQnFhMklyTzduM2VKTnlhUjRGYjBCclpNb1U1?= =?utf-8?B?TVY4V1dVQWlNRDh6VjFPdk9SV2VaVHRxQ3JyWnpkQzBWdHp0QW55VU10VzVq?= =?utf-8?B?cDhFQ0ZRUUtNZFF5MldzQmhlNmx4bnpNcWJ0ZlVYbzNNdHpKaVZyaWFBMVNV?= =?utf-8?B?eUIxWXM1MEZKS0RHNDdxVm5iVEM3RDFkWnRmSlh3UHkxN3ltanhXbzJLMDdK?= =?utf-8?B?Y1FOejFldldxRWMwbkNqWk41Nlp0RVE1S3J5b3dKK1MyYllJQnpxeHNCdSs5?= =?utf-8?B?eU1PcXJGUmxDWjZtRHFLdzZERmdCdFpjWWdGT3M1djY2eFN2S1BQUGFJdWo5?= =?utf-8?B?L2RwUHU1U1R2NXZyVHhTbUw4bGdiQmd6Y0RpdnJFZ3hFNHZpZVFacE1kQzJx?= =?utf-8?B?L0FiVzNvWDhDTmNvcGdjNEdIeHBLbGhVTmRLeGJ1QjYrZlF3eHIrZVZUSXdC?= =?utf-8?B?VHNUc2JwSngzN29kd0YvR1RRZmF2eVJ0ajVCSEpvZ252NmZWcmI3VUNVMG40?= =?utf-8?B?THNmZTZ0T2NSZ21HRzI5YkpMWDNaOFpHaWk2cExrSHBGM0lybkFweVRMRHhT?= =?utf-8?B?b1hvb1BCbXZJRzdkV0FreWN2cGRQZnRGTnpxZzZ1T29CNXEzY3dQOFBWOW52?= =?utf-8?B?Zjc1SFgwS0QxNDlRTXdhVHluYkZiWVd3ak9XY01LZ0I1WklqWWl3T0FGOEQr?= =?utf-8?B?S3Q0QndSamU0WnNOVGlJR3NydnNGLzJSd0g0dFRLVHlKdjlxdkg2ekRpZGk3?= =?utf-8?B?QmZONHlrYUJGNFJIZG0xQytBWXJnbS9wOXNraWxFZDdWQmJ2YXl3TG5tZ1Fw?= =?utf-8?B?c1ZaNytBcUczR1FWZ0tCaFQrdnRVNGpBNmRjRDI2VUU1cXQzMmZoR3RpWmhR?= =?utf-8?B?ZExCMzBpRE5JeC9uS0V1dktqNXJLa0dXdmV5Y3plSFgvV2tKczcvb2ZCeVEv?= =?utf-8?B?b0hPQkdBMnUvZU4zS0htNlRMZHZhYzV5MERHUHl5VU8zMW5wTG5EMExTR2NY?= =?utf-8?B?S2Vhek8zRmdkUE9JOG9MWEF1b0ZKWit4Smk4RjBlZkhDaC8zcFhPZXI0MjZm?= =?utf-8?B?NHZYalNTcGVyL09HZ1NOYzZOd3d0WjdHWW5hOFIzbE84a0JvVThMZ3I2VDhK?= =?utf-8?B?UEwzK0VzdENGaURwUzRYb2JCbThhR09sdjlTdVVNdXVWU21XZnVqMGxDZ1kz?= =?utf-8?B?RXlLcmhBZGpMZnFkSm9LbEYyaWJvYis4UFhsNmcrNjJ0YXZMVE11L3JnZkFG?= =?utf-8?B?RGlqSkNaK1NpT3VabDZvcVRxWWVqTDhYalZzNFJCRWFQMFhodGhvaGlMYjAx?= =?utf-8?B?T2t5ZW52OVNxd0JPdFA1SDFFb1RESnlWdWMyL1BoV3U4NVFDc0c2ZlBuYVVE?= =?utf-8?B?N2pSWjhwb04zQTh2TS9YSzIvOC9tbXVCTjI3b1VQQ2lBelNCc2Q3cGt4YThu?= =?utf-8?B?SEQ0Y2FqclFGVW1uNnRNSjF1ckYwQi9iT3cwa2E4Sm1TS05tL1hYWVBwVUZ5?= =?utf-8?B?ejhxYXZiYlNodjdEd2xHT2JzVUhubTI2dkVtejI1TGE2TWQvK1dGZlM1ZHJj?= =?utf-8?B?SVVUNndseFluNXgrYnZSTWtZOEgrS2hTM1BvQ1FqSHJuL0JORkFsSmtDdHM4?= =?utf-8?B?OVA0WWFQQ1NRbDBuZTFUcTZJVC9nekVwbmdibGk0VisrejZRazR6Y3JQR1Ax?= =?utf-8?B?clFWWVNyV3NrekxjbldaQitCampuajdVUW9RL3BKV0lJZ1VzeERacGhOZDJh?= =?utf-8?B?ZkdOYVhJQW5nWml3bGZEbWRENnZ5eURvNm5laWhUeVpaYzVFRHBPK0NsKzN6?= =?utf-8?B?Mkc3dVFWenNCZWRtNjgzcVlXYVMxbHh6dy9SQWlYbXhMYUEwRFgxMmtqb2Vs?= =?utf-8?B?NWJxS1BZa2tIcEt5TzcrRG1sZm1FdHlwaHNtKzVUWlFPR2FoMElLMkZ2cU85?= =?utf-8?Q?QB7A=3D?= X-Microsoft-Exchange-Diagnostics: 1; CY1PR11MB0684; 5:PtKxKP2KRX3m/uzbn4V4LJLr/XmChmSKucM04rDs4gCMsYNAd862lWY8EI0M6h0q6LXQGYrOQh0Xc5R7+Mrq+w7A5iCFldFbB6sr4ay/OvUxeO3NzGOlUCQdzh//pZDwLKjOidifGRQFqA6qH9iLMg==; 24:IqDVjYYEFnIsTQwzxLYR7R2RZaagdy6lppKIgFHl+Bjh81jcDQMjiUsHHbgVU7ebOcKBv7cgqKp2Qp3W5e3C3j6YLmP0wcFr2BYievJ8SCI=; 20:z0ndE31iyRu81HiNtVUlcacZOtTSD+2vfnIqPCmLMhRwz6yoXaV6D4j0u7HWHJGRIBB3ZyVPLSKA6SYMrZlb3g== SpamDiagnosticOutput: 1:23 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: bluetreble.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 23 Sep 2015 20:41:30.9449 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: CY1PR11MB0684 X-Pg-Spam-Score: -1.9 (-) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-hackers Precedence: bulk Sender: pgsql-hackers-owner@postgresql.org On 9/22/15 8:01 PM, Peter Geoghegan wrote: > I'm doubtful that this had anything to do with MaxAllocSize. You'd > certainly need a lot of bloat to be affected by that in any way. I > wonder how high pg_stat_statements.max was set to on this system, and > how long each query text was on average. max was set to 10000. I don't know about average query text size, but the command that was causing the error was a very large number of individual INSERT ... VALUES statements all in one command. The machine had plenty of free memory and no ulimit, so I don't see how this could have been anything but MaxAllocSize, unless there's some other failure mode in malloc I don't know about. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers