Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1ZeWyH-00036D-9c for pgsql-hackers@arkaria.postgresql.org; Tue, 22 Sep 2015 23:27:37 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.84) (envelope-from ) id 1ZeWyG-0000si-Rt for pgsql-hackers@arkaria.postgresql.org; Tue, 22 Sep 2015 23:27:36 +0000 Received: from makus.postgresql.org ([2001:4800:1501:1::229]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84) (envelope-from ) id 1ZeWyF-0000rl-Dd for pgsql-hackers@postgresql.org; Tue, 22 Sep 2015 23:27:35 +0000 Received: from mail-bn1on0099.outbound.protection.outlook.com ([157.56.110.99] helo=na01-bn1-obe.outbound.protection.outlook.com) by makus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84) (envelope-from ) id 1ZeWyC-0001FS-EL for pgsql-hackers@postgresql.org; Tue, 22 Sep 2015 23:27:34 +0000 Received: from BY2PR11MB0677.namprd11.prod.outlook.com (10.163.111.19) by BY2PR11MB0582.namprd11.prod.outlook.com (10.163.159.148) with Microsoft SMTP Server (TLS) id 15.1.274.16; Tue, 22 Sep 2015 23:27:29 +0000 Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=Jim.Nasby@bluetreble.com; Received: from decina.local (70.113.16.71) by BY2PR11MB0677.namprd11.prod.outlook.com (10.163.111.19) with Microsoft SMTP Server (TLS) id 15.1.274.16; Tue, 22 Sep 2015 23:27:26 +0000 Subject: Re: Less than ideal error reporting in pg_stat_statements To: Peter Geoghegan References: <5601D354.5000703@BlueTreble.com> CC: Pg Hackers From: Jim Nasby Message-ID: <5601E3D1.5010401@BlueTreble.com> Date: Tue, 22 Sep 2015 18:27:13 -0500 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset="utf-8"; format=flowed Content-Transfer-Encoding: 7bit X-Originating-IP: [70.113.16.71] X-ClientProxiedBy: BLUPR08CA0069.namprd08.prod.outlook.com (10.141.200.49) To BY2PR11MB0677.namprd11.prod.outlook.com (25.163.111.19) X-Microsoft-Exchange-Diagnostics: 1; BY2PR11MB0677; 2:zfBDWR8todlP3TOwk7EJxbWhVymIPBPSrGAQC58YFg7ySOIg8m76daWi43Yp74D13C6mIhM45pQQ8wejiaVeDAbx+Pmz45VP9De1hxwhBT9PngBXyw0Yn0y0IZAnbQ3fwA5Nuz8RBPKBuUBr/CmjjjVoMChkGmCKvBxYMNb5YdY=; 3:I+m1HqhB7OAT0SKKFyDiblE/v4NSn/WUjLI3HZi4/hiwlAo0FNf4aNuNcGUV02t12ZFbIwF+J9zdWiBxEs2GdQ3h76EBMaJTVj+n22Ve4zL+M+a+xSIyn9ZZgxFHIlD3J/3MSepobl3zu+MUyb17qg==; 25:cIQ0wefN0sIPRKguX2IlCX2Gnf/ZYujSu2U3RL1h2YYsRt6WT/6ibjeJ7JjN2YidgbSR8B0PHgeMVbBl6beuuwqCJq0Bj8h20yHpg1TVc6WYFNdaaYxo68+fXb0733XL23l348wOpWVcjJercjEtBoklGx8MMBgMjUWRdCUrxghvn6cvl40ZO+nGWy86qp2m8CAkpdpvDFaI1l9HSn8Ll4LVmT84X/BYJqtkw/esg01Tkx5LNm84MT6qmD4A/EhU; 4:gw/0UruCdOOfAszyT+7rJZtlS5QpwlLp7c3rTHHQT2xydziTsYxPH9YMFxO/pKXKI1SHVa9+/zvEgGoFaGmS7WqxS4ZpIDWTrRw2zdtxRc2Zx0vAlUWSMkHW583YnuNQ5gALYjxkaXDsdLBXSjrcUbT4zKdVk1F1oBw/FMxov5huUvqpfCcvKqtdsbgh2iKAwxLns4wTb7xupTe3WQAWVvdBBU+LBEN5AzDMbkipzNHst0/ZbFmpBPJx+Ulof5XkjJO7ET31UsGnWFlcxfqUYkV5eFcSsJbTHK3aTtZurYem6sXCchihg6cAFUQX+rUM6kF5MJiDjfHFwV8MFeS5wZjGVizoF8+pgjgtjIQGFC0= X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:BY2PR11MB0677; X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:; X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(601004)(2401047)(8121501046)(520078)(5005006)(3002001); SRVR:BY2PR11MB0677; BCL:0; PCL:0; RULEID:; SRVR:BY2PR11MB0677; X-Forefront-PRVS: 0707248B64 X-Forefront-Antispam-Report: SFV:NSPM; SFS:(10009020)(6009001)(199003)(189002)(479174004)(24454002)(377454003)(36756003)(87266999)(23676002)(5007970100001)(2950100001)(5890100001)(15975445007)(189998001)(76176999)(77096005)(33656002)(87976001)(64126003)(5001960100002)(68736005)(40100003)(92566002)(54356999)(65816999)(5004730100002)(110136002)(50466002)(86362001)(5001860100001)(4001350100001)(19580395003)(50986999)(122386002)(4001540100001)(42186005)(5001830100001)(105586002)(59896002)(81156007)(80316001)(62966003)(97736004)(77156002)(66066001)(65806001)(64706001)(47776003)(46102003)(106356001)(83506001)(65956001)(101416001)(19580405001)(85282002)(336755003)(18886065003); DIR:OUT; SFP:1101; SCL:1; SRVR:BY2PR11MB0677; H:decina.local; FPR:; SPF:None; PTR:InfoNoRecords; A:1; MX:1; LANG:en; Received-SPF: None (protection.outlook.com: bluetreble.com does not designate permitted sender hosts) X-Microsoft-Exchange-Diagnostics: =?utf-8?B?MTtCWTJQUjExTUIwNjc3OzIzOk5YdjJ5Z0ViWHhHSjJ5L2I4NysySjV6eGcy?= =?utf-8?B?OTBxU3lCYmV6czRIdlU0SUZGSlVzc29YSVB2WkhtdDE1akRSYStBclcyVkdv?= =?utf-8?B?RCtrZHNWQlpZTzJHSGJ5S3h2dE03ZGdZU3VscHVPTG5Xc0N6cy8vVFo5Q2Jl?= =?utf-8?B?QUJ1a0V6b0JGUDlvVTBXVEJJL1o2em1DVXlIeTBQY2ZMSC9IYmF5VkVUSVhM?= =?utf-8?B?UVU5M20xNzFiSHNyL1JWdjRxNXJjYnhOUWVsUS81N0lDQjdtbTkwWU1rTjRZ?= =?utf-8?B?WFF6cFFWWU8rVDhacW0reUUydUVLUlFpUjNUVUcreGtrZ0tHc1BlWWxOUmhE?= =?utf-8?B?RmRJMWlJaU52S0x2bG03UzhYaWZPa1Q3cGdhd05UTkEzQ1dSaU1VQThZM1Ix?= =?utf-8?B?bXpnSVFTRk50U2c2TDYxbTE4aFFNeVQ3bmEyOGJMem9CZUJCK0NFd2VmYzJx?= =?utf-8?B?UUd6ZDdxMElwZmZ5SVVLYlV1bDF2UEFlWG5aVlR5ZElUUFVuUDk2SEloRHFP?= =?utf-8?B?QU85QjN3Zm4yaHdMV3c0V3RQbDRrUkg2QncrM245S0NoZkdkYlAxRHd5RVdB?= =?utf-8?B?Y09DRGdyT0dLZ0s5dGppZ2dYY09kbFpzRzFGdEs4clIzeW1RUVMyT2RIWVhr?= =?utf-8?B?RThDdHRTZDJjdEZzbjBkZW5BU1MwdWNmVDQ0b2IxVkxzVUovNllnZitwQldm?= =?utf-8?B?WTYyNVJ5SXJ2QU9ORVRiL2hwSHU5SWdnOGpsb3VPc1lWbzdtWmpkNHFUMjBj?= =?utf-8?B?ZFdyalBJbTk2VC9ZRUZiRWg1c3N3NklIN0JzbFlVWFduRDNTeXBqTG44MXRX?= =?utf-8?B?bVJJclIxRjZZbTVOV1NHVUNFeGlxajFXM1NETkV3UFlMTjUvL3NscGp1ai9W?= =?utf-8?B?eDZvR0VDZ3F0S3FzYkx2SHJQdlJoZndyOGxONHZXbklOeW4yV3NSTW1hSFda?= =?utf-8?B?VjJJcmJwdzNkVnZPT3kwZXpwUVhjNmpZRlFNZ2JmR2ViaTJQUnRGTnowOU4w?= =?utf-8?B?dk1zRmZXYUJneDE4RTU0WUZQY0xSelB5OVFrU1NUYTBPWjlBOHgrVHhFWEdp?= =?utf-8?B?V29mbnVCV2NHclJiNUl3V3FFTUFYUlNiMkc2dzMvcFgwUlNNZVU2MGRaeHZs?= =?utf-8?B?RW0yeU8vVTU1THdRdGlVTHJ4dE52ZjZwVTROeGN5QTBEcTdrd28zWFl3V0hG?= =?utf-8?B?WGQ4Q0ZWVXpiNVRVdmwwU0FyRHpxV3p2d2ZCSnVtbUZUK0c1Um9ramtVblE5?= =?utf-8?B?V3B6Q0ZYUmwrdVFZY2d4Y0lhLzhnRkVtSHBiakFqU0FDbDhnalZrajJaYURN?= =?utf-8?B?aWx2VzYxdWZtRTIzV2xXZVR6SkRWYmdQRFF3VVNveHFZNFN2bTNLLzUzbzFF?= =?utf-8?B?Q0hqRE5uWHF0TjM1T3o3dUxmaUVSSHNZS0xYdGFBaEd6cWFHa2xlOFJ2b21E?= =?utf-8?B?dUpXcGVlMjNNTFp6cElZajBXbW16VmxUak4yYWU3UlQ1UjZPa0ExTWczbWMx?= =?utf-8?B?K3RDTnduUHdQTlR5cmNLYnRHR3JmbTdoSWt2TDZDdjlJNFgydHM3MFl2c3JM?= =?utf-8?B?bE01Vm16cUlPY2hyUGVKcGY3QVJzd0h6aHVyc25adWRSeTBDMDV2UWowbUhD?= =?utf-8?B?YXFkM1Z2YkhvQ1FiZjlPYnFveURvZjlCTll2WjhhSkVqMUU2TTQ2THdFY2Jr?= =?utf-8?B?cDFmZDhCU2gyUTNYL3JBV2FybWo0eGJUekJHY3hjQ3h6dWRDTHJHUFcrUWdR?= =?utf-8?B?OStIUW9QVS9pZVpJOEJ6RjdvdGg2L3Q2Qm94ZXpLcTQ3V2x2Kzk5T2JxMEp3?= =?utf-8?B?bmhwVkpEUDYwQXRlVERvaVNYY3JZZzduVDViUzd6bkRWM25heGIxb3cxblJ4?= =?utf-8?B?SVJQUEJQVCtWamV1TVRXUjhuZDZvQ3UzaEtKV09qSDZCK01aQ1ZwWTVRSmVR?= =?utf-8?B?OVhWNVlvVGo1RnFqSndwaHVPT0pGVmFGNlpJTmZWSi96N29zWlZ3bGQvUFRD?= =?utf-8?B?THlkTkVyTnoyaVRrMVBvQ2RMUzdGcXJneXFHOVJXK1pGOEtteGxkWkVVVHBx?= =?utf-8?Q?XuKE=3D?= X-Microsoft-Exchange-Diagnostics: 1; BY2PR11MB0677; 5:2PP0fL8XPkcDbnpiPPEYNaTMqn0ycQ41xfVQqZLVsHdGQe/00gIu8+6AM+4IDqzw9uEBrv++LRjkLOuCO5VY04FkxWBtPiEqcGC2PbNDTAXFf7dbtnYe21iqeSlgIg+rxuzzUs++vbrHMMXwnur9Sw==; 24:95vn41X3RLpIbWWVbgyE4fnGv6UNkRKrRs+jwMC262Qld+zTPiaFGED9PCB2wgBfQK7vU2oR2OqJm9ApWVMSLiqo5/bBQoMG8UsARGfY6Lg=; 20:60bsCYP9KYQ7rfy/5NNaVjdkt/jw8GHls3FjYb7cnlzzzW27LmWZMeyxbnRHfZiDlsgYvtG4QR78Sh08KnFkbw== SpamDiagnosticOutput: 1:23 SpamDiagnosticMetadata: NSPM X-MS-Exchange-CrossTenant-OriginalArrivalTime: 22 Sep 2015 23:27:26.7088 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: BY2PR11MB0677 X-Microsoft-Exchange-Diagnostics: 1; BY2PR11MB0582; 2:kQ7CLSCVQg462E9PNjjKZldvUEndqc4epO3CN62pXcwX1mT63yrVjmlwZ+s+JihXp0hfrBNAX0L3nbFZ180R6bRPbMs/XEzQmcvkV4LeHl3bSWBTpSGL3Drtb4bGg99mjsnb+GIn4y+Jr46lIIVGbUXXhrsIMzp6Mv+S0HDqmGw=; 23:+YEMjiLUhjkq2JRNC3xZ6khSVeN+PAMBHuTvK39//ffJaKvQcmmJU48klQkYIXeKZitF9mfMY9lxCLPou5sKLd2y2d6dTxrKBp9gaj3+eUHiIgKnn6uIq8QZkxkIgU6rmvDSNi5XA9OPnbsrFx3Z7bRhGxYdeih339XfO5mxegGA+iWEBrvJcCJ7v7LbyGu+ X-OriginatorOrg: bluetreble.com X-Pg-Spam-Score: -1.9 (-) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-hackers Precedence: bulk Sender: pgsql-hackers-owner@postgresql.org On 9/22/15 5:58 PM, Peter Geoghegan wrote: > On Tue, Sep 22, 2015 at 3:16 PM, Jim Nasby wrote: >> At first I thought the lack of context indicated a palloc had failed during >> ereport() (since we apparently just toss the previous error when that >> happens), but it turns out there's some error reporting in >> pg_stat_statements that's less than ideal. Attached patch fixes, though I'm >> not sure if %lld is portable or not. > > + ereport(LOG, > + (errcode(ERRCODE_OUT_OF_MEMORY), > + errmsg("out of memory attempting to pg_stat_statement file"), > + errdetail("file \"%s\": size %lld", PGSS_TEXT_FILE, > stat.st_size))); > > Uh, what? Oops. I'll fix that and address David's concern tomorrow. > I'm not opposed to this basic idea, but I think the message should be > reworded, and that the presence of two separate ereport() call sites > like the above is totally unnecessary. The existing MaxAllocSize check > is just defensive; no user-visible distinction needs to be made. I disagree. If you're running this on a 200+GB machine with plenty of free memory and get that error you're going to be scratching your head. I can see an argument for using the OOM SQLSTATE, but treating an artificial limit the same as a system error seems pretty bogus. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers