Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.84_2) (envelope-from ) id 1eYaw9-0004hA-HK for pgsql-bugs@arkaria.postgresql.org; Mon, 08 Jan 2018 17:10:13 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.84_2) (envelope-from ) id 1eYaw8-0001TR-Mz for pgsql-bugs@arkaria.postgresql.org; Mon, 08 Jan 2018 17:10:12 +0000 Received: from makus.postgresql.org ([2001:4800:1501:1::229]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1eYaw8-0001Sf-E2 for pgsql-bugs@lists.postgresql.org; Mon, 08 Jan 2018 17:10:12 +0000 Received: from mail-bl2nam02on0044.outbound.protection.outlook.com ([104.47.38.44] helo=NAM02-BL2-obe.outbound.protection.outlook.com) by makus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.89) (envelope-from ) id 1eYaw0-0004oQ-Nb for pgsql-bugs@postgresql.org; Mon, 08 Jan 2018 17:10:11 +0000 Received: from BN6PR10CA0032.namprd10.prod.outlook.com (10.175.102.146) by BN6PR10MB1874.namprd10.prod.outlook.com (10.175.97.137) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P256) id 15.20.386.5; Mon, 8 Jan 2018 17:10:01 +0000 Received: from SN1NAM02FT031.eop-nam02.prod.protection.outlook.com (2a01:111:f400:7e44::201) by BN6PR10CA0032.outlook.office365.com (2603:10b6:404:109::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.20.386.5 via Frontend Transport; Mon, 8 Jan 2018 17:10:01 +0000 Authentication-Results: spf=permerror (sender IP is 192.231.134.1) smtp.mailfrom=blackducksoftware.com; 2ndquadrant.com; dkim=none (message not signed) header.d=none;2ndquadrant.com; dmarc=fail action=none header.from=blackducksoftware.com; Received-SPF: PermError (protection.outlook.com: domain of blackducksoftware.com used an invalid SPF mechanism) Received: from ops-mail01.dc2.lan (192.231.134.1) by SN1NAM02FT031.mail.protection.outlook.com (10.152.72.116) with Microsoft SMTP Server id 15.20.345.12 via Frontend Transport; Mon, 8 Jan 2018 17:09:59 +0000 Received: from bds01237.bds-ad.lc (unknown [10.1.6.127]) by ops-mail01.dc2.lan (Postfix) with ESMTPS id 4DEDA459AF; Mon, 8 Jan 2018 12:09:56 -0500 (EST) Subject: Re: BUG #14932: SELECT DISTINCT val FROM table gets stuck in an infinite loop From: "Todd A. Cook" To: Tomas Vondra , , Andres Freund , Tom Lane References: <20171127185700.1470.20362@wrigleys.postgresql.org> <7a22f496-92b5-d199-984e-183965918304@blackducksoftware.com> Message-ID: <55d69e3f-f074-7838-153c-4d1539fe5802@blackducksoftware.com> Date: Mon, 8 Jan 2018 12:09:56 -0500 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.5.0 MIME-Version: 1.0 In-Reply-To: <7a22f496-92b5-d199-984e-183965918304@blackducksoftware.com> Content-Type: text/plain; charset="utf-8"; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit X-EOPAttributedMessage: 0 X-Forefront-Antispam-Report: CIP:192.231.134.1;IPV:CAL;CTRY:;EFV:NLI;SFV:NSPM;SFS:(10009020)(396003)(39850400004)(39380400002)(346002)(376002)(2980300002)(448002)(50944005)(199004)(189003)(24454002)(5890100001)(53546011)(36756003)(50466002)(53416004)(31686004)(316002)(8676002)(81156014)(83506002)(47776003)(110136005)(97736004)(81166006)(86362001)(58126008)(65956001)(65806001)(85326001)(67846002)(305945005)(26826003)(104016004)(53936002)(8936002)(31696002)(64126003)(2870700001)(2486003)(23676004)(65826007)(2950100002)(5660300001)(478600001)(229853002)(6246003)(356003)(77096006)(2906002)(76176011)(6266002)(106466001)(217873001);DIR:OUT;SFP:1101;SCL:1;SRVR:BN6PR10MB1874;H:ops-mail01.dc2.lan;FPR:;SPF:PermError;PTR:ErrorRetry;A:1;MX:1;LANG:en; X-Microsoft-Exchange-Diagnostics: 1;SN1NAM02FT031;1:zGGPbsXE+lluRllmuFPVw/JJLA1riruivoG8q4sqAK5sD6h+E0pD8849as/VQ+Pu/R6Wp2kjISa0FhOvC81jTOw9KN9CIklaSquN1DFUKkVcEwSNOqMgk4e6F8P/x9qV X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 9ce5f2d5-f44c-464d-cfae-08d556baa65f X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:(4534020)(4602075)(4627115)(201703031133081)(201702281549075)(5600026)(4604075)(2017052603307)(7153060);SRVR:BN6PR10MB1874; X-Microsoft-Exchange-Diagnostics: 1;BN6PR10MB1874;3:ab/bg/9RK6Ki7qcoWP0ipwraUCy75m5Cy0qsSi4qCSgIcUHQI7EFc44qK0g3KQYyXalc0lskAjr0+VcIuZIAetNkrOL5SLcK1wbKpjICFQZ9aowxPyQ6eWmZULKEZKzIBZZT5O7oak4adw9CkBhY8kBVR2/K/70h7Sv3GMDOUYTUDt2oN7dSrHhBLyRBbcreDLev656j1lDSmYGDimmymr8Skfw0EWStbD3+GBHmhqb62qwaiffjNXuiLATiSe0whJb0rZlU7CdE6/MR/8VUPn2EZA9OY6O3QodBwVtHltO3hwDkREHFjIurTwif1FeYKATQJp4sf39EG/Vs2StlFg==;25:uotPV/rl7UIA6N38fKf9QnnJYX9T7ebeLypLVMtmu1zN/gpNCx9vszEhiBBrEd5RfVwj4BYuCGrwqPhBxHblbw74zAHUHPEMy6pasIyx6yziJBoDJYM0cWCltXaAk4rGGuWPNxu+PI3pShHXchuyr/NhWvq/hwYbDQoG7rgTiEoOqMQXX9xKK/aaokceiyuRDVswSZiAEsxY4k8SmMzQJ3mrKA6oMLSbkuccMa5JWFWe9eFPRx9d1eFrTYyBEkZGqD1PiLw0JVP53py+3K9+C1UPv4hoA4n+/kUtyz5MoWfI6JkebbDHGjfMTddZeS9mrc1Ms6/KdVJFsq2kWDVl6Q==;31:YlcFy5Wuw5bUySsKSCI+hBXHvKGOPqf8Vne4/yAf73rxWBBzHHFv5exy1Kw7AJCCYtZqlsq6eZAzcGEv+NvJ8OVOZwDHACfeDxJkDJRjTJAzZU7d8jvVm1b8xvCGvIRaV8Q09t/fEZfeerFsF1SRY52h3dAWxh/SRrDWkVZkZGy6kGCuL92WrTjvR076zTxiL8f/UzV03W81lVBBVCg7jG7BdPUPt7TSLwRQEg++7fM= X-MS-TrafficTypeDiagnostic: BN6PR10MB1874: X-Microsoft-Exchange-Diagnostics: 1;BN6PR10MB1874;20:9NANQU1UujwbIz6YdQPHbbnkyEUFF+RFSHQqXiuV9vNBtxhye7oUAfwq6+hfc6U0h3+1aUDI8MuW/duaqoO+vWJ44xBGEM5tHJKig229PKkwdDNIBg7fNausOjCtIwBPwh+HCHyARUUqGOzCFQxp5C/MioW7Z5cu/RT1TtBJiPE+mFb7y79Xq6W5bv9ep9KMTDDNlOGRbaiOrMnQpgH9cqIYprKQvRU5JPQzIa0utqgUdT5IYockFhZVuUPJwWpDjm5r4u712adSpIZKSyoEC+I6PkIyS7fWh2OSm59aJvEHEPGesUxkuFM5dkNeuFo5mBPHzY8VY6PmNe3o7/lFOJomyLvZaETawH+5ipfgHYMX71egyiT9ZWQMq5B8T3tbnA5D5Jp6hFBljrd7FSj7s+84qXjMlD0uLWsfIFoHVxp5QmPzaSedp3UkVD9x7BohWd3gZS5yxqBm3MC+ZyeQoB6+ZT6s5+hABMmLHHpMYDN0ygLPnLPyayqmOmYt2DTK;4:ia1+kC0CsJslW6G1+xUIpezVHvVXaHau9FGVfQLue7i/ZrFzco45jhmDPNuhm/6eiJ1JV9FJPlqny2OYXn89nB/HiG6Ta0mT//+sJZCBbYe3Rdsv3QV6rYSt7XzduD0pBDP/bE5vc4Y+Lc/ynwGz/JqEJgqEExzky4zfbELYPgRVrPx0rwF5u/hWmMF259Qzyb9lLYV2/Z1CeHEqQOgm2Kqcnv8o21TwFPkhyAu5pxVjmiOyJK0zm65eSuhninJMrUg8A69a4Oi9BCE4e1+kjQ== X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:; X-Exchange-Antispam-Report-CFA-Test: BCL:0;PCL:0;RULEID:(6040470)(2401047)(8121501046)(5005006)(3231023)(944501075)(3002001)(10201501046)(93006095)(93001095)(6041268)(20161123562045)(20161123558120)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(20161123560045)(20161123564045)(6072148)(201708071742011);SRVR:BN6PR10MB1874;BCL:0;PCL:0;RULEID:(100000803101)(100110400095);SRVR:BN6PR10MB1874; X-Forefront-PRVS: 054642504A X-Microsoft-Exchange-Diagnostics: =?utf-8?B?MTtCTjZQUjEwTUIxODc0OzIzOmhFaXptMDE0WWUrbmlGODltbmpUUDdlV1ZZ?= =?utf-8?B?NWlRMHgxSEhyMlNrdjVzREJEU0tyUGcrMmNVVVVjYXVLVkdmeE1DTnEzMGM3?= =?utf-8?B?Vzl1U2wrUk9Hc3lCOW45bzVMUy8rTlJLUGpDUzQyL3JKK0RWRTQ0dnpRLzJ0?= =?utf-8?B?a2Rydyt3Z09FSDJHNWRZWHRFYmRDME5XdytKSVU0TERGRTVqbTJPVlBjVzlv?= =?utf-8?B?aHF6Zm5SeFRLQmdYb1ZCNjVXWW9ocHpsQjFxVnV3TFFZMkNlcXpDOVg0cW00?= =?utf-8?B?eERZazZLODI1Q3M2RjNEb2ZQNW1HUHFyTTFkakVmQTcydWZNU0JMaUQrTnFW?= =?utf-8?B?RDd3MVhjOW5tTkh1NWIwbFNGcEw0SVhuc2w3QWE4aGpNOGp2OUZqanlDTFQz?= =?utf-8?B?cHdBU2ljd3dXRkZlWENycVFKWEV0RUtxcE53UkU5LzRQSmR3RFM5a2o1QVdY?= =?utf-8?B?WUdFK2xzaHZpM0tmdTBwSy9NV0NDVVZCTEJoV0V1MFVaS0p1UWVLYVRSdFpm?= =?utf-8?B?bXJzclNBT20xUXlwQXczai9KYVRMSCs0WFc5Sll5ampRSUY0djdxZlFYR0Jx?= =?utf-8?B?RDlTNE9zUW9aZWc1OWFidnNMeHZ1Mzc0M2ljcGtpN3l4ZS9qSGZpYnAwUnZJ?= =?utf-8?B?VXJHVjk0MDV4K2puZ294MDVpSVpQOUMvejczRzA5TUdQcWw5TlRid3BGOHRF?= =?utf-8?B?NkpOL3JqTUlyN3VjSGhuc1J2b09lZUE0SlBDVmhNaC9UalhzZ2hzdFFqaDd4?= =?utf-8?B?SmljSkNzbHJoOW1ZNldsckJ0YjlPOE9DM3VIWC9DTmhsOU5yMmR4UFZmMWVi?= =?utf-8?B?WkZtSm1rSUZvektIOFpxUVpESFpoZTVaYUtsZHJlQnpuY0FnOW9ERGRiWnIx?= =?utf-8?B?Yk1vY2VYYjdPcUgxTFptZDhaNVZHQ081MXZLUzlVUWs5TVc5NjlGZUJ4QUtK?= =?utf-8?B?Q2Z0Q2F3SFU4LzlQTW95K0JYRHdCVFAzbjRDcCtoTk01aVducm9XTm5VMHc4?= =?utf-8?B?QWFJbTBzM3hWUVBvN0FBb1JTUnNsaEQ2bU0wZ3BWVW9hYldibmlVcjdpd3I2?= =?utf-8?B?QUNnMmFrUUxkS09GdkZNSUd1UTVuVlc1ZXdybGF4RjN3ODRwZVBod1JTYXpW?= =?utf-8?B?elFaT1ZJRVpjOTFBbC8wOGl1L25JMXlmaGt3b1NSZUFKK0FEYU9KcFhxVEFU?= =?utf-8?B?aGMyUnpaWUUzUnNNQUpqdlVMOXF1Nm85dnhPSVlpTlQwckppOFlwb1NQdHJG?= =?utf-8?B?RGVtaHRlZENTTDlBM0N0dlUrV0tyZE5TVldJR1ZKaUc2WnRDcHJqOTlhaGlZ?= =?utf-8?B?bTNhK3ZqZUNwNTFuZkJLT2c3N2RObzF0Ty9BTzFaLzRteGVJeG1LR0xOaVR0?= =?utf-8?B?SiswdURSTktkRm94SjFNbDVMSTRPcmZONWtPOU5WemlaM1BNSXFjYjdRZjVh?= =?utf-8?B?bEY1aVJUM2s4c1ZkTVNRZzhFc3paWDlTd3Y0eS8rbk5leitYUzh0N1JFalRa?= =?utf-8?B?SHdRZ1BGYW1pMDlsY1Q2L0IyWW15MmVKcjV3aXorRlJFZ1VXbEwzNWczRUJs?= =?utf-8?B?NlJQMnV3NUZaaUFaVlBYTzdNdm1DYmwxcDhwQ0dYNitSb1RCWVJJN3pZMUtw?= =?utf-8?B?SXoyMnJtUWhPVEZEdGhpaU9tV3B6eVRJSndGZUU5RzJiSy9TRk1xdE00QkFl?= =?utf-8?Q?Wa5OKQWWSsi86QrbxwKJXzzi60FOIAJzVeyWjKL?= X-Microsoft-Exchange-Diagnostics: 1;BN6PR10MB1874;6:BdMJl6Kw6R7/NWH3KjfRdOAmuD9Kyjw5d6OWra7rXrG37I0aOvv3THmlKDEulrqSaSmBh/rQwLTsH2tiUPiLRZYTn8MOJ9d9NeBCnQK1wFbVM3CEP4mRsvcioCYbEka6UfNAlN5ZfF15ot0B0VprICWUeS2Ab5uHpsNlOHsZ62iLGkpfuKQAbfneL3K3+1IV2/9m5AcDnjRx0lGYWhKXWXTLnQo7TW2ED+hxfvmw62xsyBlW1W7aqYn6yj4MFWZ4T+fNAJbQrYxVMp3n/DqtqffaokX30sPMdVogbCQaINncITk91kp8gcmCtjrtNj0pm20dHPrduIGPq5C1Ij4hQfVR3W2aQBEKDuuAXNKw/9I=;5:MXGpXwWrC5DOt8+DBsOSvFUJD9D/RDHjLZ3Ym3zjrAns6ytHoVh7T8nYlIIuL86R3f80R2i+UGbczVIt95OdNt3C+DKW8HAlnU3gdOq8oYDzlRuCivXMUeFuXOEEIatI13ecvVTQWtON6fpGMV3o/DyTseAM5nSDfe4o5uzImkU=;24:SAtSsamOmQq8EvM/Scq7zCRRMn/wJYYba3O3f7pLKLSMYITpLzsaS3vjZmoPCcsKHJP1IsiqPGZqlV/Nln1d6JmPKn3uPWw9AjYcCebCiq4=;7:c9TvtXjXWuskC9qR1R11ijS4YxHYuzXm7vdxfjFTAs/UBUilYhHwfK0lXg8y+VTgVHiObNvpAKHxddmxJvntgJ+i8fFvr7Q4DIix3v2GTuyLkUalV7tBy4x3EdjRItaXfro7N/h1Q8OJ8Rbd5OKbQ7fgNCOgCoA+2V0isEYNBkU5wEDpa2owfK+RO5MC+ETXPxBs3pF5p6YsxU0ZjL4fCWkMNqteRRQiMKMnBE2vadTYU009ZSXDwkyJri6uasN1 SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: blackducksoftware.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 08 Jan 2018 17:09:59.6120 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 9ce5f2d5-f44c-464d-cfae-08d556baa65f X-MS-Exchange-CrossTenant-Id: a8cff409-0d9d-48cf-b483-b7442cbeb39d X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=a8cff409-0d9d-48cf-b483-b7442cbeb39d;Ip=[192.231.134.1];Helo=[ops-mail01.dc2.lan] X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN6PR10MB1874 List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Precedence: bulk On 11/27/17 15:59, Todd A. Cook wrote: > On 11/27/17 14:17, Tomas Vondra wrote: >> Hi, >> >> On 11/27/2017 07:57 PM, tcook@blackducksoftware.com wrote: >>> The following bug has been logged on the website: >>> >>> Bug reference:      14932 >>> Logged by:          Todd Cook >>> Email address:      tcook@blackducksoftware.com >>> PostgreSQL version: 10.1 >>> Operating system:   CentOS Linux release 7.4.1708 (Core) >>> Description: >>> >>> It hangs on a table with 167834 rows, though it works fine with only 167833 >>> rows.  When it hangs, CTRL-C does not interrupt it, and the backend has to >>> be killed to stop it. >>> >> >> Can you share the query and data, so that we can reproduce the issue? >> >> Based on the stack traces this smells like a bug in the simplehash, >> introduced in PostgreSQL 10. Perhaps somewhere in tuplehash_grow(), >> which gets triggered for 167834 rows (but not for 167833). > > I've attached a reproducer using real data.  (FWIW, I wasn't able to reproduce with > fake data made with generate_series().) > > Also, I forgot to mention that this problem is not present in 9.6 or 9.5. Is this issue likely to be addressed in 10.2? FWIW, we try to avoid running with local patches, but we are unable to move past 9.6 without a fix... -- todd