Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.89) (envelope-from ) id 1egEbs-0007eb-79 for pgsql-bugs@arkaria.postgresql.org; Mon, 29 Jan 2018 18:56:52 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.84_2) (envelope-from ) id 1egEbq-0007Xe-I4 for pgsql-bugs@arkaria.postgresql.org; Mon, 29 Jan 2018 18:56:50 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1egEbq-0007XU-Bs for pgsql-bugs@lists.postgresql.org; Mon, 29 Jan 2018 18:56:50 +0000 Received: from mail-cys01nam02on0080.outbound.protection.outlook.com ([104.47.37.80] helo=NAM02-CY1-obe.outbound.protection.outlook.com) by magus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.89) (envelope-from ) id 1egEbl-0001qr-Mv for pgsql-bugs@postgresql.org; Mon, 29 Jan 2018 18:56:49 +0000 Received: from BN6PR1001CA0033.namprd10.prod.outlook.com (10.174.84.46) by BLUPR10MB0627.namprd10.prod.outlook.com (10.163.124.153) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P256) id 15.20.444.14; Mon, 29 Jan 2018 18:56:38 +0000 Received: from BL2NAM02FT020.eop-nam02.prod.protection.outlook.com (2a01:111:f400:7e46::201) by BN6PR1001CA0033.outlook.office365.com (2603:10b6:405:28::46) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.20.444.14 via Frontend Transport; Mon, 29 Jan 2018 18:56:38 +0000 Authentication-Results: spf=permerror (sender IP is 192.231.134.1) smtp.mailfrom=blackducksoftware.com; 2ndquadrant.com; dkim=none (message not signed) header.d=none;2ndquadrant.com; dmarc=fail action=none header.from=blackducksoftware.com; Received-SPF: PermError (protection.outlook.com: domain of blackducksoftware.com used an invalid SPF mechanism) Received: from ops-mail01.dc2.lan (192.231.134.1) by BL2NAM02FT020.mail.protection.outlook.com (10.152.77.162) with Microsoft SMTP Server id 15.20.444.13 via Frontend Transport; Mon, 29 Jan 2018 18:56:38 +0000 Received: from bds01237.bds-ad.lc (bds01237.bds-ad.lc [10.1.6.127]) by ops-mail01.dc2.lan (Postfix) with ESMTPS id CA5D640174; Mon, 29 Jan 2018 13:56:37 -0500 (EST) Subject: Re: BUG #14932: SELECT DISTINCT val FROM table gets stuck in an infinite loop To: Andres Freund CC: Tom Lane , Tomas Vondra , Thomas Munro , PostgreSQL Bugs References: <219b37b2-d740-d04a-203a-49ae422028f7@blackducksoftware.com> <1773c302-2fb1-749f-8ccc-62b23617c5ac@blackducksoftware.com> <25629.1512580464@sss.pgh.pa.us> <20171206171923.dg7phzfh7nb4lou3@alap3.anarazel.de> <7de4b2d6-b119-7d15-04d8-4c0fcb29cbc3@2ndquadrant.com> <20180126234537.dyu6jwnqz7snpq7n@alap3.anarazel.de> <14184.1517010515@sss.pgh.pa.us> <20180129010213.rt3nu73ilff756f6@alap3.anarazel.de> <15ae5ae2-bc74-ebef-f9d6-34b16423cc04@blackducksoftware.com> <20180129183118.rdtm34fshwxlajzm@alap3.anarazel.de> From: "Todd A. Cook" Message-ID: <633f3730-0cba-9aed-2724-3ae4295bb0b2@blackducksoftware.com> Date: Mon, 29 Jan 2018 13:56:37 -0500 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.5.2 MIME-Version: 1.0 In-Reply-To: <20180129183118.rdtm34fshwxlajzm@alap3.anarazel.de> Content-Type: text/plain; charset="windows-1252"; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-EOPAttributedMessage: 0 X-Forefront-Antispam-Report: CIP:192.231.134.1;IPV:CAL;CTRY:;EFV:NLI;SFV:NSPM;SFS:(10009020)(39850400004)(396003)(39380400002)(346002)(376002)(2980300002)(448002)(199004)(189003)(377424004)(106466001)(6916009)(2950100002)(36756003)(54906003)(53546011)(186003)(58126008)(47776003)(86362001)(23746002)(77096007)(26005)(65956001)(83506002)(76176011)(305945005)(316002)(356003)(65806001)(5890100001)(31696002)(50466002)(104016004)(4326008)(53936002)(229853002)(81156014)(67846002)(8676002)(81166006)(8936002)(97736004)(6266002)(65826007)(93886005)(230700001)(478600001)(31686004)(26826003)(53416004)(64126003)(336011)(6246003)(85326001)(2906002)(5660300001)(217873001);DIR:OUT;SFP:1101;SCL:1;SRVR:BLUPR10MB0627;H:ops-mail01.dc2.lan;FPR:;SPF:PermError;PTR:ErrorRetry;A:1;MX:1;LANG:en; X-Microsoft-Exchange-Diagnostics: 1;BL2NAM02FT020;1:ZChCpBbTNfHLJ7gIH75/mWzO5Nzxxu78UYygHd1qr+HmN6VFxWrpz7mHsLI6qVYMpwaPTnb9vYFr2a1RGMH5imUa1QTa1+W+2X02YTW96KEDTG4Vz9kBpps8gdP/C6mK X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: bc622003-f1b7-4f96-7870-08d5674a06bc X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:(7020095)(4652020)(4534165)(4627221)(201703031133081)(201702281549075)(5600026)(4604075)(2017052603307)(7153060);SRVR:BLUPR10MB0627; X-Microsoft-Exchange-Diagnostics: 1;BLUPR10MB0627;3:7fLzrvL8QvWZBMicWtZoSWfAuGIda5CGG1eRdkidIHNUyegA01J1mw485gIbcAbzhczBHKXo2sTacRbYCifCet/P67W8l3SSrNu4jBvYshHxSXCiJTLiaMl16OzlrOsZA4FzvGRMI2akPNMGZcHE3m6sAftQ9iYMNnDxkCTsefjjDwABNLgVZnbjR6obFZtZ364GS0mPjNLQh7k4tUlBWKiiYhJG9r6C1P1DOr1NmpJmHEJBg3f22KcB7JjV+uMToJ0cJ97+GGjND7tZilNzxmBvtY4lMTuvQCKKBnB1mPYveIZ+i5Nr2h+CrbtNMf4JJmZ5G5k11LKz4IhH8DYn9A==;25:xb2cTRbInGwQ/XgqC+etX0OttIHk8bub/nKz4osG0mflOw11/m7XxaySAmHhXiLhUPVlbBPXY6es17/LDVWB5UOjh1KbhvlMJ5byWdUi0UPkvmv+IzmpiyFgcc099v9t+jzdVivqlsUdTqITuYsHx3GVVwjt5c3BnQ/dlN68sbwepDmjLUAd/qNmFZHdsiIShl5uB8xTT5wywr0z52Sl/ToRlI2vQYi3jIBJgll4OohexXUGPmjOWkggkDpYEUynMr8WDms8ThlOa7allSdI6yp+WCPIxbWXu3He0Oq6XZEY4rgydkQTiR1aF1LE+fOr4XINue0azA2hKs9StFXHKQ==;31:LOEr2qlRZnSTTKtiTMQ8eoXZa80e1Q6Gax0zIrKk4edaafh1yuQwTQXZ+V9+CmMe8nuq80mRHdzHZy3MEheHH5orUCiYwKYcZkiZ5ynkaXHV+8dTra/cJxg+x3jSDCF6LJFkBtuVDm4LxXB2VtCnPA8OwVFBKMHA4kjPP6wFQQRX1SHWGInM7hB+/fcckcnJfja+reyjzmN+89zgkmYnfgqS0FXhf2eiaYe7A4z7RvQ= X-MS-TrafficTypeDiagnostic: BLUPR10MB0627: X-Microsoft-Exchange-Diagnostics: 1;BLUPR10MB0627;20:a9C0zCclVEipOSuYDACRtC2La9RI63qc4Bf0h3IOcbt3BuJLMLRylRfeSv+ebdqxITOucOBVmyNDmOKHwp7Gy7z+qhbe5eBPloG2zVXsAtJ5xlHTwN3x5xTBWa6KQH/DYRNk7njB3XBFy34gs+/HGF6BtCDj5qXjq93at7phhV/MCAM8EV0TL6iSeU5YhZkUs/8bybGzdGvMqvKwMHqigtwHToo7YU3RPo1NTIlkUb6Oq0Tv/yAuYSxdHa4tq+hjYwXxGsmfl5SSnmZKZ0b0KBOPUJ48DZRyf/lDU2RYsgy9GI+Cfd/b++c/++EjNtWaomwKHXceeSkNcInGOLHAZG3PZcXu2Vjh9XF5BK5ueVsqNBe0vMPaFPaDQ3AI+2Dc1fRH977TwZYjxrWQWiZBM8cD0XlnQ1NUTWr5Cop2zsx0FTYkHYMXcyx2qXGiGfPf405KOdE0YMqg8BLUMWCau3nzJYF5dMwqYQ3d5NV3l8LtUaEbMjMyknzuqMqemhug;4:KUcl7eXp5kYyHDQNdrD68hRK/VytNXuCKdJe0aJBg2hrJdEdAfORxeZabXtyCblLyIacnvqLY6Kq9OYEzDAn3KZrd3fjgNSEFKzriS6Us1bKZEH1UpvddysKt6scz9i9o3t2UM3Vkl8IzjQnh5FA8+KNpDh1PdnH+ok7HRx4o5ZinOcwoGDYGEWhDgzAyFc5FZAKS1jpwsrOCvyMVGPlBXjcL9W2oilHEraeiOeaVN04IhKLxOUeKRoi5pG0ydIzZ2KtsHfuzYVR25/9QrI4Qw== X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:; X-Exchange-Antispam-Report-CFA-Test: BCL:0;PCL:0;RULEID:(6040501)(2401047)(8121501046)(5005006)(3231101)(944501161)(93006095)(93001095)(10201501046)(3002001)(6041288)(20161123562045)(20161123558120)(20161123564045)(20161123560045)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(6072148)(201708071742011);SRVR:BLUPR10MB0627;BCL:0;PCL:0;RULEID:;SRVR:BLUPR10MB0627; X-Forefront-PRVS: 0567A15835 X-Microsoft-Exchange-Diagnostics: =?Windows-1252?Q?1;BLUPR10MB0627;23:F6GeINqPvIF4YtdtFOezbR70CynXzCj838aAU?= =?Windows-1252?Q?LyqUeGtidRNxFsPzy2PEMzocb9dhzfVJ9gp55zrUQVXAwHcVTTPPV4mg?= =?Windows-1252?Q?4QBB1wwNiXSsMcEyrfwZCP/+LQCbnTwfuupwkZg9JPHNriV2OSgYmfqO?= =?Windows-1252?Q?IOsRW/8RnTxVFJDuvTFCSeq0mJyfmyZvCsXkQj5jzhxuwJD3BdorC2O/?= =?Windows-1252?Q?l7so0RpbHqbW65xfodoG2NSmGWbQmKBYKhBPE1ewBEnv4R8VCVfei7HH?= =?Windows-1252?Q?QWhRVOMXh0+wiHYPa5yJgbjXxUWfrEtWtpBjXocFrCHL0HLzBFXd2meS?= =?Windows-1252?Q?T1s2dh4VQS0FzaVNV9sppO+2Z/G7Zb5VYK1HcdRBF15cR41k7C+KD/ol?= =?Windows-1252?Q?rLpzEUZnAbJzukhMGsOkwWePJUVEWosmp1DWTK0tGB0/tTzAH7L7n+pD?= =?Windows-1252?Q?mQw8l6nmeZtHsW79ht6GMohjyoHPcZCPha9eZxnIJfI/tQyGPaq0ieA8?= =?Windows-1252?Q?ZroPeaSds5a3htLBwEzJurpOyte10Dh2/UPeUO5Wi3H/zeNLSuV/t/6G?= =?Windows-1252?Q?AbZNImrPKvu68da/2pE1f9bp3k0DL6SGCFts5/s97CQhmncaO5SN94wQ?= =?Windows-1252?Q?BcKChKlmpF6O2Vw9MLbsK3ptXpSwH/v+xeP9rfIpFVPmhp501+Tp1Nlf?= =?Windows-1252?Q?wWzc70jUMdfxnAFtBShN5oyyI433Z3Sbw8TH4zir7eGen7FLk2ZffQPI?= =?Windows-1252?Q?Ioi8S310SsyB3+IhU4LHcLwyMj3pqIgSCdpgcYTcO1A87hQhhunrwofa?= =?Windows-1252?Q?GzAmVD4+7e1zgaxpR4rkhf3iLsmOCmvo0u3366NH9n8MzXi+60gPpcQW?= =?Windows-1252?Q?NpVC6BJ24950oE2OLke9i8MNRMh0ToBUmv4McVdb+pLuGM4NuQ677FaZ?= =?Windows-1252?Q?HFWFPU9Nm7nMZWQSH95FJOcB7yrZ5K3xuGd2liQDYwVc57hEut/zETLO?= =?Windows-1252?Q?UoKIR8UHwTIRY7vnrRaXEyB0He96XiR5O851wxfoVc1wkNCCf9RtGN4P?= =?Windows-1252?Q?26WoZFjGNFZBk48PHdKSaNAvdIgtRqjiTql6AD4F0zzIPibzpeiwkMOa?= =?Windows-1252?Q?yNDNo1Niq3UAt/EHDPu3IAwRKkYvJBTaF7rmJK5rzHu3CHi/H5SykeCA?= =?Windows-1252?Q?tKEPHjD9X35VL7x7KWJm23ZmbxF/0b5QWbLfEdHJVbDnqD947kNr92IT?= =?Windows-1252?Q?bLNfUDPoa47oW/DbcPTmrVCTokBk6hyzOXRSNwBJd6WY7+lX+g6GZovI?= =?Windows-1252?Q?BvSXRv2GMg9oUfJUOi/TlhyqS/bu70mV0joVnM6uwABRC2LTqVhPBGOg?= =?Windows-1252?Q?9Tya2Uxvs81JlIKzM/6nmIhHalxYjlKOFbUQ/25wWOGLCdExhAt/9ifV?= =?Windows-1252?Q?c0/rjK3HjEsxhtvdspN?= X-Microsoft-Exchange-Diagnostics: 1;BLUPR10MB0627;6:Oos6DoXK5wETgtlseOwij/WwVO2WD4dHhrM/8T0yChOH7PkKJumkMKG119wsbsCsXM4XX17MzbWUqG6HzaHmFTvHpXhzlHvGDXzBo7GwwEiGArhW7cHgAfjmYh1Wwr9Elz+OALr/tYhMsYQVeN9+oRGSIBSyQDR2EZ6dhJ/SbptNHdtR+8zdG6Bo/Q8BIw8ck83SVBzXcAhqZNcZ7W0c+2P2MISBH0vOA0OdZnKaQI/UGPfgXRer7dR+6jV5pmJk9yzfYDjSY9WqcUqaXXq+krFM0MUdx6kbOvRZmrHQcTqT5s4icmswjTG17M/DnWv/WuP9p5Er+aX60lW908Wlv6a2+Z7E/UL9BQLE4q5a+C0=;5:oLXWVLss1IXuq7pqprlCPzmEM88SIRgqZeQBN9bVtpixsCIG5Zh2IEgjJ2XOsLnGWQjd4jHGqcNDpMSy8JTfzEUXy9tZ6Z/vjITs1rqOiyZTWtLlbjHftELvi2fssMDJM/rw9x30bk9eD0fEt9Srd8lpK7TEdq+3qfxXa+Ypdzw=;24:Z5tfg39NBgDbtpsbryWIDUKXdnrpfgiwjtmYkfiwIvEdlQF1cyi5UdFYMHd8tvI8qbr7g7GjEWy0hsddQzPP35vOEyOV+jugPc7dkBRQSoU=;7:uod+wJ+lEDYK9fcMmg33boMCtqM2aJNCc2qcaBPFdn07125Grtbpgq4Gzb1QjNJGVWBW/fP8dvp6M9YFjmea/hYFRYuBpqShNwMjh9wpQuB/x6YXWUTgFo+NOQ89XnEmTfNhribf5leFl6B3ByY+GCA4U9TrN+Tku162WX8in6xNg7jC1Jsq4V/kRCJOZAgYE5FnnjpWDkCinLiyVzOgjHA34//0Y/hHjSYKre87jxGpeO/zDr9TSNhX8Q8p3nWt SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: blackducksoftware.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 29 Jan 2018 18:56:38.0267 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: bc622003-f1b7-4f96-7870-08d5674a06bc X-MS-Exchange-CrossTenant-Id: a8cff409-0d9d-48cf-b483-b7442cbeb39d X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=a8cff409-0d9d-48cf-b483-b7442cbeb39d;Ip=[192.231.134.1];Helo=[ops-mail01.dc2.lan] X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: BLUPR10MB0627 List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Precedence: bulk On 01/29/18 13:31, Andres Freund wrote: > On 2018-01-29 13:20:25 -0500, Todd A. Cook wrote: >> I applied 0001 and 0002 to REL_10_STABLE at 1b2a3860d3ea81825e9bbad2c7dbf66db87445c1 >> and got the following build error: >> >> execGrouping.c:26:29: fatal error: utils/hashutils.h: No such file or directory >> #include "utils/hashutils.h" > > Yea, there's some minor differences from master to the 10 branch, > needing to backport one commit beforehand. Attached are three patches > applying to 10. Thanks. With those patches applied, I'm able to process a 175 million row data set without any problems. I'll try the 900 million row set next. -- todd