Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1qjQf2-00B1YR-EN for pgsql-bugs@arkaria.postgresql.org; Thu, 21 Sep 2023 20:52:33 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1qjQf0-00Eq1m-Sp for pgsql-bugs@arkaria.postgresql.org; Thu, 21 Sep 2023 20:52:30 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1qjQ3u-00EgDx-AX for pgsql-bugs@lists.postgresql.org; Thu, 21 Sep 2023 20:14:10 +0000 Received: from mahout.postgresql.org ([2001:4800:3e1:1::227]) by magus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1qjQ3q-006aIC-Ut for pgsql-bugs@lists.postgresql.org; Thu, 21 Sep 2023 20:14:09 +0000 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=postgresql.org; s=20171124; h=Message-ID:Date:Reply-To:Cc:From:To:Subject: MIME-Version:Content-Type:Sender:Content-Transfer-Encoding:Content-ID: Content-Description:In-Reply-To:References; bh=ln9mv1TBtPwms8a4Hhsor7xY33eWp1EpR5ljYNqZQSY=; b=OwDKSO92pf8LYvMcT/VQVOx6Qv wTakbV2yZITS+pCXcNfKIARDNLC6YK6Ad7VJIJ7h6hJGUE7kgo/po3HBoiOUa8N7N706dCBgn2KUT lDQGLjMwDGInYC9QGBzUSW5oqALQavsXdEtmHrKUe2VUbYxNoqsiXEcMGUyi3eYltD2vKptbnUD0K LrdTs2XiUjbK6PwZWWEfTGMlRxkvm9nFgHnRiirUjd5LzsXYiSg9+21kPzs6yyz6R7ZGyJTYvNqKw xyVbmej/Q8PWVNN5DqYjMumOwAxWre9wVUzOGMbmJ2rGBhWWmqVmqVcFKJPYBEMHOXIs0A34DMs35 ngXLy+pA==; Received: from wrigleys.postgresql.org ([2a02:c0:301:0:ffff::34]) by mahout.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1qjQ3p-0007O1-Kj for pgsql-bugs@lists.postgresql.org; Thu, 21 Sep 2023 20:14:05 +0000 Received: from localhost ([127.0.0.1] helo=wrigleys.postgresql.org) by wrigleys.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1qjQ3m-00266A-5U for pgsql-bugs@lists.postgresql.org; Thu, 21 Sep 2023 20:14:02 +0000 Content-Type: multipart/mixed; boundary="===============2180206643040805476==" MIME-Version: 1.0 Subject: BUG #18128: a Parallel Hash started with batches 64 but increased to 262144 and FreeableMemory tanked To: pgsql-bugs@lists.postgresql.org From: PG Bug reporting form Cc: mike@muzzylane.com Reply-To: mike@muzzylane.com, pgsql-bugs@lists.postgresql.org Date: Thu, 21 Sep 2023 20:13:18 +0000 Message-ID: <18128-5022ee1cf4cf4d3f@postgresql.org> X-Auto-Response-Suppress: All Auto-Submitted: auto-generated List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk --===============2180206643040805476== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: base64 VGhlIGZvbGxvd2luZyBidWcgaGFzIGJlZW4gbG9nZ2VkIG9uIHRoZSB3ZWJzaXRlOgoKQnVnIHJl ZmVyZW5jZTogICAgICAxODEyOApMb2dnZWQgYnk6ICAgICAgICAgIE1pa2UgR2luZ2VyaWNoCkVt YWlsIGFkZHJlc3M6ICAgICAgbWlrZUBtdXp6eWxhbmUuY29tClBvc3RncmVTUUwgdmVyc2lvbjog MTMuMTIKT3BlcmF0aW5nIHN5c3RlbTogICBsaW51eCAoQVdTIFJEUykKRGVzY3JpcHRpb246ICAg ICAgICAKCkFwcmlsIHdhcyBtdWNoIHNsb3dlci4gTWFyY2ggYW5kIE1heSBiYXRjaGVzIHN0YXll ZCBhdCA2NCBpbnN0ZWFkIG9mCmluY3JlYXNpbmcgdG8gMjYyMTQ0DQpRdWVyeSBhbmFseXNpcyBm b3IgQXByaWw6DQogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgCiAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgIFFVRVJZIFBMQU4gICAgICAgICAgICAgICAgICAKICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgDQotLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0NCiBHcm91cEFnZ3JlZ2F0ZSAgKGNvc3Q9MjI5MDA5MC4zMy4uMjc2MTUyOC44MCBy b3dzPTE3Mzcgd2lkdGg9MTYpIChhY3R1YWwKdGltZT02NDExMzM2LjAyNy4uNjUyNDU2OS42MjMg cm93cz0zMCBsb29wcz0xKQ0KICAgR3JvdXAgS2V5OiAoZGF0ZV90cnVuYygnZGF5Jzo6dGV4dCwg dWEycy5jcmVhdGVfZGF0ZSkpDQogICAtPiAgR2F0aGVyIE1lcmdlICAoY29zdD0yMjkwMDkwLjMz Li4yNzQyMTAxLjg2IHJvd3M9Mzg4MTA0NCB3aWR0aD0xMikKKGFjdHVhbCB0aW1lPTY0MTEyNzMu NjE0Li42NTIzNDA0Ljg1NSByb3dzPTM5MTM1ODQgbG9vcHM9MSkNCiAgICAgICAgIFdvcmtlcnMg UGxhbm5lZDogMg0KICAgICAgICAgV29ya2VycyBMYXVuY2hlZDogMg0KICAgICAgICAgLT4gIFNv cnQgIChjb3N0PTIyODkwOTAuMzEuLjIyOTMxMzMuMDYgcm93cz0xNjE3MTAyIHdpZHRoPTEyKQoo YWN0dWFsIHRpbWU9NjQxMTI1My4wNzAuLjY0MTE0NzkuMDg1IHJvd3M9MTMwNDUyOCBsb29wcz0z KQ0KICAgICAgICAgICAgICAgU29ydCBLZXk6IChkYXRlX3RydW5jKCdkYXknOjp0ZXh0LCB1YTJz LmNyZWF0ZV9kYXRlKSkNCiAgICAgICAgICAgICAgIFNvcnQgTWV0aG9kOiBleHRlcm5hbCBtZXJn ZSAgRGlzazogMjcwODhrQg0KICAgICAgICAgICAgICAgV29ya2VyIDA6ICBTb3J0IE1ldGhvZDog ZXh0ZXJuYWwgbWVyZ2UgIERpc2s6IDI4NDU2a0INCiAgICAgICAgICAgICAgIFdvcmtlciAxOiAg U29ydCBNZXRob2Q6IGV4dGVybmFsIG1lcmdlICBEaXNrOiAyODg1NmtCDQogICAgICAgICAgICAg ICAtPiAgUGFyYWxsZWwgSGFzaCBKb2luICAoY29zdD0xNTY5MjUyLjI5Li4yMDY3MDQ3LjgzCnJv d3M9MTYxNzEwMiB3aWR0aD0xMikgKGFjdHVhbCB0aW1lPTYxNDcyMjQuNzc1Li42NDEwNjIwLjc2 MSByb3dzPTEzMDQ1MjgKbG9vcHM9MykNCiAgICAgICAgICAgICAgICAgICAgIEhhc2ggQ29uZDog KGEuaWQgPSBhc3NuLmlkKQ0KICAgICAgICAgICAgICAgICAgICAgLT4gIFBhcmFsbGVsIFNlcSBT Y2FuIG9uIGFzc2lnbm1lbnRzIGEgCihjb3N0PTAuMDAuLjQyNTUwNy43MiByb3dzPTQwNjA4Mjcg d2lkdGg9OCkgKGFjdHVhbCB0aW1lPTAuMDIxLi44NTU3LjA5MQpyb3dzPTI1NTU0NDEgbG9vcHM9 MykNCiAgICAgICAgICAgICAgICAgICAgICAgICAgIEZpbHRlcjogKChwcm9qZWN0X3VzZXJfaWQg PSA5OTk5KSBPUgoocGFydG5lcl91c2VyX2lkID0gOTk5OSkpDQogICAgICAgICAgICAgICAgICAg ICAgICAgICBSb3dzIFJlbW92ZWQgYnkgRmlsdGVyOiAxNDgwMQ0KICAgICAgICAgICAgICAgICAg ICAgLT4gIFBhcmFsbGVsIEhhc2ggIChjb3N0PTE1Mzk1NTguMDkuLjE1Mzk1NTguMDkKcm93cz0x NjE3Mzc2IHdpZHRoPTI0KSAoYWN0dWFsIHRpbWU9MzA5MzcuNTk2Li4zMDkzOS44MTEgcm93cz0x MzE2NDA3Cmxvb3BzPTMpDQogICAgICAgICAgICAgICAgICAgICAgICAgICBCdWNrZXRzOiA2NTUz NiAob3JpZ2luYWxseSA2NTUzNikgIEJhdGNoZXM6CjI2MjE0NCAob3JpZ2luYWxseSA2NCkgIE1l bW9yeSBVc2FnZTogNjMwNGtCDQogICAgICAgICAgICAgICAgICAgICAgICAgICAtPiAgUGFyYWxs ZWwgSGFzaCBKb2luIAooY29zdD05NDQ2OTUuODIuLjE1Mzk1NTguMDkgcm93cz0xNjE3Mzc2IHdp ZHRoPTI0KSAoYWN0dWFsCnRpbWU9MTQ2NjguMjkxLi4xNTU2MS4zNzcgcm93cz0xMzE2NDA3IGxv b3BzPTMpDQogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBIYXNoIENvbmQ6IChhdHQu YXNzaWdubWVudF9pZCA9IGFzc24uaWQpDQogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAtPiAgUGFyYWxsZWwgSGFzaCBKb2luIAooY29zdD02OTg4NTEuODUuLjEyNTc4MDYuNTEgcm93 cz0xNjE3Mzc2IHdpZHRoPTE2KSAoYWN0dWFsCnRpbWU9MTEyNjAuNjM5Li4xMjk4NS45ODkgcm93 cz0xMzE2NDA3IGxvb3BzPTMpDQogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICBIYXNoIENvbmQ6IChhdHQuaWQgPQp1MmF0dC5hdHRlbXB0X2lkKQ0KICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgLT4gIFBhcmFsbGVsIFNlcSBTY2FuIG9uIGF0dGVtcHRz IGF0dAogKGNvc3Q9MC4wMC4uNDI0MDY3Ljk5IHJvd3M9ODE1NzU5OSB3aWR0aD0xMikgKGFjdHVh bCB0aW1lPTAuMTk4Li4xOTM2LjU1OQpyb3dzPTY1NjAwNTggbG9vcHM9MykNCiAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgIC0+ICBQYXJhbGxlbCBIYXNoIAooY29zdD02NzA3 MzYuNjUuLjY3MDczNi42NSByb3dzPTE2MTczNzYgd2lkdGg9MTYpIChhY3R1YWwKdGltZT03NzM0 LjEwNS4uNzczNS40NTUgcm93cz0xMzE2NDA3IGxvb3BzPTMpDQogICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICBCdWNrZXRzOiAxMzEwNzIgIEJhdGNoZXM6IDY0IApN ZW1vcnkgVXNhZ2U6IDQwMzJrQg0KICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgLT4gIFBhcmFsbGVsIEhhc2ggSm9pbiAKKGNvc3Q9NDUzODY5LjU4Li42NzA3MzYu NjUgcm93cz0xNjE3Mzc2IHdpZHRoPTE2KSAoYWN0dWFsCnRpbWU9NTc3NC42MjQuLjczNTkuNzc5 IHJvd3M9MTMxNjQwNyBsb29wcz0zKQ0KICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgSGFzaCBDb25kOgoodWEycy51c2VyX2F0dGVtcHRfaWQgPSB1MmF0 dC5pZCkNCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg IC0+ICBQYXJhbGxlbCBJbmRleCBTY2FuCnVzaW5nIHVzZXJfYXR0ZW1wdF90b19zdGF0dXNlc19j cmVhdGVfZGF0ZV9kYXlfaWR4IG9uCnVzZXJfYXR0ZW1wdF90b19zdGF0dXNlcyB1YTJzICAoY29z dD0wLjU3Li4xNTU3NDguMDMgcm93cz0xNjE3Mzc2IHdpZHRoPTEyKQooYWN0dWFsIHRpbWU9MC4w MzQuLjUyMi45NjMgcm93cz0xMzE2NDA3IGxvb3BzPTMpDQogICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBJbmRleCBDb25kOgooKGRhdGVfdHJ1 bmMoJ2RheSc6OnRleHQsIGNyZWF0ZV9kYXRlKSA+PSAnMjAyMy0wNC0wMSAwMDowMDowMCc6OnRp bWVzdGFtcAp3aXRob3V0IHRpbWUgem9uZSkgQU5EIChkYXRlX3RydW5jKCdkYXknOjp0ZXh0LCBj cmVhdGVfZGF0ZSkgPD0gJzIwMjMtMDQtMzAKMDA6MDA6MDAnOjp0aW1lc3RhbXAgd2l0aG91dCB0 aW1lIHpvbmUpKQ0KICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgLT4gIFBhcmFsbGVsIEhhc2ggCihjb3N0PTMwNzYzMS41Ni4uMzA3NjMxLjU2IHJvd3M9 ODQxMjc1NiB3aWR0aD0xNikgKGFjdHVhbAp0aW1lPTQ2NjYuOTY1Li40NjY2Ljk3OCByb3dzPTY1 NzcwNjQgbG9vcHM9MykNCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgIEJ1Y2tldHM6IDEzMTA3MiAKQmF0Y2hlczogNTEyICBNZW1vcnkgVXNh Z2U6IDMyMDBrQg0KICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgLT4gIFBhcmFsbGVsIFNlcQpTY2FuIG9uIHVzZXJzX3RvX2F0dGVtcHRzIHUy YXR0ICAoY29zdD0wLjAwLi4zMDc2MzEuNTYgcm93cz04NDEyNzU2CndpZHRoPTE2KSAoYWN0dWFs IHRpbWU9MC4wMTMuLjE3NTAuMDIxIHJvd3M9NjU3NzA2NCBsb29wcz0zKQ0KICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgLT4gIFBhcmFsbGVsIEhhc2ggCihjb3N0PTE3OTIwOS4wMy4u MTc5MjA5LjAzIHJvd3M9NDA2MTUxNSB3aWR0aD04KSAoYWN0dWFsCnRpbWU9MTM1NC4zMzYuLjEz NTQuMzQwIHJvd3M9MjU3MDI0MiBsb29wcz0zKQ0KICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgQnVja2V0czogMTMxMDcyICBCYXRjaGVzOiAxMjggIE1lbW9yeQpVc2FnZTog MzQ1NmtCDQogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAtPiAgUGFyYWxs ZWwgSW5kZXggT25seSBTY2FuIHVzaW5nCmFzc2lnbm1lbnRzX3BrZXkgb24gYXNzaWdubWVudHMg YXNzbiAgKGNvc3Q9MC40My4uMTc5MjA5LjAzIHJvd3M9NDA2MTUxNQp3aWR0aD04KSAoYWN0dWFs IHRpbWU9MC4wNjYuLjY4MC4wNzMgcm93cz0yNTcwMjQyIGxvb3BzPTMpDQogICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBIZWFwIEZldGNoZXM6IDI0NDAyMg0KIFBs YW5uaW5nIFRpbWU6IDEuNjA1IG1zDQogRXhlY3V0aW9uIFRpbWU6IDY1MjQ1ODIuNTc4IG1zDQoo Mzcgcm93cykKCg== --===============2180206643040805476==--