Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1tkqa7-007IlM-VV for pgsql-hackers@arkaria.postgresql.org; Wed, 19 Feb 2025 20:22:08 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1tkqa5-00D5tf-TV for pgsql-hackers@arkaria.postgresql.org; Wed, 19 Feb 2025 20:22:06 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1tkqa5-00D5tX-JK for pgsql-hackers@lists.postgresql.org; Wed, 19 Feb 2025 20:22:05 +0000 Received: from relay1-d.mail.gandi.net ([2001:4b98:dc4:8::221]) by magus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.96) (envelope-from ) id 1tkqa2-001pPT-1s for pgsql-hackers@postgresql.org; Wed, 19 Feb 2025 20:22:05 +0000 Received: by mail.gandi.net (Postfix) with ESMTPSA id C0355443AE; Wed, 19 Feb 2025 20:22:00 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=vondra.me; s=gm1; t=1739996521; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=gRIGQ/O9Ck0+3/tJFN29rA/iKB6L5gsBoWC7dvHWJZw=; b=fw6p4ED6wVs/YgsiplEB0wl64kEbEOj4D9YTs6wT4CgQvC2pQAd3yDsHRnZslyfDZqN45R 74KY/szr4u8kwYZf7Wzzf2VbJxfFJoQtlGHBXDMzIS3FrqQ9XZEkMbfArBPsZP6zAV9hCE 2vlqmqfKteoPechBHQD89HXWIidYoEA23lVcoHbppLWelRkvfEbxp74c+iBSRDzfVuFt2T n3/FV++dkqTKgOx+7mBQipPrQza4L2ZYop2bKtMQkVpiun+7NavQ2/0/Exw/57eUbqE1Mz Dl8OP1cZKzCTAlSn12+6vn30hLFxUVuKTzc1QBoYjsVZfyVJSKpydZBGRpUhMg== Message-ID: Date: Wed, 19 Feb 2025 21:21:59 +0100 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: Adjusting hash join memory limit to handle batch explosion From: Tomas Vondra To: Melanie Plageman Cc: PostgreSQL Hackers References: <7bed6c08-72a0-4ab9-a79c-e01fcdd0940f@vondra.me> <5a440920-4ca4-4bd0-8b42-a5aa7af4fb70@vondra.me> <508fda6f-5a9d-42c9-af6e-aa94ed1210ec@vondra.me> <5c6b1a65-6265-4bc5-9d0e-a4c7d6ff3d62@vondra.me> <04cc34f5-47ae-4ed7-b7b6-c6ba8bf2f8ae@vondra.me> <310eeb10-1c75-4361-966a-33fa12970e6e@vondra.me> Content-Language: en-US In-Reply-To: <310eeb10-1c75-4361-966a-33fa12970e6e@vondra.me> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-GND-State: clean X-GND-Score: -100 X-GND-Cause: gggruggvucftvghtrhhoucdtuddrgeefvddrtddtgdeihedvtdcutefuodetggdotefrodftvfcurfhrohhfihhlvgemucfitefpfffkpdcuggftfghnshhusghstghrihgsvgenuceurghilhhouhhtmecufedtudenucesvcftvggtihhpihgvnhhtshculddquddttddmnecujfgurhepkfffgggfuffhvfevfhgjtgfgsehtjeertddtvdejnecuhfhrohhmpefvohhmrghsucggohhnughrrgcuoehtohhmrghssehvohhnughrrgdrmhgvqeenucggtffrrghtthgvrhhnpefhgefgleejvefgjeetuedvhffhudetveelgfeugfduledvffejleegjefhteffkeenucfkphepkeeirdegledrvdefiedrudelfeenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepihhnvghtpeekiedrgeelrddvfeeirdduleefpdhhvghloheplgdutddrudefjedrtddrvdgnpdhmrghilhhfrhhomhepthhomhgrshesvhhonhgurhgrrdhmvgdpnhgspghrtghpthhtohepvddprhgtphhtthhopehmvghlrghnihgvphhlrghgvghmrghnsehgmhgrihhlrdgtohhmpdhrtghpthhtohepphhgshhqlhdqhhgrtghkvghrshesphhoshhtghhrvghsqhhlrdhorhhg X-GND-Sasl: tomas@vondra.me List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk I've pushed the first (and main) part of the patch series, after some more cleanup and comment polishing. As explained in my previous message, I'm not sure about 0002. I don't know if we need to worry about it (no reports AFAICS). And while the patch works I'm not sure it's the best fix, or whether we need to do something about exhausting hash bits. In any case, it's not PG18 material. And it's a separate issue, so I'm marking this as committed. Thanks everyone who helped with any of the many old patch versions! -- Tomas Vondra