Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1ss4vd-005viO-Kh for pgsql-hackers@arkaria.postgresql.org; Sat, 21 Sep 2024 18:33:58 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1ss4vb-0082hY-8B for pgsql-hackers@arkaria.postgresql.org; Sat, 21 Sep 2024 18:33:56 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1ss4va-0082hQ-Qq for pgsql-hackers@lists.postgresql.org; Sat, 21 Sep 2024 18:33:56 +0000 Received: from relay2-d.mail.gandi.net ([217.70.183.194]) by magus.postgresql.org with esmtps (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1ss4vY-000O6z-68 for pgsql-hackers@lists.postgresql.org; Sat, 21 Sep 2024 18:33:55 +0000 Received: by mail.gandi.net (Postfix) with ESMTPSA id 68DB940002; Sat, 21 Sep 2024 18:33:50 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=vondra.me; s=gm1; t=1726943631; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ZuRnR+zERzMA1AWmdeiy4RHTpDT0S6/Fwus7tY887JY=; b=WDyiK8LqbcTbX3zwr4OQh8xkpI0ZrzJlwV8uJqwARNz/U404StKBN9PVILCCag4wMLFhVO U/x88ep5lARslthyMWylKaNABEM49BRQSE0vXIWFSmGQj/NmvwG16NyI2g9EInWEqnw8Qr GiDVAH/Xs/t5AVRlbWO9fTXOs6M946KhqUzPTzFUJMcHhh17RoIxVr5u1jBLfziOaBRioe ocJhhXgJihWPpK0MKk9un8lbWbRi2CLFe3yTsHHVOQuK2rt/F9IvnW0EaCYRQlfzSV9gqE c4MLi1VLGjtUzSrVtCsMcAGbE79PgkncxM3hEeIMfyDKqk7hjuQjTJHnrEPz7g== Message-ID: <7c1eeafb-2375-4ff6-8469-0640d52d44ed@vondra.me> Date: Sat, 21 Sep 2024 20:33:49 +0200 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: scalability bottlenecks with (many) partitions (and more) From: Tomas Vondra To: Jakub Wartak Cc: Robert Haas , PostgreSQL Hackers , Andres Freund References: <510b887e-c0ce-4a0c-a17a-2c6abb8d9a5c@enterprisedb.com> <9266c8df-0df7-4605-ba5a-b204c5e52586@enterprisedb.com> <52afd566-d110-43ea-ae72-69349d4414f6@vondra.me> <52f026c4-6c4e-4de2-bd78-609091d7c772@vondra.me> <14cd8763-c905-4705-99c5-cbcc5db06f50@vondra.me> <0775ba8a-920c-4d37-b202-989a90b6ee4c@vondra.me> <0f27b64b-5bf3-4140-98b7-635e312e1796@vondra.me> <3cebb4ab-1168-4259-8cb8-8a8ed7efeb43@vondra.me> Content-Language: en-US In-Reply-To: <3cebb4ab-1168-4259-8cb8-8a8ed7efeb43@vondra.me> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-GND-Sasl: tomas@vondra.me List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk Hi, I've finally pushed this, after many rounds of careful testing to ensure no regressions, and polishing. All changes since the version shared on September 13 are only cosmetic - renaming a macro to keep it consistent with the other ones, clarifying a couple comments etc. Nothing major. I ended up squashing the two parts into a single commit. I thought about keeping the two steps, but it seemed pointless - the first part inflated the PGPROC struct, which I didn't like to commit, even if only as an intermediate WIP state. So far buildfarm didn't blew up, so let's hope it will stay that way. I just realized there's no CF entry for this - sorry about that :-( I started the thread a year ago to discuss an experimental patche, and it never made it to CFA. But there was a discussion spanning a year, so hopefully that's enough. regards -- Tomas Vondra