Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1uYxYB-00E2ec-0y for pgsql-hackers@arkaria.postgresql.org; Tue, 08 Jul 2025 01:55:15 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1uYxY9-005g4g-3Z for pgsql-hackers@arkaria.postgresql.org; Tue, 08 Jul 2025 01:55:13 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1uYxY8-005g4Y-OO for pgsql-hackers@lists.postgresql.org; Tue, 08 Jul 2025 01:55:13 +0000 Received: from mailfr00.databene.net ([31.170.12.19]) by magus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.96) (envelope-from ) id 1uYxY6-006Mxe-2q for pgsql-hackers@lists.postgresql.org; Tue, 08 Jul 2025 01:55:13 +0000 Received: from localhost (localhost.localdomain [127.0.0.1]) by mailfr00.databene.net (Postfix) with ESMTP id 513C25F2D0; Tue, 8 Jul 2025 03:55:10 +0200 (CEST) X-Virus-Scanned: by Amavis at mailfr00.databene.net Received: from mailfr00.databene.net ([127.0.0.1]) by localhost (databene-mailfr00.evolix.net [127.0.0.1]) (amavis, port 10024) with LMTP id IIT8qXAsmk6U; Tue, 8 Jul 2025 03:55:08 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=data-bene.io; s=2024; t=1751939708; bh=4GHN8OI68o2KKpU6UwBYarqWcOJrtul3sHsI8InGTWI=; h=Date:Subject:To:Cc:References:From:In-Reply-To:From; b=U9aG6ullPzJ6GCeVnDqIAG+PGXuT0KEXIyO45JdQUl1AVF0wq7oO+b/KJAPyRkRBv FYyCpiivIPp07nK4S8VAJi0uvXOnyHET8b43CuOhhRiQKSnN8TWRx2n2By/VOMzgxc /Lpbnca8xhSyL0JhtLZxMXByxUUGCEXfVyWZpNjUnu2DNH7V2yg4D0CiTvLEY9IHK5 CDszcr8rPcfnU6E5pgYlQNAsXG+H3hUN163Ql79NJXF85zucI2mfvJN3gl6dMCdr4s S4vLTADPKF7bZ2JwsWcnjVfaz+RZm8WdgdTsXDO2ZPlwOjIExlH8eb0en1jZFMoOVU G/aut56oAlHutKhFMGxeoauPBiZ84GZdGiXOEZPxJ5TFVbO0e1fUoBaNIzdQuLwkI4 v/AiFUeFdfBN5pMfKqpwAuLT8MmI/+5UYTKREI1wV5ai61yd1g6YIJttqD5UMsjCQ8 VXI48eDHfOIPJBrUmrJt3fVLYSx6vY2PU1payKRATuE9xnTfHrVrjhqVtI10292iDT LVgdMwSmK0TOVqCVpKE4kdSPRQGRqHDgSHQhRay0RdS0osQ+vEjMToHEqQyjZsxwbv WprRZkxj+xEFxWVscf7X00bSiy3pf5nCsxPDKi+ul+t9IL7u+FcN65+q+qfLxvD6tM Upruy1nJ9MZSwomsdPAlIjSw= Received: from [127.0.0.1] (257400053.box.freepro.com [95.178.90.96]) by mailfr00.databene.net (Postfix) with ESMTPSA id 044035F2A1; Tue, 8 Jul 2025 03:55:07 +0200 (CEST) Message-ID: Date: Tue, 8 Jul 2025 01:55:00 +0000 MIME-Version: 1.0 Subject: Re: Adding basic NUMA awareness - Preliminary feedback and outline for an extensible approach To: Andres Freund Cc: Tomas Vondra , PostgreSQL Hackers References: <099b9433-2855-4f1b-b421-d078a5d82017@vondra.me> <1caea3b1-3e0b-4bdb-a630-75671f1f837a@data-bene.io> From: =?UTF-8?Q?C=C3=A9dric_Villemain?= Autocrypt: addr=cedric.villemain@data-bene.io; keydata= xsBNBEvW1WwBCAC6CG3zZnRpQwmSiFoTjaHlgt7RQ2RmYDqSB7DNtOItV9bBDUe4DKxV9iNF SoD2yV2LrzsYghWXwI0snHGVGCLkJFYBkqyMnJeli5PoHcn9jI12mOz0hdpsTmTJbH+JCLXF admIjh+sz+m7X4net3UQhj8tCaExkdNsw7FWfNr6oHOVkLWlTWh1df1dfTZ3CBZ8vc1L6dIn mWe3i2sRGQ/fCy7XfLqjFe5U+D3jXmqF92p7n8v0vwDZarn4MVeBegTtBYUxpM8Bj78Lga9a SW+ojYo21Zk/TYn+fdOX4L9nNiRFgnAYVjPlWwjV30WpVlQ56o8U+zV2hCNRQyl5QxkNABEB AAHNMUPDqWRyaWMgVmlsbGVtYWluIDxjZWRyaWMudmlsbGVtYWluQGRhdGEtYmVuZS5pbz7C wI4EEwEKADgWIQQ66LJpfJwdoY4rdHTbIB9Ms1QXmwUCY3ARzwIbAwULCQgHAgYVCgkICwIE FgIDAQIeAQIXgAAKCRDbIB9Ms1QXm9oTB/41lFaXCcwtzLjjN7Qr7lImBjiTOntvhzFOBUMP xZWmrXzVl1jVzQm8ubsZNJFB98kw5MrhZjY0sY4x6Txlh6y/OTtpT0RWfZQOGSmfpMq8QDuV gymCfXyr0t4XHFou31nlaqEz1CyUi8ZaYdutJAV0L8j1e0LUHvTcCmlHOsb1uS+Xf5yc7ub+ eRiGtjXwM+OJBYYkFZ2Ebyw7mHWRF4+B3QXUjZhPCQZWBQE1GeX1KxrSCfSKfqujVWCwgiF9 q5TQisgzVRwPBwsi5Fam2X7UHD8I6ZjaAiKHJXezP/Ied/bup457DlXfOg5ORePJgIldMo0p AtHIY1061TckCPs9zsBNBEvW1WwBCAC1iEAHk3lEWEDp9O/DebejwyNr9Zmun6NXPN5axuSj 5VKWP/2CCmsPkcIQlH70rEtZl4vQjXrdRviRcc56TC/SSXti8uOVr/55uStitTCjKRkpxPdf ReOFuOB7OUkHrE3gF6N0UNgOMgmBsT5+rgFm+xqY6TOrvnDVGUbAGkJIdzgTjzeu96BcBEuF 59r+grsmff8PUGtertKeXBr8NlliYZEFCilqus3PheOetWewysHROQJrqnSkpRP7zJWyFYY5 W6PWKQlUgcItrWsgPlHl5gmoH68zesTlW1rX1Z56V8vLPF7RTAPG6g1J7l29wLxUYTwF5Y64 gy+jXAEUJHKZABEBAAHCwF8EGAECAAkFAkvW1WwCGwwACgkQ2yAfTLNUF5ubKAgAtZdh0QJU Wc7WfZhoGOcAEADZJ9n6GSuhL+oxuhPfym1zsU70241rKYZH1m53CWWo+aNyThCXJx+HSSRV /hLNVW34DErJeNJIYwdxPo5/AjOhIUr4e8gMYuviFESBaMpgl8mSM1B1cHVBMZcsQb43Rc3V VfIMNRc4NB16uc7Sm++fbraQq13rB8HC6uYu7PbEAdX3C0IokR3JGb1NghQKga/OoU22KPEx Y+bFk4h3vq9MjlKLir0UJZHKSQ5xec6RcehoMBy0FHBEuK/72xN36dR/3bVwyeR76S7xf9UQ gXdpciBG95/tLRcpelwx8GaRcivTGc0FCBUzqG/YcCqvcA== In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk Hi Andres, > Hi, > > On 2025-07-05 07:09:00 +0000, Cédric Villemain wrote: >> In my work on more careful PostgreSQL resource management, I've come to the >> conclusion that we should avoid pushing policy too deeply into the >> PostgreSQL core itself. Therefore, I'm quite skeptical about integrating >> NUMA-specific management directly into core PostgreSQL in such a way. > > I think it's actually the opposite - whenever we pushed stuff like this > outside of core it has hurt postgres substantially. Not having replication in > core was a huge mistake. Not having HA management in core is probably the > biggest current adoption hurdle for postgres. > > To deal better with NUMA we need to improve memory placement and various > algorithms, in an interrelated way - that's pretty much impossible to do > outside of core. Except the backend pinning which is easy to achieve, thus my comment on the related patch. I'm not claiming NUMA memory and all should be managed outside of core (though I didn't read other patches yet). -- Cédric Villemain +33 6 20 30 22 52 https://www.Data-Bene.io PostgreSQL Support, Expertise, Training, R&D