From: Bertrand Drouvot <bertranddrouvot.pg@gmail.com>
To: Tomas Vondra <tomas@vondra.me>
Cc: Christoph Berg <myon@debian.org>
Cc: Andres Freund <andres@anarazel.de>
Cc: Tomas Vondra <tomas.vondra@postgresql.org>
Cc: pgsql-hackers@lists.postgresql.org
Subject: Re: pgsql: Introduce pg_shmem_allocations_numa view
Date: Tue, 24 Jun 2025 11:10:24 +0000
Message-ID: <aFqHoNXQ/uWKXJ4U@ip-10-97-1-34.eu-west-3.compute.internal> (raw)
In-Reply-To: <a3a4fe3d-1a80-4e03-aa8e-150ee15f6c35@vondra.me>
References: <6c9f9f7e-947b-4fc3-bdb6-b0696d7492e5@vondra.me>
<aFm5tmSFwhGX7mA7@msg.df7cb.de>
<ce305c79-0a68-46ce-b563-ab9f87bb5f20@vondra.me>
<aFm-ZfL-vz9I2Zmc@msg.df7cb.de>
<0643ae61-cf9d-482c-9b2c-fb861b24fd22@vondra.me>
<aFnGQ2lfb8cfukim@msg.df7cb.de>
<cd16c4a3-2860-46de-a74e-5532d1b2ee39@vondra.me>
<6342f601-77de-4ee0-8c2a-3deb50ceac5b@vondra.me>
<aFpg1de9ZfS1QgUt@ip-10-97-1-34.eu-west-3.compute.internal>
<a3a4fe3d-1a80-4e03-aa8e-150ee15f6c35@vondra.me>
Hi,
On Tue, Jun 24, 2025 at 11:20:15AM +0200, Tomas Vondra wrote:
> On 6/24/25 10:24, Bertrand Drouvot wrote:
> > Yeah, same for me with pg_get_shmem_allocations_numa(). It works if
> > pg_numa_query_pages() is done on chunks <= 16 pages but fails if done on more
> > than 16 pages.
> >
> > It's also confirmed by test_chunk_size.c attached:
> >
> > $ gcc-11 -m32 -o test_chunk_size test_chunk_size.c
> > $ ./test_chunk_size
> > 1 pages: SUCCESS (0 errors)
> > 2 pages: SUCCESS (0 errors)
> > 3 pages: SUCCESS (0 errors)
> > 4 pages: SUCCESS (0 errors)
> > 5 pages: SUCCESS (0 errors)
> > 6 pages: SUCCESS (0 errors)
> > 7 pages: SUCCESS (0 errors)
> > 8 pages: SUCCESS (0 errors)
> > 9 pages: SUCCESS (0 errors)
> > 10 pages: SUCCESS (0 errors)
> > 11 pages: SUCCESS (0 errors)
> > 12 pages: SUCCESS (0 errors)
> > 13 pages: SUCCESS (0 errors)
> > 14 pages: SUCCESS (0 errors)
> > 15 pages: SUCCESS (0 errors)
> > 16 pages: SUCCESS (0 errors)
> > 17 pages: 1 errors
> > Threshold: 17 pages
> >
> > No error if -m32 is not used.
> >
> > We could work by chunks (16?) on 32 bits but would probably produce performance
> > degradation (we mention it in the doc though). Also would always 16 be a correct
> > chunk size?
>
> I don't see how this would solve anything?
>
> AFAICS the problem is the two places are confused about how large the
> array elements are, and get to interpret that differently.
> I don't see how using smaller array makes this correct. That it works is
> more a matter of luck,
Not sure it's luck, maybe the wrong pointers arithmetic has no effect if batch
size is <= 16.
So we have kernel_move_pages() -> kernel_move_pages() (because nodes is NULL here
for us as we call "numa_move_pages(pid, count, pages, NULL, status, 0);").
So, if we look at do_pages_stat() ([1]), we can see that it uses an hardcoded
"#define DO_PAGES_STAT_CHUNK_NR 16UL" and that this pointers arithmetic:
"
pages += chunk_nr;
status += chunk_nr;
"
is done but has no effect since nr_pages will exit the loop if we use a batch
size <= 16.
So if this pointer arithmetic is not correct, (it seems that it should advance
by 16 * sizeof(compat_uptr_t) instead) then it has no effect as long as the batch
size is <= 16.
Does test_chunk_size also fails at 17 for you?
[1]: https://github.com/torvalds/linux/blob/master/mm/migrate.c
Regards,
--
Bertrand Drouvot
PostgreSQL Contributors Team
RDS Open Source Databases
Amazon Web Services: https://aws.amazon.com
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-committers@postgresql.org
Cc: bertranddrouvot.pg@gmail.com, tomas@vondra.me, myon@debian.org, andres@anarazel.de, tomas.vondra@postgresql.org, pgsql-hackers@lists.postgresql.org
Subject: Re: pgsql: Introduce pg_shmem_allocations_numa view
In-Reply-To: <aFqHoNXQ/uWKXJ4U@ip-10-97-1-34.eu-west-3.compute.internal>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox