public inbox for [email protected]
help / color / mirror / Atom feedFrom: Robert Haas <[email protected]>
To: Heikki Linnakangas <[email protected]>
Cc: Ashutosh Bapat <[email protected]>
Cc: Andres Freund <[email protected]>
Cc: pgsql-hackers <[email protected]>
Cc: [email protected]
Subject: Re: Better shared data structure management and resizable shared data structures
Date: Thu, 12 Mar 2026 16:05:32 -0400
Message-ID: <CA+Tgmob7E3CGDoEBB3mwfk+v1CgcOG8yL0VHje2gy9Ts=e1Zxw@mail.gmail.com> (raw)
In-Reply-To: <[email protected]>
References: <CAExHW5vM1bneLYfg0wGeAa=52UiJ3z4vKd3AJ72X8Fw6k3KKrg@mail.gmail.com>
<[email protected]>
<CAExHW5s9Vp+-vJi020UJ+otyccBBo7eT1g6bttdRKL6HAvscyQ@mail.gmail.com>
<mlsruptoxgm2nqtdfyfsowjklzxl5zltsjb3y5bmywtigm474l@5tsonk4t3kia>
<CAExHW5uEK+eeG7e2g6uWh7POrFpfp+dqfaa=_3miMN17zgeaJw@mail.gmail.com>
<CAExHW5vz+PUHHUuzGRwtyx-mPLQk3nCZXxrFqnruRadEFrO5Xg@mail.gmail.com>
<CAExHW5so6VSxBC-1V=35229Z1+dw5vhw8HxHg9ry7UzceKcXzA@mail.gmail.com>
<[email protected]>
<CA+TgmoaoSha9KnSdrA7DDMYD9+Uor4OPEaQ88bbEC3QuVE5Mcg@mail.gmail.com>
<[email protected]>
<CA+TgmoboxAaS6MCRf__LRhf8Ji3B0O9_=d7KzRS12QhOuocnTQ@mail.gmail.com>
<[email protected]>
On Thu, Mar 12, 2026 at 3:21 PM Heikki Linnakangas <[email protected]> wrote:
> >> I'm currently leaning towards _PG_init(), except for allocations that
> >> depend on MaxBackends. For those, you can install a shmem_request_hook
> >> that sets the size in the descriptor. In other words, you can leave the
> >> 'size' as empty in _PG_init(), but set it later in the shmem_request_hook.
> >
> > Why can't you just do the whole thing later?
>
> shmem_request_hook won't work in EXEC_BACKEND mode, because in
> EXEC_BACKEND mode, ShmemRegisterStruct() also needs to be called at
> backend startup.
>
> One of my design goals is to avoid EXEC_BACKEND specific steps so that
> if you write your extension oblivious to EXEC_BACKEND mode, it will
> still usually work with EXEC_BACKEND. For example, if it was necessary
> to call a separate AttachShmem() function for every shmem struct in
> EXEC_BACKEND mode, but which was not needed on Unix, that would be bad.
That's *definitely* a good goal. A less important but still valuable
goal is to maximize the notational simplicity of the mechanism. Your
callback idea is elegant in theory but in practice it seems like it
might make it harder for people to get started quickly on a new
module, and having to create the object in one place and then fill in
the size in another sort of has the same problem. I don't really know
what to do about that, but it's something to think about. The
complexity of getting the details right is annoyingly high in this
area.
> > Yeah, I think RequestNamedLWLockTranche() might be fine if you just
> > need LWLocks, but if you need a bunch of resources, putting them all
> > into the same chunk of memory seems cleaner.
>
> Agreed. Then again, how often do you need just a LWLock (or multiple
> LWLocks)? Surely you have a struct you want to protect with the lock. I
> guess having shmem hash table but no struct would be pretty common, though.
Yeah, we've developed an annoying number of different ways to do this
stuff. I don't entirely know how to fix that.
--
Robert Haas
EDB: http://www.enterprisedb.com
view thread (75+ messages) latest in thread
reply
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: [email protected]
Cc: [email protected], [email protected], [email protected], [email protected], [email protected]
Subject: Re: Better shared data structure management and resizable shared data structures
In-Reply-To: <CA+Tgmob7E3CGDoEBB3mwfk+v1CgcOG8yL0VHje2gy9Ts=e1Zxw@mail.gmail.com>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox