From: Heikki Linnakangas <hlinnaka@iki.fi>
To: Alexander Lakhin <exclusion@gmail.com>
To: Tristan Partin <tristan@neon.tech>
To: Andres Freund <andres@anarazel.de>
Cc: pgsql-hackers <pgsql-hackers@postgresql.org>
Cc: Thomas Munro <thomas.munro@gmail.com>
Subject: Re: Refactoring backend fork+exec code
Date: Sun, 3 Dec 2023 16:41:47 +0200
Message-ID: <70e5dada-3cd4-4d7e-80eb-e841a6f35df8@iki.fi> (raw)
In-Reply-To: <5e976369-2925-e0cc-b5a1-e9e356264596@gmail.com>
References: <7a59b073-5b5b-151e-7ed3-8b01ff7ce9ef@iki.fi>
<20230710225043.svl7fqxecwshwc7a@awork3.anarazel.de>
<119551e6-60f6-49b2-ae04-a382a89f900c@iki.fi>
<e0dcfabb-f59a-45e8-bd92-f8d706c92128@iki.fi>
<CXCDA9YFDZS1.Y5JUZBHLLXYR@neon.tech>
<3b02a5a1-81ea-44e4-a09e-c0a594a4cef8@iki.fi>
<014768ed-8b39-c44f-b07c-098c87b1644c@gmail.com>
<a1b69a02-544a-471e-8b95-81256e992248@iki.fi>
<5e976369-2925-e0cc-b5a1-e9e356264596@gmail.com>
On 02/12/2023 05:00, Alexander Lakhin wrote:
> What bothered me additionally, is an error detected after server start. I
> couldn't see it without the patches applied. I mean, on HEAD I now see
> `make check` passing, but with the patches it fails:
> ...
> # parallel group (20 tests): interval date numerology polygon box macaddr8 macaddr multirangetypes line timestamp
> timetz timestamptz time circle strings lseg inet md5 path point
> not ok 22 + strings 1048 ms
> # (test process exited with exit code 2)
> not ok 23 + md5 1052 ms
> # (test process exited with exit code 2)
> ...
> src/test/regress/log/postmaster.log contains:
> ==00:00:00:30.730 1713480== Syscall param write(buf) points to uninitialised byte(s)
> ==00:00:00:30.730 1713480== at 0x5245A37: write (write.c:26)
> ==00:00:00:30.730 1713480== by 0x51BBF6C: _IO_file_write@@GLIBC_2.2.5 (fileops.c:1180)
> ==00:00:00:30.730 1713480== by 0x51BC84F: new_do_write (fileops.c:448)
> ==00:00:00:30.730 1713480== by 0x51BC84F: _IO_new_file_xsputn (fileops.c:1254)
> ==00:00:00:30.730 1713480== by 0x51BC84F: _IO_file_xsputn@@GLIBC_2.2.5 (fileops.c:1196)
> ==00:00:00:30.730 1713480== by 0x51B1056: fwrite (iofwrite.c:39)
> ==00:00:00:30.730 1713480== by 0x5540CF: internal_forkexec (postmaster.c:4526)
> ==00:00:00:30.730 1713480== by 0x5543C0: bgworker_forkexec (postmaster.c:5624)
> ==00:00:00:30.730 1713480== by 0x555477: do_start_bgworker (postmaster.c:5665)
> ==00:00:00:30.730 1713480== by 0x555738: maybe_start_bgworkers (postmaster.c:5928)
> ==00:00:00:30.730 1713480== by 0x556072: process_pm_pmsignal (postmaster.c:5080)
> ==00:00:00:30.730 1713480== by 0x556610: ServerLoop (postmaster.c:1761)
> ==00:00:00:30.730 1713480== by 0x557BE2: PostmasterMain (postmaster.c:1469)
> ==00:00:00:30.730 1713480== by 0x47216B: main (main.c:198)
> ==00:00:00:30.730 1713480== Address 0x1ffeffd8c0 is on thread 1's stack
> ==00:00:00:30.730 1713480== in frame #4, created by internal_forkexec (postmaster.c:4482)
> ==00:00:00:30.730 1713480==
> ...
Ack, I see this too. I fixed it by adding MCXT_ALLOC_ZERO to the
allocation of the BackendWorker struct. That's a little heavy-handed,
like with the previous failures the uninitialized padding bytes are
written to the file and read back, but not accessed after that. But it
seems like the simplest fix. This isn't performance critical after all.
I also renamed the 'has_worker' field to 'has_bgworker', per Tristan's
suggestion. Pushed with those changes.
Thanks for the reviews!
> 2023-12-02 05:14:30.751 MSK client backend[1713740] pg_regress/rangetypes FATAL: terminating connection due to
> unexpected postmaster exit
> 2023-12-02 05:14:31.033 MSK client backend[1713734] pg_regress/numeric FATAL: postmaster exited during a parallel
> transaction
> TRAP: failed Assert("!IsTransactionOrTransactionBlock()"), File: "pgstat.c", Line: 591, PID: 1713734
>
> I haven't looked deeper yet, but it seems that we see two issues here (and
> Assert is not directly caused by the patches set.)
I have not been able to reproduce this one.
--
Heikki Linnakangas
Neon (https://neon.tech)
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-hackers@postgresql.org
Cc: hlinnaka@iki.fi, exclusion@gmail.com, tristan@neon.tech, andres@anarazel.de, thomas.munro@gmail.com
Subject: Re: Refactoring backend fork+exec code
In-Reply-To: <70e5dada-3cd4-4d7e-80eb-e841a6f35df8@iki.fi>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox