pg.ddx.io  pgsql-hackers@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Tom Lane <tgl@sss.pgh.pa.us>
To: Alexander Lakhin <exclusion@gmail.com>
Cc: pgsql-hackers <pgsql-hackers@postgresql.org>
Cc: Andres Freund <andres@anarazel.de>
Subject: Re: plpython tests fail against python 3.14 under Valgrind
Date: Tue, 11 Aug 2026 16:57:02 -0400
Message-ID: <2541685.1786481822@sss.pgh.pa.us> (raw)
In-Reply-To: <2322557.1786409782@sss.pgh.pa.us>
References: <f071e691-5930-4738-9dbd-43ed2da367fe@gmail.com>
	<2322557.1786409782@sss.pgh.pa.us>

I wrote:
> Anyway, I've confirmed that the attached patch makes the problem
> go away here.  Unless somebody wants to expend brain cells on
> running the underlying issue to ground, I think we should just
> apply this to the back branches and be happy.  A variant plan
> could be to do it like this #ifdef USE_VALGRIND and otherwise
> keep the old code, but that seems unduly paranoid to me.

A bit of excavation in our git history reminded me that our old
behavior here was very intentional:

Author: Tom Lane <tgl@sss.pgh.pa.us>
Branch: master Release: REL9_6_BR [62c8421e8] 2016-07-07 11:28:17 -0400

    Reduce stack space consumption in tzload().
    
    While syncing our timezone code with IANA's updates in commit 1c1a7cbd6,
    I'd chosen not to adopt the code they conditionally compile under #ifdef
    ALL_STATE.  The main thing that that drives is that the space for gmtime
    and localtime timezone definitions isn't statically allocated, but is
    malloc'd on first use.  I reasoned we didn't need that logic: we don't have
    localtime() at all, and we always initialize TimeZone to GMT so we always
    need that one.  But there is one other thing ALL_STATE does, which is to
    make tzload() malloc its transient workspace instead of just declaring it
    as a local variable.  It turns out that that local variable occupies 78K.
    Even worse is that, at least for common US timezone settings, there's a
    recursive call to parse the "posixrules" zone name, making peak stack
    consumption to select a time zone upwards of 150K.  That's an uncomfortably
    large fraction of our STACK_DEPTH_SLOP safety margin, and could result in
    outright crashes if we try to reduce STACK_DEPTH_SLOP as has been discussed
    recently.  Furthermore, this means that the postmaster's peak stack
    consumption is several times that of a backend running typical queries
    (since, except on Windows, backends inherit the timezone GUC values and
    don't ever run this code themselves unless you do SET TIMEZONE).  That's
    completely backwards from a safety perspective.
    
    Hence, adopt the ALL_STATE rather than non-ALL_STATE variant of tzload(),
    while not changing the other code aspects that symbol controls.  The
    risk of an ENOMEM error from malloc() seems less than that of a SIGSEGV
    from stack overrun.

Now, we deleted the "posixrules" recursion logic in v13, so in all
active branches the amount of stack space required is 70-something K
not twice that.  But re-reading this message, the postmaster
vs. backends point still seems like a compelling safety argument.
So I'd rather make master work like the old code instead of vice
versa.

Hence, what I'm now thinking is to malloc the space by default,
but use a stack allocation if USE_VALGRIND, with a comment explaining
that that masks an obscure valgrind-or-possibly-python bug; and to
do it the same way in all branches.

			regards, tom lane






view thread (3+ messages)

Message-ID: <2541685.1786481822@sss.pgh.pa.us>
Permalink:  ../2541685.1786481822@sss.pgh.pa.us/
Also on:    postgresql.org/message-id/2541685.1786481822@sss.pgh.pa.us

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-hackers@postgresql.org
  Cc: tgl@sss.pgh.pa.us, exclusion@gmail.com, andres@anarazel.de
  Subject: Re: plpython tests fail against python 3.14 under Valgrind
  In-Reply-To: <2541685.1786481822@sss.pgh.pa.us>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox