pg.ddx.io  pgsql-bugs@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Tomas Vondra <tomas.vondra@2ndquadrant.com>
To: Jeff Janes <jeff.janes@gmail.com>
Cc: ben@lantern.is, pgsql-bugs <pgsql-bugs@lists.postgresql.org>
Subject: Re: BUG #16112: large, unexpected memory consumption
Date: Thu, 14 Nov 2019 00:18:27 +0100
Message-ID: <20191113231827.dljqkbuf22v2gftf@development> (raw)
In-Reply-To: <CAMkU=1yXNf_=dFtOkp=M2kXs1RHPgUddxAv3qDfyAfOEOz=YnA@mail.gmail.com>
References: <16112-4448bbf55a404189@postgresql.org>
	<20191113145004.opxx4vuajyoadbcq@development>
	<CAMkU=1yXNf_=dFtOkp=M2kXs1RHPgUddxAv3qDfyAfOEOz=YnA@mail.gmail.com>

On Wed, Nov 13, 2019 at 05:53:28PM -0500, Jeff Janes wrote:
>On Wed, Nov 13, 2019 at 9:50 AM Tomas Vondra <tomas.vondra@2ndquadrant.com>
>wrote:
>
>>
>> Yeah, I can reproduce this pretty easily. It seems like a memory leak in
>> ExecMakeTableFunctionResult. a9c35cf85ca reworked FunctionCallInfo to be
>> variable-length, but it gets allocated in ExecutorState context directly
>> and so until the end of the query.
>>
>
>I find the leak was introduced much earlier than that, in:
>
>commit 763f2edd92095b1ca2f4476da073a28505c13820
>Author: Andres Freund <andres@anarazel.de>
>Date:   Thu Nov 15 14:26:14 2018 -0800
>
>    Rejigger materializing and fetching a HeapTuple from a slot.
>
>I have no idea if this info is useful to informing the best solution,
>though.
>

Ah, I've only done a simple 'git blame' and assumed it's the last commit
that touched the palloc line (and it seemed somewhat plausible). I don't
think it changes the reasoning too much, though.

>You patch applied to REL_12_STABLE does fix it for me.
>
>
>> The attached trivial patch fixes that by adding a pfree() at the end of
>> the function. I wonder if we have the same issue elsewhere ...
>>
>>
>Is there an easy way to assess if the "make check" regression tests are
>taking more memory than they used to?
>

Probably not. The regression tests use fairly small number of rows in
general, and we don't have a way to track/inspect high watermaks or
anything like that anyway.

regards

-- 
Tomas Vondra                  http://www.2ndQuadrant.com
PostgreSQL Development, 24x7 Support, Remote DBA, Training & Services 





view thread (16+ messages)  latest in thread

Message-ID: <20191113231827.dljqkbuf22v2gftf@development>
Permalink:  ../20191113231827.dljqkbuf22v2gftf@development/
Also on:    postgresql.org/message-id/20191113231827.dljqkbuf22v2gftf@development

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-bugs@postgresql.org
  Cc: tomas.vondra@2ndquadrant.com, jeff.janes@gmail.com, pgsql-bugs@lists.postgresql.org
  Subject: Re: BUG #16112: large, unexpected memory consumption
  In-Reply-To: <20191113231827.dljqkbuf22v2gftf@development>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox