Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1t1N7m-00Fyl8-KW for pgsql-bugs@arkaria.postgresql.org; Thu, 17 Oct 2024 09:48:54 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1t1N7k-002S8I-DO for pgsql-bugs@arkaria.postgresql.org; Thu, 17 Oct 2024 09:48:52 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1t1N7k-002S89-2N for pgsql-bugs@lists.postgresql.org; Thu, 17 Oct 2024 09:48:52 +0000 Received: from mail-pl1-x630.google.com ([2607:f8b0:4864:20::630]) by makus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.94.2) (envelope-from ) id 1t1N7d-001L7H-L7 for pgsql-bugs@lists.postgresql.org; Thu, 17 Oct 2024 09:48:51 +0000 Received: by mail-pl1-x630.google.com with SMTP id d9443c01a7336-20ce5e3b116so5932185ad.1 for ; Thu, 17 Oct 2024 02:48:45 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1729158525; x=1729763325; darn=lists.postgresql.org; h=content-transfer-encoding:in-reply-to:from:content-language :references:cc:to:subject:user-agent:mime-version:date:message-id :from:to:cc:subject:date:message-id:reply-to; bh=6j8lSwWxtzsqb4HzSuqYNX+6YLJzYLPvI2okyOg3Jmc=; b=byPaVcqybgziwEN8QuyXeDkazJVSOygl7zZwaMQgSzjjPKxKzzm6S3nqhQqree7jK5 2TI/5jrssIC2qur2nTX5a1r9puGpMcW0+j6oQOZ9dwM8O2C56HOIqRs/ZKi1rCehE0jN EzHf3YqC0qligzgyNpkhJTexoMWqIZ28T/Yk0IIt81uxot0u3KHeGDH2ywW0ZemO67ay LkjGeWes03+GLEiAo1vWHq5kOAz6ynzcI/eQH4OCgPmEvJasee/B73unXx9XEOu1BkRi RnI74qm+oKshCDX+WdphtOF6XcaSKGZlEXcsi0VsxJEfgGibABcowJOMa7oWcRhLdikT cGjA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1729158525; x=1729763325; h=content-transfer-encoding:in-reply-to:from:content-language :references:cc:to:subject:user-agent:mime-version:date:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=6j8lSwWxtzsqb4HzSuqYNX+6YLJzYLPvI2okyOg3Jmc=; b=trEMd0oL7OkZkWt8L3/pa3CUwdhuFoiLMn7zfvz+jcXMLhZaRTcYk2u165m8D7LetP EA99pnvoLS+/vxZnLq72UhccGKyEsX+iWrClnPoW7wbFb93C/QBt4pNfaJN2GCKh+WWc ahjwX12L67ebnXzqNK8b5RjrPbi4W1GwvpyxLcqANcKt3zZ5bZR+LLr+A+36gT+hwJ1z xnnF/aMzrdpV2XsJByno+PKGXGlr/CDwiqGtx8ZiE5AGSCEH543xEFWGvTAkK8brQczO OFxnfL/H6y0bOwYvPbNpuOH4EB0zxx06lGJtoqegBw/Jc1v/xolDjWxY3y3WMzr7TzrL NwEA== X-Forwarded-Encrypted: i=1; AJvYcCWDAmjpCoWiNPMsDjV60hsSbdlfMIwSzCKxuGJs1sI60JFM9/PUgyUiZ74VEC4mNLgmevO9Dib/nw9w@lists.postgresql.org X-Gm-Message-State: AOJu0YxBGiVUj8AMJmXyMMlPD8FlkUvPRnSUIz9sC+VNmeyeNq9kZlin 7194/NmcEJN/PZzgmaaihf7p860ZNDE9jSpa//FNdT8dtqMwWjak X-Google-Smtp-Source: AGHT+IH4dGnPNkY63fsM45bVBEc5PynGMcGsBZJ7vX74owmuyENEgUdECINombK0OmBIvrJbiIkd0A== X-Received: by 2002:a17:902:f551:b0:20c:fb47:5c02 with SMTP id d9443c01a7336-20cfb475ee0mr185949235ad.52.1729158524614; Thu, 17 Oct 2024 02:48:44 -0700 (PDT) Received: from [10.10.20.104] (node-u1e.pool-101-109.dynamic.totinternet.net. [101.109.152.18]) by smtp.gmail.com with ESMTPSA id d9443c01a7336-20d17f9de78sm41126655ad.107.2024.10.17.02.48.42 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Thu, 17 Oct 2024 02:48:43 -0700 (PDT) Message-ID: <7428912d-1600-4e79-9aed-fee788e20ca0@gmail.com> Date: Thu, 17 Oct 2024 16:48:40 +0700 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: Reference to - BUG #18349: ERROR: invalid DSA memory alloc request size 1811939328, CONTEXT: parallel worker To: Thomas Munro Cc: Tom Lane , Craig Milhiser , pgsql-bugs@lists.postgresql.org References: <6785e9e8-4c64-41b0-9e72-c13d1822b599@gmail.com> <0c3b0e1b-55d1-42b6-8c3c-4392479187db@gmail.com> <3581840.1728887169@sss.pgh.pa.us> <3a1ac6f1-ac30-4ed4-8d0d-beb8a5aca7e5@gmail.com> <30fbb76b-4b6f-405e-bf9c-741fe2c7722a@gmail.com> Content-Language: en-AU From: Andrei Lepikhov In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk On 10/17/24 15:57, Thomas Munro wrote: > On Thu, Oct 17, 2024 at 9:12 PM Andrei Lepikhov wrote: >> Yeah, I misunderstood the meaning of the estimated_size variable. Your >> solution is more universal. Also, I confirm, it passes my synthetic test. >> Also, it raises the immediate question: What if we have too many >> duplicates? Sometimes, in user complaints, I see examples where they, >> analysing the database's logical consistency, pass through millions of >> duplicates to find an unexpected value. Do we need a top memory >> consumption limit here? I recall a thread in the mailing list with a >> general approach to limiting backend memory consumption, but it is >> finished with no result. > > It is a hard problem alright[1]. > >> The patch looks good as well as commentary. > > Thanks, I will go ahead and push this now. > > [1] https://www.postgresql.org/message-id/flat/CAAKRu_aLMRHX6_y%3DK5i5wBMTMQvoPMO8DT3eyCziTHjsY11cVA%40mail.gmail.com Thanks for the link. BTW, why not to use current case and fix the problem with the 'invalid DSA memory alloc request size 1811939328' itself ? -- regards, Andrei Lepikhov