Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1razO3-00CU98-DH for pgsql-bugs@arkaria.postgresql.org; Fri, 16 Feb 2024 14:40:23 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1razNy-002Mim-H3 for pgsql-bugs@arkaria.postgresql.org; Fri, 16 Feb 2024 14:40:18 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1razNy-002Mie-4X for pgsql-bugs@lists.postgresql.org; Fri, 16 Feb 2024 14:40:18 +0000 Received: from mail.postgrespro.ru ([93.174.131.139]) by makus.postgresql.org with esmtps (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1razNu-0073vw-Kr for pgsql-bugs@lists.postgresql.org; Fri, 16 Feb 2024 14:40:16 +0000 Received: from [192.168.1.35] (cm-27-145-178-8.revip12.asianet.co.th [27.145.178.8]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: a.lepikhov@postgrespro.ru) by mail.postgrespro.ru (Postfix/587) with ESMTPSA id A260DE21107; Fri, 16 Feb 2024 17:40:08 +0300 (MSK) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=postgrespro.ru; s=mx2023; t=1708094409; bh=3jFf0ZliLctZL+SERaBybicRfwxef+dlxpba7uDqTIQ=; h=Message-ID:Date:User-Agent:Subject:To:References:From:In-Reply-To: From; b=37VVEN0lYuJ+4KC6jCrjHaoSqG1yQRRbl/3TEHDtUOLVwEWpMTmH9/fNA+jii0H41 H3lGYMu5uP65skde6wiDRG1s8H6k8OdRR35d+IUzMf7gYizBsQrZ9CTedWcn/NreAG lbwqu3m3BKwHhffCrRYwU9GHMXSA/z+98vVGKJF73vmpFNEB3QkJz4q655irYK++ww 1KUkyzgEpVUwEF32E6wZgvM/hG5bX+ttlyizm7MHocqnHlOWEkMLHUQADR8LAVGo79 XQZASPkzunoKtxgK4QP1ox/WfxDSVaXPxAOvwO9PyIvL6ZcA7njMWvDlIKw7GKE9xl /AEeyh32HeSTQ== Message-ID: <512ef568-336e-4087-ba23-f22b006d329d@postgrespro.ru> Date: Fri, 16 Feb 2024 21:40:03 +0700 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: BUG #18349: ERROR: invalid DSA memory alloc request size 1811939328, CONTEXT: parallel worker Content-Language: en-US To: alexey.ermakov@dataegret.com, pgsql-bugs@lists.postgresql.org, PG Bug reporting form References: <18349-83d33dd3d0c855c3@postgresql.org> From: Andrei Lepikhov Organization: Postgres Professional In-Reply-To: <18349-83d33dd3d0c855c3@postgresql.org> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk On 16/2/2024 20:18, PG Bug reporting form wrote: > Interesting thing: after query fails it take some time (seconds) before psql > gives control back. > It turns out that postgresql written 1M+ (!) temporary files (most of them > are empty) and cleaning up takes some time. Interesting. It correlates with one performance issue I have been trying to catch already 3 months. Could you provide some reproduction of that behavior? > With bigger work_mem it won't write so many files. Maybe memory issue > somehow related with number of files. > > In PostgreSQL 16.2 there were fix for similar bug: [1],[2]. Could it be that > there is some issue with it ? Looks like surely the same issue we fixed recently: Parallel Hash Join + DSM is a sign of that problem. -- regards, Andrei Lepikhov Postgres Professional