Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1uUdFU-0069dY-HE for pgsql-performance@arkaria.postgresql.org; Thu, 26 Jun 2025 03:26:04 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1uUdFS-007AP5-H8 for pgsql-performance@arkaria.postgresql.org; Thu, 26 Jun 2025 03:26:03 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1uUdFS-007AOx-73 for pgsql-performance@lists.postgresql.org; Thu, 26 Jun 2025 03:26:02 +0000 Received: from meldrar.postgresql.org ([2a02:c0:301:0:ffff::31]) by makus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.96) (envelope-from ) id 1uUdFQ-0042AB-2Y for pgsql-performance@lists.postgresql.org; Thu, 26 Jun 2025 03:26:01 +0000 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=postgresql.org; s=20171124; h=Content-Transfer-Encoding:Content-Type: Mime-Version:References:In-Reply-To:From:Subject:Cc:To:Message-Id:Date:Sender :Reply-To:Content-ID:Content-Description; bh=1BRxVqo9H6dGsCn9+X+jz8BkyYSy1rmc4qHJOvMNIOM=; b=WbRZUaiCk3Zs0YVGXjt8NJcj+R GxZuoj8nFiiTQrKPyxJ1wZnYauRsINQOvWWn4VCcG16/R9/dELEV53dG0mYOs9iXLrBPlH00J172A B30Vy5FL2A5zBC1iAQL7wSGihoSrCW3mpausuZKsxXS+1nuniXfhll5M0PHfI1kTfoRzwpS4d37m/ WlCbfiyV9XyDUlEy9oJzbxEKAYHdMu9CTYiTDButG3gXyN0Ue1YRoAtD+vNV9iB0eKSUIC7JljA91 7jw5NkANdmcP211CwTc3ulw+7zf8sFjnZmp3nasRdfEev6Z+s1TiswEorEdF8CFWe/cUXNa4or/E9 htH0iH3A==; Received: from [2409:11:4120:300:435:457c:c4b1:e434] (helo=localhost) by meldrar.postgresql.org with esmtpsa (TLS1.3) tls TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305_SHA256 (Exim 4.96) (envelope-from ) id 1uUdFL-00FGd6-1c; Thu, 26 Jun 2025 03:25:58 +0000 Date: Thu, 26 Jun 2025 12:25:45 +0900 (JST) Message-Id: <20250626.122545.1937425176692913230.ishii@postgresql.org> To: laurenz.albe@cybertec.at Cc: jamespang886@gmail.com, frits.hoogland@gmail.com, pgsql-performance@lists.postgresql.org Subject: Re: many sessions waiting DataFileRead and extend From: Tatsuo Ishii In-Reply-To: References: X-Mailer: Mew version 6.8 on Emacs 26.3 Mime-Version: 1.0 Content-Type: Text/Plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable X-Host-Lookup-Failed: Reverse DNS lookup failed for 2409:11:4120:300:435:457c:c4b1:e434 (failed) List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk > On Thu, 2025-06-26 at 10:32 +0800, James Pang wrote: >> thans for you suggestions, we have iowait from sar command too, copy= here, checking with infra team not found abnormal IO activities either= .=A0=A0 >> 02:00:01 PM =A0CPU =A0 =A0%usr =A0 %nice =A0 =A0%sys %iowait =A0 =A0= %irq =A0 %soft =A0%steal =A0%guest =A0%gnice =A0 %idle >> 02:00:03 PM =A0all=A0 =A015.92 =A0 =A00.00 =A0 43.02 =A0 =A00.65 =A0= =A00.76 =A0 =A02.56 =A0 =A00.00 =A0 =A00.00 =A0 =A00.00 =A0 37.09 > = > Crazy high system time. > = > If it is not transparent hugepages, the other suspect is fork(). Can we use starce -S to collect system call statistics to find out which system call is taking time? Best regards, -- Tatsuo Ishii SRA OSS K.K. English: http://www.sraoss.co.jp/index_en/ Japanese:http://www.sraoss.co.jp