IronPort-PHdr: =?us-ascii?q?A9a23=3AkqwenBzc1LShagLXCzPZngc9DxPP8534PQ8Qv?=
 =?us-ascii?q?5wgjb8GMqGu5I/rM0GX4/JxxETIUoPW57Mh6aLWvqnsVHZG7cOHt3YPI5BJX?=
 =?us-ascii?q?gUO3MMRmQFoCcWZCEr9efjtaSFyHMlLWFJ/uX+hNk0AE8flbFqUqXq3vlYv?=
IronPort-Data: =?us-ascii?q?A9a23=3AG1ImxKrbLt7CEJmzg8txT9XNdXheBmLEZxIvg?=
 =?us-ascii?q?KrLsJaIsI4StFCztgarIBmBO/zfMDT8fdEnOoSzpB8OvMeAn99iQVNuri1mF?=
 =?us-ascii?q?CMS8ePIVI+TRqvS04x+DSFioHqKZKzyU/GYRCwPZiKa907F3oTJ9yEmj/nVH?=
 =?us-ascii?q?+SkUYYoBwgoLeNaYHZ54f5cs7ZRbr5A2bBVMivV0T/Ai5S31GyNg1aYBlkpB?=
 =?us-ascii?q?5er83uDihhdVAQw5TTSbdgT1LPXeuJ84Jg3fcldJFOgKmVY83LTegrN8F251?=
 =?us-ascii?q?juxExYFENiplPPwdVcHB++UNgmVgX0QUK+n6vRAjnVtieBga7xNMgEO12jhc?=
 =?us-ascii?q?9NZkL2hsbS7SQ4uOrXFnswWUgJTFGd1OqguFLrvfibh75XIkBKdG5fr67A0Z?=
 =?us-ascii?q?K0sBqUA9f1uBSRW+OYWLyoIZxaIisqywamnUa90gd8/I9PmJ5ob/HZ6wlnxF?=
 =?us-ascii?q?ew3U5rSa7nH4cRRxzA+moZFGvO2T9YWbRJ0dw+GexJPfE8eTo8l9NpELFGXn?=
 =?us-ascii?q?yZwslmZo+885HLeiV0327n2O92TcduPLfi5V32w/grul1kVyDlDaLRzEQa4z?=
 =?us-ascii?q?08=3D?=
IronPort-HdrOrdr: =?us-ascii?q?A9a23=3AKAtgLKMrs8mv6MBcT2v155DYdb4zR+YMi2?=
 =?us-ascii?q?TDiHoedfUFSKOlfp6V8MjzjSWE9Ar4WBkb6LS90dq7MAzhHPlOkMYs1NaZLU?=
 =?us-ascii?q?XbUQ6TTb2KgrGSuwEIdxeOlNK1kJ0QDpSWa+eAQ2SS7/yKmzVQeuxIqLLsnc?=
 =?us-ascii?q?DY5ts2jU0dNz2CAJsQiDuRfzzra3GeMzM2Y6bReqDsg/Zvln6FQzA6f867Dn?=
 =?us-ascii?q?4KU6zovNvQjq/rZhYAGloO9BSOpSnA0s+6LzGomjMlFx9fy7Yr9mbI1ybj4L?=
 =?us-ascii?q?+4jv29whjAk0fO8pVtnsf7wNcrPr3NtiFVEESutu+bXvUlZ1SwhkFwnAhp0i?=
 =?us-ascii?q?dsrDD4mWZjAy200QKWQoj6m2q15+Cq6kdR15ar8y7ovZKkm72geNr/YPAx37?=
 =?us-ascii?q?6wtXDimhEdVZhHodJ29nPcuJxNARzamiPho9DOShFxj0Kx5WEviOgJkhVkIM?=
 =?us-ascii?q?AjgZJq3MUiFXluYd899ePBmfQaOfgrCNuZ6OddcFucYXyctm5zwMa0VnB2Gh?=
 =?us-ascii?q?udWEANtsGczjATxRlCvgYl7d1amm1F+IM2SpFC6eiBOqN0lKtWRstTaa5mHu?=
 =?us-ascii?q?8OTca+F2SISxPRN2CZJ0jhCcg8Sjjwgo+y5K9w6PCheZQOwpd3kJPdUElAvW?=
 =?us-ascii?q?p3YE7qAd3m5uw8zvkMehTLYd3A8LAt23EigMyOeFPCC1z3dGwT?=
From: "James Pang (chaolpan)" <chaolpan@cisco.com>
To: Tom Lane <tgl@sss.pgh.pa.us>
CC: Justin Pryzby <pryzby@telsasoft.com>,
        "pgsql-performance@lists.postgresql.org"
	<pgsql-performance@lists.postgresql.org>
Subject: RE: postgres backend process hang on " D " state
Thread-Topic: postgres backend process hang on " D " state
Thread-Index: AdhzXfHI/fq4oALSSJuDSaqODewFoAADxiWAABVduSAAAlqAgAABSsmwADBx6cA=
Date: Tue, 31 May 2022 02:08:28 +0000
Message-ID: 
 <PH0PR11MB5191C41907CC2C255AA89F6FD6DC9@PH0PR11MB5191.namprd11.prod.outlook.com>
References: 
 <PH0PR11MB5191521AF97E422D288DB9DBD6DA9@PH0PR11MB5191.namprd11.prod.outlook.com>
 <20220529150157.GM19626@telsasoft.com>
 <PH0PR11MB5191C0B3BE53A16AC7EED9FED6DD9@PH0PR11MB5191.namprd11.prod.outlook.com>
 <3723051.1653877267@sss.pgh.pa.us>
 <PH0PR11MB51914B2D764632C934112F84D6DD9@PH0PR11MB5191.namprd11.prod.outlook.com>
In-Reply-To: 
 <PH0PR11MB51914B2D764632C934112F84D6DD9@PH0PR11MB5191.namprd11.prod.outlook.com>
Accept-Language: en-US
Content-Language: en-US
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: 
 =?us-ascii?Q?hHJlg9LNVvArQP3fDe+7t/JZ9HLILSXh92pjACJ5qy73lC4mMRTIb5ehD1qT?=
 =?us-ascii?Q?rZckc9jcmADRcc8r5MatG7T48veXW9yYFcQz+i5NWfwMQsBaHotLGc26JPRh?=
 =?us-ascii?Q?al9MkgNUgdFmgSaLzBzmSjC9ydZFx9AG05BvjymNSk9NzamJBqBdMDK4PF2z?=
 =?us-ascii?Q?zMolPgI2KCyV/QdqEcb4BFa4LOZZSGOjCuXjnpqgt5F64vMqVRTi+HMVj8CJ?=
 =?us-ascii?Q?dACxAS8igD+QDa4R0MGuqcojXLISuMCyexDQ0siiP6oVRUy5PoXzgl7toiq5?=
 =?us-ascii?Q?ApJ/qi9mEbCCsojWqE7NhX59RpZZ/GXqQbOflVwiC6Obhw1hiLvfq0BdDTZD?=
 =?us-ascii?Q?uDogqA3MRLtM+UimWkdpxZAvdWSLmuDdg1LVGloNWU60LM9BfLwbcOAQ4Wfi?=
 =?us-ascii?Q?PMXoQsgauNfXngnzg40uuR+AsGGx3y7AP5kjlVxu3Y1ws1fGdfjvo1pUUxOg?=
 =?us-ascii?Q?rdEXYA9GSvxAwrT0clojJeOLU9MK9xC/TbXtlUn5KHCjPzq762RVVDMCmqW1?=
 =?us-ascii?Q?sGfM4ijwZprWX5CDKd9GEhknZ9FQp0lKDvKmLSEy5WMBW2hdlZPYzn0jSXFl?=
 =?us-ascii?Q?BvLYcnSL2jbk73D/6k5JReHQlelJta2XlqpulCtpXGuPd+cvYL3U2XfcTC4w?=
 =?us-ascii?Q?ixeis9Hh9w/83hbTj7mUQTtQUzgNuauO0BbZrJAj39Ar/SwNGZWGXHKMnxzz?=
 =?us-ascii?Q?eY9u/MdCeoR0i7siZq3KzfHRrni8LvsFEmeGQMqnRw7XNqextW2C69KW0uMk?=
 =?us-ascii?Q?i+t3DqvZKnPJzkPm3AKiBz6duFASE8633ZsCiMMgDH1Jj+X/QI9QxA71irMl?=
 =?us-ascii?Q?wjXCQZx2btjcAtJIi2q1btnanrsCiN7njnS0B7slukNI4vc8T2+Th4kbxcaG?=
 =?us-ascii?Q?JIFddNPxmYojWwmUOYuzTZxcDZKqwQvAltYQoA0nOdW5eVPVT9NY5i94apFZ?=
 =?us-ascii?Q?J4dFYg7qW2k2ejLAEP84Q+2cLNQIPKeYOZeFvsFBb29LhCEgI+ucPnmIbhxf?=
 =?us-ascii?Q?9+uD3Bz3lJSkAZWvCj5deIbG50/5b4BWcesf3VtS9ZgD4Uf+LhxX/LdTK+5R?=
 =?us-ascii?Q?R0rY89jjH3O3FWkMw/O6+09wYqg1ib1/gdPOodcFC9d7LWwUnslyJ7cNCZay?=
 =?us-ascii?Q?PAo8FloqacejcmBEGtiXC6MhsFOz76gRhVt5LXyLX6K315U6wAYvjV+LpRax?=
 =?us-ascii?Q?lQEpK37h9RoatifyxVkFUYOWWvrL6duecxbu/DOqSo2UOjnaeVoglPdd9mlw?=
 =?us-ascii?Q?eap1q2QqC4y3c7aMemdSwyUNTxVVR7ahFVplnvxaBHhWifjYEJVERkxieMp0?=
 =?us-ascii?Q?DYIEBYDlB+BWMXzgFFjMuN4sgpktI+Y2QeylGcHuNwbZNGxKvgPF5Gug59+T?=
 =?us-ascii?Q?fLDW8/KzITvbIhY0q5XmSujZlhDHAC3r3EK8vz6u1Xyl2EZsI4h3OboOKeI7?=
 =?us-ascii?Q?tZ/USstodSU3RYvmWn5X1QqElQLzp8Ad7e7jy08nNZFurDCyYepGfM4HRBea?=
 =?us-ascii?Q?M2ROrQhqZhOSrFD0Nhm/es8LoWjD/9bnpyKIr5vIrkPRNDUGwfnSHvHRHDeK?=
 =?us-ascii?Q?chTtnNHcmJTnJE6MSHBlhVZeC9wArKGlbcAVi2RY7e3McgDsNpOB/h5Q89gI?=
 =?us-ascii?Q?Zg3F78zAOVBowW2xDVlINSYeEzMFxBJxGfKY1W2b6hVJ236Th5eihoxslHgX?=
 =?us-ascii?Q?OSGG32ZsPfzYyf6kvbFnhU9YBv6ad9/58DdOBjdkR5bsF3YKYm5Uw7iDgcKt?=
 =?us-ascii?Q?MbTctVL2+w=3D=3D?=
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: PH0PR11MB5191.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 
 e85e27c4-0cca-4c92-6d99-08da42aa73e6
X-MS-Exchange-CrossTenant-originalarrivaltime: 31 May 2022 02:08:28.2076
 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 5ae1af62-9505-4097-a69a-c1553ef7840e
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: 
 F21HswbREd8SeoFBgPoed2eLRFB37amHyAgif7xUIaiHr6tOnS+VJm3Iab2ECWDcJu+7vp+naQ435bOLFjSKew==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: MWHPR11MB1375
X-OriginatorOrg: cisco.com
X-Outbound-SMTP-Client: 173.37.227.252, xfe-rcd-004.cisco.com
X-Outbound-Node: rcdn-core-9.cisco.com
List-Id: <pgsql-performance.lists.postgresql.org>
List-Help: <https://lists.postgresql.org/manage/>
List-Subscribe: <https://lists.postgresql.org/manage/>
List-Post: <mailto:pgsql-performance@lists.postgresql.org>
List-Owner: <mailto:pgsql-performance-owner@lists.postgresql.org>
List-Archive: <https://www.postgresql.org/list/pgsql-performance>
Archived-At: 
 <https://www.postgresql.org/message-id/PH0PR11MB5191C41907CC2C255AA89F6FD6DC9%40PH0PR11MB5191.namprd11.prod.outlook.com>
Precedence: bulk

    Seems all process blocked by a system service "fapolicy.d", when I stop=
 the service,  defunct process got disappeared and pending backends got rel=
eased or moving on, and database started to accept new connection again.=20
   This fapolicy.d in RHEL8.4 is enabled by system admin to support securit=
y compliance requirements.=20
   systemctl stop fapolicyd , after that, everything go back to be normal s=
oon. =20

Regards,

James


-----Original Message-----
From: James Pang (chaolpan)=20
Sent: Monday, May 30, 2022 11:00 AM
To: Tom Lane <tgl@sss.pgh.pa.us>
Cc: Justin Pryzby <pryzby@telsasoft.com>; pgsql-performance@lists.postgresq=
l.org
Subject: RE: postgres backend process hang on " D " state

   Maybe any bugs from these extensions ?  I can try that removing all exte=
nsions, but we need these extensions.=20

Thanks,

James

-----Original Message-----
From: Tom Lane <tgl@sss.pgh.pa.us>=20
Sent: Monday, May 30, 2022 10:21 AM
To: James Pang (chaolpan) <chaolpan@cisco.com>
Cc: Justin Pryzby <pryzby@telsasoft.com>; pgsql-performance@lists.postgresq=
l.org
Subject: Re: postgres backend process hang on " D " state

"James Pang (chaolpan)" <chaolpan@cisco.com> writes:
> 1. extensions=20
>       shared_preload_libraries =3D 'orafce,pgaudit,pg_cron,pg_stat_statem=
ents,set_user'

Can you still reproduce this if you remove all of those?

			regards, tom lane