Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1tZRBa-009JLx-RW for pgsql-general@arkaria.postgresql.org; Sun, 19 Jan 2025 09:01:39 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1tZRBY-005wMm-IU for pgsql-general@arkaria.postgresql.org; Sun, 19 Jan 2025 09:01:37 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1tZRBY-005wMe-5d for pgsql-general@lists.postgresql.org; Sun, 19 Jan 2025 09:01:36 +0000 Received: from mail-ed1-x534.google.com ([2a00:1450:4864:20::534]) by magus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.96) (envelope-from ) id 1tZRBV-000Kjk-0j for pgsql-general@postgresql.org; Sun, 19 Jan 2025 09:01:35 +0000 Received: by mail-ed1-x534.google.com with SMTP id 4fb4d7f45d1cf-5d3f57582a2so9244072a12.1 for ; Sun, 19 Jan 2025 01:01:33 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1737277291; x=1737882091; darn=postgresql.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=oOuXStHgu/Ibd2EY70eyZ46mOjp09YHGVBt51/qnMjQ=; b=kTHcEuprMVr5tpovGpyy44DZBG/A4cJtAANEZ4g548QqNGyjx+lkdeQipMTv+Ssy8f Qn5d8NiI468feOfeqvtcymX46jy55hMeFNyuRgvcnk4nUaYf5J1LrSfWTurPOJ8cXE7Z BcYm8YLvAAIPqzQXzHzg/iJv6Z9l4mHDCrfMIrQl/x0otTOwMjBD5Ys1udrwPQq0AL1H MWo4JStcmW2e/JMUNKaF/IPWaVDbvBaJZObC25weCsSe6cnMswMw+jlt5pfLXmT88VYv z6O1yPOi8ZmvgJ10D9dYvlmRhnprW7VHayJCNGs0FlYS/SW5zcujtHmBTaLOdbmPB3+1 8vkA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1737277291; x=1737882091; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=oOuXStHgu/Ibd2EY70eyZ46mOjp09YHGVBt51/qnMjQ=; b=Ts4nkQdympjfAiUxvavIbpmjtLWxo8dgmLuiAkrgKI3VVi6MMeVsgGaTu9lm+tskbR upbnZSAjS+NRi1xMNDoDARAIZBtRYKhDrl96CiQuPZbl1/xPtvbVwR7h7/xaBrzY47vU k556jq11GHLIyUQrwRZBwJFVYwsOxnUnmFBq53qPYgG8MJ2gtb+VUmT8i2WLRavrryOV /LI1uL35KLoDaVFryfkb7oiPDI/VnGv40/KEkoa/xhGbxt9N6eTq+W3h3x3dNVtxCg2z NDvdPzC8aNqdArn2Yfr/HPXk5bEOT/eJfptefWoiZFMQm4jqo7sDg2N23epTQvcmfNPf KKZw== X-Forwarded-Encrypted: i=1; AJvYcCUDjRwHZwv7W+xdtIrEjtq/dThYSE8yliuD10OWWhbRtNRLQJ7EOWudcjfnFH2timPuKE4qAcUlbq6UNnmD@postgresql.org X-Gm-Message-State: AOJu0YxHhxpNAwlXSestMr6I8y95aeWhkgA9FS7RsvHNU/wetPibu52n Qsmj9ygJuaUJyEQTdfZCwLNj06iSCIptrKXgJcOOA2qF+gFVkM3Jtex0BnFAg5KSf3RdtLRugrv Gshp5JJtdBV0Cd10Ry2wm3OQ7WGP9uXya X-Gm-Gg: ASbGnctXIWto6ldHwB9EFWc8uQsLxdut3HkZR/8IqtdB+UmL4ISS+mDv8MNNlkllb+d LE8keEGHjMLRhWSSk7wTyGOCrOa0VhWTHHaOkCl7+3oaH07iNln8= X-Google-Smtp-Source: AGHT+IFytCSLf86+G1wYyW0rYRQFHyOndnZA0uk6bbdUpUFK4CplsSjSyM/xczJQF/vZZSDUWbl1JCw8rBxZYXjbrUs= X-Received: by 2002:a17:907:1b1a:b0:aab:8311:951f with SMTP id a640c23a62f3a-ab38cba41d7mr869418266b.6.1737277290882; Sun, 19 Jan 2025 01:01:30 -0800 (PST) MIME-Version: 1.0 References: <0af98214-3c2a-43e5-9bbf-ddd79b85ea93@ebi.ac.uk> <709d5fa0-85e1-40a2-a6a4-11040f4e5b62@ebi.ac.uk> <679341.1736864393@sss.pgh.pa.us> <9b69fcc6-dca1-4671-af00-b250f154fb14@ebi.ac.uk> In-Reply-To: <9b69fcc6-dca1-4671-af00-b250f154fb14@ebi.ac.uk> From: Durgamahesh Manne Date: Sun, 19 Jan 2025 14:31:18 +0530 X-Gm-Features: AbW1kva81boDj_UbcosIWBtXpWCdGsGeZApm68n0yq8UDPBlfVFdjoINsvDvuo4 Message-ID: Subject: Re: Postgresql database terminates abruptly with too many open files error To: Sri Mrudula Attili Cc: Tom Lane , PostgreSQL mailing lists Content-Type: multipart/alternative; boundary="000000000000ccaea1062c0b63e6" List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk --000000000000ccaea1062c0b63e6 Content-Type: text/plain; charset="UTF-8" ---------- Forwarded message --------- From: Sri Mrudula Attili Date: Wed, 15 Jan, 2025, 17:12 Subject: Re: Postgresql database terminates abruptly with too many open files error To: Tom Lane Cc: Hello Tom, The max_connections =200 and max_files_per_process =1000 as you mentioned. So should a max_files_per_process =500 helps? I could see from the number of connections to the databaseis not exceeding 20. But still these 20 are causing all the damage or using up all the openfiles quota. Thanks, Sri On 14/01/2025 14:19, Tom Lane wrote: > Sri Mrudula Attili writes: >> We have a postgresql VDB(virtual database- Delphix) that keeps >> terminating due "to too many open files". > What do you have max_connections set to, and how many actually-live > server processes are there typically? > >> The number of allowed openfiles at OS level are 65000. > I'm suspecting that you either need to increase that, decrease > max_files_per_process (which defaults to 1000), or decrease > max_connections. > > regards, tom lane Hi Team, What is the final conclusion for this ? Regards, Durga Mahesh --000000000000ccaea1062c0b63e6 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


---------- Forwarded mes= sage ---------
From: Sri= Mrudula Attili <sri@ebi.ac.uk>
Date: Wed, 15 Jan, 2025, 17:12
Sub= ject: Re: Postgresql database terminates abruptly with too many open files = error
To: Tom Lane <tgl@sss.pgh.= pa.us>
Cc: <p= gsql-general@postgresql.org>


Hello Tom,


The max_connections =3D200 and max_files_per_process =3D1000 as you mention= ed.

So should a max_files_per_process =3D500 helps?


I could see from the number of connections to the databaseis not
exceeding 20. But still these 20 are causing all the damage or using up all the openfiles quota.


Thanks,

Sri

On 14/01/2025 14:19, Tom Lane wrote:
> Sri Mrudula Attili <sri@ebi.ac.uk> writes:
>>=C2=A0 =C2=A0=C2=A0We have a postgresql VDB(virtual database- Delph= ix) that keeps
>> terminating due "to too many open files".
> What do you have max_connections set to, and how many actually-live > server processes are there typically?
>
>> The number of allowed openfiles at OS level are 65000.
> I'm suspecting that you either need to increase that, decrease
> max_files_per_process (which defaults to 1000), or decrease
> max_connections.
>
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0regards, tom lane


Hi Team,

What is the final conclusion for this ?

Regards,
Durga Mahesh=C2=A0


--000000000000ccaea1062c0b63e6--