Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1t03Qm-009IMD-Po for pgsql-general@arkaria.postgresql.org; Sun, 13 Oct 2024 18:35:04 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1t03Qj-006HZK-J8 for pgsql-general@arkaria.postgresql.org; Sun, 13 Oct 2024 18:35:01 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1t03Qj-006HZA-0l for pgsql-general@lists.postgresql.org; Sun, 13 Oct 2024 18:35:01 +0000 Received: from mail-ed1-x52b.google.com ([2a00:1450:4864:20::52b]) by makus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.94.2) (envelope-from ) id 1t03Qc-000i1u-PC for pgsql-general@lists.postgresql.org; Sun, 13 Oct 2024 18:35:00 +0000 Received: by mail-ed1-x52b.google.com with SMTP id 4fb4d7f45d1cf-5c97c7852e8so417587a12.1 for ; Sun, 13 Oct 2024 11:34:54 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1728844492; x=1729449292; darn=lists.postgresql.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=UMBDJGum7sehYRlBO7JAT8+YrZVJGfcQvA20cu4vqzI=; b=Ij22cUNAN0fQjkyUIwzqJomb4TchtL4LkyujwLpJuVR8kS+QGmH84y37HQ9MEHpCod 1JkRQjkU2SKFffiygCvGNRo/GmGhZ9ZGz2ThQ4W4VtPfOzcvKNDx4gd4WYU6MToZen/h KXWYHfQ1q2M2G6GsfLgIdKS0aRmdBKknB3YiEGK2IfHXVdL80JAJFdeD+meEb+MMcEES PvG58MeozUD5HWa5cDDYZjIwc3OrsbFdmsnOyT6WnDH73vs8lLI5qmQCh8yCAednwmZq 32VChHyJv3rerarh14sT0+2qzxrxFgZX3X87dpFQRNL66FbSbNPzomOOUc4/exy8WCBE h8cw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1728844492; x=1729449292; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=UMBDJGum7sehYRlBO7JAT8+YrZVJGfcQvA20cu4vqzI=; b=Q6nGFDz79gyPdl5h3+cspCE/9dUd6mC35c/h9ch+gMFn2WmJLtN9CklX/GJHaDp8JN 7XL4/8nM0HwcI5FXKYmiamNxfsTycyvwfrQQ1/PEEei84ISwPWBIS/a21bC+wh2g6ETT MEyvRRdH95v3rY45apdrIO5N5xVUKYb0Rv0GZgnMkgeF6Qu4Nhsl0FvKIboW7RNzRp5N Y4FxzFwpgdA46V/0I4YCr4INK9CGtSblmJcHfNoA+461+lDHEN9iOjlo+YcX5pwljNfZ oyzZ0a/HIP1klED0NikjkpkrAXVgYzg34FThp/pRhh4w1z1oOC3wB0HyXKkD5zVPX6n3 Ekyg== X-Gm-Message-State: AOJu0Yz1NCOs60bXJiKw9G2bOhpqizwEJRBVQzaayjOsYX/X6Luah0yy UOMM1VoU0+8DbcMVp/fz9hh4arBFlRZMdq7fOPGIhf+aawG3GzZ9A8DomPhWhsBsasS3F5iZQli nSBYRbcNDxSOPJQywOQBwaFx5GfavtA== X-Google-Smtp-Source: AGHT+IGVnY1DOBLbjjOXnBBTkNXX1ZJP4iNQAuXag84gGmYiBpoWUc9vMTFY6VOI06AnoedxXvhYYOMXSn0F4UY+Enw= X-Received: by 2002:a05:6402:520f:b0:5c8:9624:326a with SMTP id 4fb4d7f45d1cf-5c95ac15955mr5154977a12.14.1728844492448; Sun, 13 Oct 2024 11:34:52 -0700 (PDT) MIME-Version: 1.0 References: <3217758f-a9e0-4ed3-b78b-0ab2622279e0@aklaver.com> In-Reply-To: <3217758f-a9e0-4ed3-b78b-0ab2622279e0@aklaver.com> From: Priancka Chatz Date: Sun, 13 Oct 2024 20:34:41 +0200 Message-ID: Subject: Re: Unknown temp directories and library files To: Adrian Klaver Cc: pgsql-general@lists.postgresql.org Content-Type: multipart/alternative; boundary="000000000000d82eb906245ff94a" List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk --000000000000d82eb906245ff94a Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hi Adrian, There is patroni and pgqd running on the server. So possibly these are using psycopg2. Regards, Priyanka On Sun, 13 Oct 2024 at 6:01=E2=80=AFPM, Adrian Klaver wrote: > On 10/10/24 11:36, Priancka Chatz wrote: > > Hi admins, > > > > I am observing a new/unknown behavior on some of my instances. My > > postgres Data directory path is /home/postgres/pgdata/pgroot/data. And = I > > see a temp directory present inside /home/postgres/pgdata which has 100= s > > of directory underneath it and inside each directory some library files > > related to Psycopg2. Not sure what these files are and why it is gettin= g > > created. However, the only pattern I found is wherever Postgres is down > > this behavior is seen. > > They are coming from an install of psycopg2-binary: > > pip install psycopg2-binary > > ll lib/python3.12/site-packages/psycopg2_binary.libs/ > total 6944 > drwxrwxr-x 2 aklaver aklaver 4096 Oct 13 08:55 ./ > drwxrwxr-x 348 aklaver aklaver 20480 Oct 13 08:55 ../ > -rwxrwxr-x 1 aklaver aklaver 17497 Oct 13 08:55 > libcom_err-2abe824b.so.2.1* > -rwxrwxr-x 1 aklaver aklaver 3133185 Oct 13 08:55 > libcrypto-0628e7d4.so.1.1* > -rwxrwxr-x 1 aklaver aklaver 345209 Oct 13 08:55 > libgssapi_krb5-497db0c6.so.2.2* > -rwxrwxr-x 1 aklaver aklaver 219953 Oct 13 08:55 > libk5crypto-b1f99d5c.so.3.1* > -rwxrwxr-x 1 aklaver aklaver 17913 Oct 13 08:55 > libkeyutils-dfe70bd6.so.1.5* > -rwxrwxr-x 1 aklaver aklaver 1018953 Oct 13 08:55 > libkrb5-fcafa220.so.3.3* > -rwxrwxr-x 1 aklaver aklaver 76873 Oct 13 08:55 > libkrb5support-d0bcff84.so.0.1* > -rwxrwxr-x 1 aklaver aklaver 60977 Oct 13 08:55 > liblber-5a1d5ae1.so.2.0.200* > -rwxrwxr-x 1 aklaver aklaver 447329 Oct 13 08:55 > libldap-5d2ff197.so.2.0.200* > -rwxrwxr-x 1 aklaver aklaver 406817 Oct 13 08:55 > libpcre-9513aab5.so.1.2.0* > -rwxrwxr-x 1 aklaver aklaver 370777 Oct 13 08:55 libpq-e8a033dd.so.5.1= 6* > -rwxrwxr-x 1 aklaver aklaver 119217 Oct 13 08:55 > libsasl2-883649fd.so.3.0.0* > -rwxrwxr-x 1 aklaver aklaver 178337 Oct 13 08:55 > libselinux-0922c95c.so.1* > -rwxrwxr-x 1 aklaver aklaver 646065 Oct 13 08:55 libssl-3e69114b.so.1.= 1* > > > Looks like something is setting up psycopg2-binary and psycopg2 as part > of some script/tool/orm/etc in your $DATA directory. > > Are you using something that uses psycopg2 as the client library? > > > > > I am attaching screenshots for reference. > > > > Can anyone shed some light or direct me to any links to troubleshoot > this? > > > > Regards, > > Priyanka > > -- > Adrian Klaver > adrian.klaver@aklaver.com > > --000000000000d82eb906245ff94a Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hi Adrian,

There is patroni and pgqd running on the server. So possibly these are= using psycopg2.

Regards= ,
Priyanka=C2=A0


On = Sun, 13 Oct 2024 at 6:01=E2=80=AFPM, Adrian Klaver <adrian.klaver@aklaver.com> wrote:
=
On 10/10/24 11:36, Priancka Chatz wrote:
> Hi admins,
>
> I am observing a new/unknown behavior on some of my instances. My
> postgres Data directory path is /home/postgres/pgdata/pgroot/data. And= I
> see a temp directory present inside /home/postgres/pgdata which has 10= 0s
> of directory underneath it and inside each directory some library file= s
> related to Psycopg2. Not sure what these files are and why it is getti= ng
> created. However, the only pattern I found is wherever Postgres is dow= n
> this behavior is seen.

They are coming from an install of psycopg2-binary:

pip install psycopg2-binary

ll lib/python3.12/site-packages/psycopg2_binary.libs/
total 6944
drwxrwxr-x=C2=A0 =C2=A02 aklaver aklaver=C2=A0 =C2=A0 4096 Oct 13 08:55 ./<= br> drwxrwxr-x 348 aklaver aklaver=C2=A0 =C2=A020480 Oct 13 08:55 ../
-rwxrwxr-x=C2=A0 =C2=A01 aklaver aklaver=C2=A0 =C2=A017497 Oct 13 08:55 libcom_err-2abe824b.so.2.1*
-rwxrwxr-x=C2=A0 =C2=A01 aklaver aklaver 3133185 Oct 13 08:55
libcrypto-0628e7d4.so.1.1*
-rwxrwxr-x=C2=A0 =C2=A01 aklaver aklaver=C2=A0 345209 Oct 13 08:55
libgssapi_krb5-497db0c6.so.2.2*
-rwxrwxr-x=C2=A0 =C2=A01 aklaver aklaver=C2=A0 219953 Oct 13 08:55
libk5crypto-b1f99d5c.so.3.1*
-rwxrwxr-x=C2=A0 =C2=A01 aklaver aklaver=C2=A0 =C2=A017913 Oct 13 08:55 libkeyutils-dfe70bd6.so.1.5*
-rwxrwxr-x=C2=A0 =C2=A01 aklaver aklaver 1018953 Oct 13 08:55 libkrb5-fcafa= 220.so.3.3*
-rwxrwxr-x=C2=A0 =C2=A01 aklaver aklaver=C2=A0 =C2=A076873 Oct 13 08:55 libkrb5support-d0bcff84.so.0.1*
-rwxrwxr-x=C2=A0 =C2=A01 aklaver aklaver=C2=A0 =C2=A060977 Oct 13 08:55 liblber-5a1d5ae1.so.2.0.200*
-rwxrwxr-x=C2=A0 =C2=A01 aklaver aklaver=C2=A0 447329 Oct 13 08:55
libldap-5d2ff197.so.2.0.200*
-rwxrwxr-x=C2=A0 =C2=A01 aklaver aklaver=C2=A0 406817 Oct 13 08:55
libpcre-9513aab5.so.1.2.0*
-rwxrwxr-x=C2=A0 =C2=A01 aklaver aklaver=C2=A0 370777 Oct 13 08:55 libpq-e8= a033dd.so.5.16*
-rwxrwxr-x=C2=A0 =C2=A01 aklaver aklaver=C2=A0 119217 Oct 13 08:55
libsasl2-883649fd.so.3.0.0*
-rwxrwxr-x=C2=A0 =C2=A01 aklaver aklaver=C2=A0 178337 Oct 13 08:55
libselinux-0922c95c.so.1*
-rwxrwxr-x=C2=A0 =C2=A01 aklaver aklaver=C2=A0 646065 Oct 13 08:55 libssl-3= e69114b.so.1.1*


Looks like something is setting up psycopg2-binary and psycopg2 as part of some script/tool/orm/etc in your $DATA directory.

Are you using something that uses psycopg2 as the client library?

>
> I am attaching screenshots for reference.
>
> Can anyone shed some light or direct me to any links to troubleshoot t= his?
>
> Regards,
> Priyanka

--
Adrian Klaver
adrian.klave= r@aklaver.com

--000000000000d82eb906245ff94a--