pg.ddx.io  pgsql-general@postgresql.org mailing list archive  
help / color / mirror / Atom feed
could not open file "base/XX/XX": Interrupted system call
7+ messages / 4 participants
[nested] [flat]

* could not open file "base/XX/XX": Interrupted system call
@ 2023-09-20 08:49  Torsten Krah <krah.tm@gmail.com>
  0 siblings, 1 reply; 7+ messages in thread

From: Torsten Krah @ 2023-09-20 08:49 UTC (permalink / raw)
  To: pgsql-general@lists.postgresql.org

Hi,

I am running the postgres docker image with that version:

2023-09-20 10:36:32.478 CEST [1] LOG:  starting PostgreSQL 13.12 (Debian 13.12-1.pgdg120+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 12.2.0-14) 12.2.0, 64-bit
2023-09-20 10:36:32.564 CEST [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
2023-09-20 10:36:32.564 CEST [1] LOG:  listening on IPv6 address "::", port 5432

And this is happening for some queries:

2023-09-20 10:38:25.076 CEST [47] ERROR:  could not open file "base/16386/17328": Interrupted system call
2023-09-20 10:38:41.897 CEST [49] ERROR:  could not open file "base/16386/68359": Interrupted system call

I can enter the container and view the files above with e.g. strings
$file | less and I can create a md5sum from that file without an error.

What can I do about that EINTR on open, how to fix it?

The host (6.1.53-060153-generic #202309130436 SMP PREEMPT_DYNAMIC) and
the docker daemon (Version: 24.0.6) do have nothing suspicious in there
dmesg / logs.

Anyone an idea how to debug / progress with that one?

Torsten






^ permalink  raw  reply  [nested|flat] 7+ messages in thread

* Re: could not open file "base/XX/XX": Interrupted system call
@ 2023-09-20 11:11  Laurenz Albe <laurenz.albe@cybertec.at>
  parent: Torsten Krah <krah.tm@gmail.com>
  0 siblings, 1 reply; 7+ messages in thread

From: Laurenz Albe @ 2023-09-20 11:11 UTC (permalink / raw)
  To: krah.tm@gmail.com; pgsql-general@lists.postgresql.org

On Wed, 2023-09-20 at 10:49 +0200, Torsten Krah wrote:
> I am running the postgres docker image with that version:
> 
> 2023-09-20 10:36:32.478 CEST [1] LOG:  starting PostgreSQL 13.12 (Debian 13.12-1.pgdg120+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 12.2.0-14) 12.2.0, 64-bit
> 2023-09-20 10:36:32.564 CEST [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
> 2023-09-20 10:36:32.564 CEST [1] LOG:  listening on IPv6 address "::", port 5432
> 
> And this is happening for some queries:
> 
> 2023-09-20 10:38:25.076 CEST [47] ERROR:  could not open file "base/16386/17328": Interrupted system call
> 2023-09-20 10:38:41.897 CEST [49] ERROR:  could not open file "base/16386/68359": Interrupted system call

Is that an NFS mount?  What are the mount options?

Yours,
Laurenz Albe





^ permalink  raw  reply  [nested|flat] 7+ messages in thread

* Re: could not open file "base/XX/XX": Interrupted system call
@ 2023-09-20 11:24  Torsten Krah <krah.tm@gmail.com>
  parent: Laurenz Albe <laurenz.albe@cybertec.at>
  0 siblings, 1 reply; 7+ messages in thread

From: Torsten Krah @ 2023-09-20 11:24 UTC (permalink / raw)
  To: pgsql-general@lists.postgresql.org

Am Mittwoch, dem 20.09.2023 um 13:11 +0200 schrieb Laurenz Albe:
> Is that an NFS mount?  What are the mount options?
> 
> Yours,
> Laurenz Albe

No mount at all.

Just the docker container filesystem using the overlay2 storage driver,
there is nothing externally mounted in that container, the data is
already in the image (via docker COPY) from which the container gets
created (and that data directory was created in the image build process
via pg_restore from the dump file).

The whole container / image just involves overlay2 fs which itself is
sitting on ext4.

Torsten






^ permalink  raw  reply  [nested|flat] 7+ messages in thread

* Re: could not open file "base/XX/XX": Interrupted system call
@ 2024-12-26 11:48  Slava Shpitalny <slava.shpitalny@tactilemobility.com>
  parent: Torsten Krah <krah.tm@gmail.com>
  0 siblings, 2 replies; 7+ messages in thread

From: Slava Shpitalny @ 2024-12-26 11:48 UTC (permalink / raw)
  To: krah.tm@gmail.com; +Cc: pgsql-general@lists.postgresql.org

Hi,
We are facing a similar problem using a docker from
https://hub.docker.com/_/postgres on AWS EC2 machine.
The version we are using is 17 (docker image "postgres:17")
The issue happens on our CI server, and it happens consistently.
The table is a big one (related to
https://www.postgresql.org/message-id/16832-943d33fd58eb26e4%40postgresql.org
)

Do you happen to have any updates on this issue?

*Slava Shpitalny*

Software Development Team Lead

Tactile Mobility

E-mail: slava.shpitalny@tactilemobility.com




On Thu, Dec 26, 2024 at 1:43 PM Torsten Krah <krah.tm@gmail.com> wrote:

> Am Mittwoch, dem 20.09.2023 um 13:11 +0200 schrieb Laurenz Albe:
> > Is that an NFS mount?  What are the mount options?
> >
> > Yours,
> > Laurenz Albe
>
> No mount at all.
>
> Just the docker container filesystem using the overlay2 storage driver,
> there is nothing externally mounted in that container, the data is
> already in the image (via docker COPY) from which the container gets
> created (and that data directory was created in the image build process
> via pg_restore from the dump file).
>
> The whole container / image just involves overlay2 fs which itself is
> sitting on ext4.
>
> Torsten
>
>
>
>
>
>

^ permalink  raw  reply  [nested|flat] 7+ messages in thread

* Re: could not open file "base/XX/XX": Interrupted system call
@ 2025-01-13 09:34  Torsten Krah <krah.tm@gmail.com>
  parent: Slava Shpitalny <slava.shpitalny@tactilemobility.com>
  1 sibling, 0 replies; 7+ messages in thread

From: Torsten Krah @ 2025-01-13 09:34 UTC (permalink / raw)
  To: Slava Shpitalny <slava.shpitalny@tactilemobility.com>; +Cc: pgsql-general@lists.postgresql.org

Am Donnerstag, dem 26.12.2024 um 13:48 +0200 schrieb Slava Shpitalny:
> Do you happen to have any updates on this issue?

Hi,

unfortunately not, the only thing I found is this in "man 2 open":

...

EINTR  While blocked waiting to complete an open of a slow device
(e.g., a FIFO; see fifo(7)), the call was interrupted by a signal
handler; see signal(7).
...


To me this reads that postgres should handle that error code (e.g. try
again n times before failing) - but maybe it does that already, I did
not verify all open calls, if or how postgres does handle EINTR.

The only thing I did change is, that I use a volume (an anonymous one
in my usecase) again, because with that, I never encountered that error
- if I omit that volume and write directly to the containers fs (which
would be sufficient for me), I still had that error.

kind regards

Torsten






^ permalink  raw  reply  [nested|flat] 7+ messages in thread

* Re: could not open file "base/XX/XX": Interrupted system call
@ 2025-01-20 14:24  Andreas Froede <psql@andreas.spider-net.de>
  parent: Slava Shpitalny <slava.shpitalny@tactilemobility.com>
  1 sibling, 1 reply; 7+ messages in thread

From: Andreas Froede @ 2025-01-20 14:24 UTC (permalink / raw)
  To: pgsql-general@lists.postgresql.org

Am 26.12.24 um 12:48 schrieb Slava Shpitalny:

> We are facing a similar problem using a docker from https:// 
> hub.docker.com/_/postgres <https://hub.docker.com/_/postgres; on AWS EC2 
> machine.

In this case it's a docker issue.
By default docker limit the size of shared memory (i think 64M).
You can change this in your dockerfile.

CIAO
andreas





^ permalink  raw  reply  [nested|flat] 7+ messages in thread

* Re: could not open file "base/XX/XX": Interrupted system call
@ 2025-01-20 14:30  Andreas Froede <psql@andreas.spider-net.de>
  parent: Andreas Froede <psql@andreas.spider-net.de>
  0 siblings, 0 replies; 7+ messages in thread

From: Andreas Froede @ 2025-01-20 14:30 UTC (permalink / raw)
  To: pgsql-general@lists.postgresql.org

Am 20.01.25 um 15:24 schrieb Andreas Froede:
> Am 26.12.24 um 12:48 schrieb Slava Shpitalny:
> 
>> We are facing a similar problem using a docker from https:// 
>> hub.docker.com/_/postgres <https://hub.docker.com/_/postgres; on AWS 
>> EC2 machine.
> 
> In this case it's a docker issue.
> By default docker limit the size of shared memory (i think 64M).
> You can change this in your dockerfile.

Sorry. Wrong discussion.
Please forgot it.


CIAO
andreas





^ permalink  raw  reply  [nested|flat] 7+ messages in thread


end of thread, other threads:[~2025-01-20 14:30 UTC | newest]

Thread overview: 7+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2023-09-20 08:49 could not open file "base/XX/XX": Interrupted system call Torsten Krah <krah.tm@gmail.com>
2023-09-20 11:11 ` Laurenz Albe <laurenz.albe@cybertec.at>
2023-09-20 11:24   ` Torsten Krah <krah.tm@gmail.com>
2024-12-26 11:48     ` Slava Shpitalny <slava.shpitalny@tactilemobility.com>
2025-01-13 09:34       ` Torsten Krah <krah.tm@gmail.com>
2025-01-20 14:24       ` Andreas Froede <psql@andreas.spider-net.de>
2025-01-20 14:30         ` Andreas Froede <psql@andreas.spider-net.de>

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox