pg.ddx.io pgsql-bugs@postgresql.org mailing list archive
help / color / mirror / Atom feedBUG #17156: pg_restore: [custom archiver] WARNING: ftell mismatch with expected position -- ftell used
5+ messages / 4 participants
[nested] [flat]
* BUG #17156: pg_restore: [custom archiver] WARNING: ftell mismatch with expected position -- ftell used
@ 2021-08-23 09:42 PG Bug reporting form <noreply@postgresql.org>
2021-08-24 05:25 ` Re: BUG #17156: pg_restore: [custom archiver] WARNING: ftell mismatch with expected position -- ftell used Masahiko Sawada <sawada.mshk@gmail.com>
0 siblings, 1 reply; 5+ messages in thread
From: PG Bug reporting form @ 2021-08-23 09:42 UTC (permalink / raw)
To: pgsql-bugs@lists.postgresql.org; +Cc: ashutosh.kumar@morningstar.com
The following bug has been logged on the website:
Bug reference: 17156
Logged by: Ashutosh Kumar
Email address: ashutosh.kumar@morningstar.com
PostgreSQL version: 10.18
Operating system: RHEL
Description:
Getting below warning when I am restoring the backup file :
Warning Message : pg_restore: [custom archiver] WARNING: ftell mismatch with
expected position -- ftell used
Backup was taken with below command :
pg_dump -h'127.0.0.1' -p 5432 -U (username) -Fc databasename >
backupfile.sql
I am restoring it with pg_restore when i got the above warning.
THanks,
Ashu
^ permalink raw reply [nested|flat] 5+ messages in thread
* Re: BUG #17156: pg_restore: [custom archiver] WARNING: ftell mismatch with expected position -- ftell used
2021-08-23 09:42 BUG #17156: pg_restore: [custom archiver] WARNING: ftell mismatch with expected position -- ftell used PG Bug reporting form <noreply@postgresql.org>
@ 2021-08-24 05:25 ` Masahiko Sawada <sawada.mshk@gmail.com>
2021-08-24 08:42 ` Re: BUG #17156: pg_restore: [custom archiver] WARNING: ftell mismatch with expected position -- ftell used Kyotaro Horiguchi <horikyota.ntt@gmail.com>
0 siblings, 1 reply; 5+ messages in thread
From: Masahiko Sawada @ 2021-08-24 05:25 UTC (permalink / raw)
To: ashutosh.kumar@morningstar.com, PostgreSQL mailing lists <pgsql-bugs@lists.postgresql.org>
On Mon, Aug 23, 2021 at 7:31 PM PG Bug reporting form
<noreply@postgresql.org> wrote:
>
> The following bug has been logged on the website:
>
> Bug reference: 17156
> Logged by: Ashutosh Kumar
> Email address: ashutosh.kumar@morningstar.com
> PostgreSQL version: 10.18
> Operating system: RHEL
> Description:
>
> Getting below warning when I am restoring the backup file :
>
> Warning Message : pg_restore: [custom archiver] WARNING: ftell mismatch with
> expected position -- ftell used
>
> Backup was taken with below command :
>
> pg_dump -h'127.0.0.1' -p 5432 -U (username) -Fc databasename >
> backupfile.sql
>
> I am restoring it with pg_restore when i got the above warning.
Could you share the exact pg_restore command with the arguments you executed?
What's is the size of the backup? Are both Postgres servers that you
took/restored the backup from/to are RHEL?
Could you try to execute pg_dump without a pipe and restore it and see
the same error happens? That is, please execute "pg_dump -h'127.0.0.1'
-p 5432 -U (username) -Fc databasename -f backupfile.sql".
Regards,
--
Masahiko Sawada
EDB: https://www.enterprisedb.com/
^ permalink raw reply [nested|flat] 5+ messages in thread
* Re: BUG #17156: pg_restore: [custom archiver] WARNING: ftell mismatch with expected position -- ftell used
2021-08-23 09:42 BUG #17156: pg_restore: [custom archiver] WARNING: ftell mismatch with expected position -- ftell used PG Bug reporting form <noreply@postgresql.org>
2021-08-24 05:25 ` Re: BUG #17156: pg_restore: [custom archiver] WARNING: ftell mismatch with expected position -- ftell used Masahiko Sawada <sawada.mshk@gmail.com>
@ 2021-08-24 08:42 ` Kyotaro Horiguchi <horikyota.ntt@gmail.com>
2021-08-24 10:01 ` RE: BUG #17156: pg_restore: [custom archiver] WARNING: ftell mismatch with expected position -- ftell used Ashutosh Kumar <Ashutosh.Kumar@morningstar.com>
2021-08-25 06:01 ` Re: BUG #17156: pg_restore: [custom archiver] WARNING: ftell mismatch with expected position -- ftell used Masahiko Sawada <sawada.mshk@gmail.com>
0 siblings, 2 replies; 5+ messages in thread
From: Kyotaro Horiguchi @ 2021-08-24 08:42 UTC (permalink / raw)
To: sawada.mshk@gmail.com; +Cc: ashutosh.kumar@morningstar.com; pgsql-bugs@lists.postgresql.org
At Tue, 24 Aug 2021 14:25:50 +0900, Masahiko Sawada <sawada.mshk@gmail.com> wrote in
> On Mon, Aug 23, 2021 at 7:31 PM PG Bug reporting form
> <noreply@postgresql.org> wrote:
> >
> > The following bug has been logged on the website:
> >
> > Bug reference: 17156
> > Logged by: Ashutosh Kumar
> > Email address: ashutosh.kumar@morningstar.com
> > PostgreSQL version: 10.18
> > Operating system: RHEL
> > Description:
> >
> > Getting below warning when I am restoring the backup file :
> >
> > Warning Message : pg_restore: [custom archiver] WARNING: ftell mismatch with
> > expected position -- ftell used
> >
> > Backup was taken with below command :
> >
> > pg_dump -h'127.0.0.1' -p 5432 -U (username) -Fc databasename >
> > backupfile.sql
> >
> > I am restoring it with pg_restore when i got the above warning.
>
> Could you share the exact pg_restore command with the arguments you executed?
>
> What's is the size of the backup? Are both Postgres servers that you
> took/restored the backup from/to are RHEL?
>
> Could you try to execute pg_dump without a pipe and restore it and see
> the same error happens? That is, please execute "pg_dump -h'127.0.0.1'
> -p 5432 -U (username) -Fc databasename -f backupfile.sql".
That error means when reading a seekable source, the file pointer
ftello returns doesn't consistent with how many bytes pg_restore has
read, or ftello returned an error. Considering that the path is very
ancient, the latter likely to happen. If the failure is reproducible,
running pg_restore with strace could show something helpful.
regards.
--
Kyotaro Horiguchi
NTT Open Source Software Center
^ permalink raw reply [nested|flat] 5+ messages in thread
* RE: BUG #17156: pg_restore: [custom archiver] WARNING: ftell mismatch with expected position -- ftell used
2021-08-23 09:42 BUG #17156: pg_restore: [custom archiver] WARNING: ftell mismatch with expected position -- ftell used PG Bug reporting form <noreply@postgresql.org>
2021-08-24 05:25 ` Re: BUG #17156: pg_restore: [custom archiver] WARNING: ftell mismatch with expected position -- ftell used Masahiko Sawada <sawada.mshk@gmail.com>
2021-08-24 08:42 ` Re: BUG #17156: pg_restore: [custom archiver] WARNING: ftell mismatch with expected position -- ftell used Kyotaro Horiguchi <horikyota.ntt@gmail.com>
@ 2021-08-24 10:01 ` Ashutosh Kumar <Ashutosh.Kumar@morningstar.com>
1 sibling, 0 replies; 5+ messages in thread
From: Ashutosh Kumar @ 2021-08-24 10:01 UTC (permalink / raw)
To: Kyotaro Horiguchi <horikyota.ntt@gmail.com>; sawada.mshk@gmail.com <sawada.mshk@gmail.com>; +Cc: pgsql-bugs@lists.postgresql.org <pgsql-bugs@lists.postgresql.org>
Restore Command :
On Prem backup(linux RHEL) to RDS PostgreSQL
Backup size around : 6.4 GB(on prem server which was restored on RDS postgres when I received the warning)
Thanks,
Ashu
-----Original Message-----
From: Kyotaro Horiguchi <horikyota.ntt@gmail.com>
Sent: Tuesday, August 24, 2021 2:12 PM
To: sawada.mshk@gmail.com
Cc: Ashutosh Kumar <Ashutosh.Kumar@morningstar.com>; pgsql-bugs@lists.postgresql.org
Subject: Re: BUG #17156: pg_restore: [custom archiver] WARNING: ftell mismatch with expected position -- ftell used
[EXTERNAL EMAIL]
At Tue, 24 Aug 2021 14:25:50 +0900, Masahiko Sawada <sawada.mshk@gmail.com<mailto:sawada.mshk@gmail.com>> wrote in
> On Mon, Aug 23, 2021 at 7:31 PM PG Bug reporting form
> <noreply@postgresql.org<mailto:noreply@postgresql.org>> wrote:
> >
> > The following bug has been logged on the website:
> >
> > Bug reference: 17156
> > Logged by: Ashutosh Kumar
> > Email address: ashutosh.kumar@morningstar.com<mailto:ashutosh.kumar@morningstar.com>
> > PostgreSQL version: 10.18
> > Operating system: RHEL
> > Description:
> >
> > Getting below warning when I am restoring the backup file :
> >
> > Warning Message : pg_restore: [custom archiver] WARNING: ftell
> > mismatch with expected position -- ftell used
> >
> > Backup was taken with below command :
> >
> > pg_dump -h'127.0.0.1' -p 5432 -U (username) -Fc databasename >
> > backupfile.sql
> >
> > I am restoring it with pg_restore when i got the above warning.
>
> Could you share the exact pg_restore command with the arguments you executed?
>
> What's is the size of the backup? Are both Postgres servers that you
> took/restored the backup from/to are RHEL?
>
> Could you try to execute pg_dump without a pipe and restore it and see
> the same error happens? That is, please execute "pg_dump -h'127.0.0.1'
> -p 5432 -U (username) -Fc databasename -f backupfile.sql".
That error means when reading a seekable source, the file pointer ftello returns doesn't consistent with how many bytes pg_restore has read, or ftello returned an error. Considering that the path is very ancient, the latter likely to happen. If the failure is reproducible, running pg_restore with strace could show something helpful.
regards.
--
Kyotaro Horiguchi
NTT Open Source Software Center
Attachments:
Picture (Device Independent Bitmap) 1.jpg (image/jpeg, 14.4K) download
view image
* Re: BUG #17156: pg_restore: [custom archiver] WARNING: ftell mismatch with expected position -- ftell used
2021-08-23 09:42 BUG #17156: pg_restore: [custom archiver] WARNING: ftell mismatch with expected position -- ftell used PG Bug reporting form <noreply@postgresql.org>
2021-08-24 05:25 ` Re: BUG #17156: pg_restore: [custom archiver] WARNING: ftell mismatch with expected position -- ftell used Masahiko Sawada <sawada.mshk@gmail.com>
2021-08-24 08:42 ` Re: BUG #17156: pg_restore: [custom archiver] WARNING: ftell mismatch with expected position -- ftell used Kyotaro Horiguchi <horikyota.ntt@gmail.com>
@ 2021-08-25 06:01 ` Masahiko Sawada <sawada.mshk@gmail.com>
1 sibling, 0 replies; 5+ messages in thread
From: Masahiko Sawada @ 2021-08-25 06:01 UTC (permalink / raw)
To: Kyotaro Horiguchi <horikyota.ntt@gmail.com>; +Cc: ashutosh.kumar@morningstar.com, PostgreSQL mailing lists <pgsql-bugs@lists.postgresql.org>
On Tue, Aug 24, 2021 at 5:42 PM Kyotaro Horiguchi
<horikyota.ntt@gmail.com> wrote:
>
> At Tue, 24 Aug 2021 14:25:50 +0900, Masahiko Sawada <sawada.mshk@gmail.com> wrote in
> > On Mon, Aug 23, 2021 at 7:31 PM PG Bug reporting form
> > <noreply@postgresql.org> wrote:
> > >
> > > The following bug has been logged on the website:
> > >
> > > Bug reference: 17156
> > > Logged by: Ashutosh Kumar
> > > Email address: ashutosh.kumar@morningstar.com
> > > PostgreSQL version: 10.18
> > > Operating system: RHEL
> > > Description:
> > >
> > > Getting below warning when I am restoring the backup file :
> > >
> > > Warning Message : pg_restore: [custom archiver] WARNING: ftell mismatch with
> > > expected position -- ftell used
> > >
> > > Backup was taken with below command :
> > >
> > > pg_dump -h'127.0.0.1' -p 5432 -U (username) -Fc databasename >
> > > backupfile.sql
> > >
> > > I am restoring it with pg_restore when i got the above warning.
> >
> > Could you share the exact pg_restore command with the arguments you executed?
> >
> > What's is the size of the backup? Are both Postgres servers that you
> > took/restored the backup from/to are RHEL?
> >
> > Could you try to execute pg_dump without a pipe and restore it and see
> > the same error happens? That is, please execute "pg_dump -h'127.0.0.1'
> > -p 5432 -U (username) -Fc databasename -f backupfile.sql".
>
> That error means when reading a seekable source, the file pointer
> ftello returns doesn't consistent with how many bytes pg_restore has
> read, or ftello returned an error. Considering that the path is very
> ancient, the latter likely to happen.
If ftello returned an error, i.g., -1, wouldn't pg_restore die instead
of emitting the warning? As Tom mentioned[1], we have fseeko() calls
in some code paths but don't correct ctx->filePos afterward. This is
also likely to cause this warning.
FIWI I'd like to note that this warning is meant to be for debugging
purposes as the comment in the source code mentioned. Since if the
input source is seekable we rely on ftello() to get the current
position in the file the restoration should be performed even if we
got this warning. Actually, we removed manual tracking of file
position by commit a8d0732ac, which backpatched to v12.
Regards,
[1] https://www.postgresql.org/message-id/3172545.1594845659%40sss.pgh.pa.us
--
Masahiko Sawada
EDB: https://www.enterprisedb.com/
^ permalink raw reply [nested|flat] 5+ messages in thread
end of thread, other threads:[~2021-08-25 06:01 UTC | newest]
Thread overview: 5+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2021-08-23 09:42 BUG #17156: pg_restore: [custom archiver] WARNING: ftell mismatch with expected position -- ftell used PG Bug reporting form <noreply@postgresql.org>
2021-08-24 05:25 ` Masahiko Sawada <sawada.mshk@gmail.com>
2021-08-24 08:42 ` Kyotaro Horiguchi <horikyota.ntt@gmail.com>
2021-08-24 10:01 ` Ashutosh Kumar <Ashutosh.Kumar@morningstar.com>
2021-08-25 06:01 ` Masahiko Sawada <sawada.mshk@gmail.com>
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox