pg.ddx.io pgsql-admin@postgresql.org mailing list archivehelp / color / mirror / Atom feed
Database corrupted - PSQL 9.3 Ubuntu Server 14.04 4+ messages / 3 participants [nested] [flat]
* Database corrupted - PSQL 9.3 Ubuntu Server 14.04 @ 2016-12-15 15:07 Sébastien Beausoleil <sebastien@nubilogic.com> 2016-12-15 15:31 ` Re: Database corrupted - PSQL 9.3 Ubuntu Server 14.04 Achilleas Mantzios <achill@matrix.gatewaynet.com> 2016-12-15 16:44 ` Re: Database corrupted - PSQL 9.3 Ubuntu Server 14.04 Payal Singh <payal@omniti.com> 0 siblings, 2 replies; 4+ messages in thread From: Sébastien Beausoleil @ 2016-12-15 15:07 UTC (permalink / raw) To: pgsql-admin Hi, I have a big problem with one of my Postgresql server. I started a standard package update and during the Postgresql update, something happen that it make it fails. Since when, postgresql isn't able to start. In the log, here is what it is showed: 2016-12-15 08:40:03 EST FATAL: "/var/lib/postgresql/9.3/main" is not a valid data directory 2016-12-15 08:40:03 EST DETAIL: File "/var/lib/postgresql/9.3/main/PG_VERSION" is missing. And if I go further, there is a reccuring message: 2016-12-14 22:01:14 EST FATAL: could not open relation mapping file "global/pg_filenode.map": No such file or directory 2016-12-14 22:01:15 EST ERROR: could not open file "base/305852/11848": No such file or directory 2016-12-14 22:01:15 EST CONTEXT: writing block 0 of relation base/305852/11848 2016-12-14 22:01:15 EST WARNING: could not write block 0 of base/305852/11848 2016-12-14 22:01:15 EST DETAIL: Multiple failures --- write error might be permanent. I notice, when comparing with a similare server, that 3 db data in the main/base folder are empty, I suppose it's the postgres, template0 et template1 database. I try pg_resetxlog on a copy of the data dir, the server came up but the "postgres" user isn't a valide role... I had a cron which make dump backup each day but there was un bug in the script that make it right, so I know we should not rely on recovery, but by now, It s really my only hope. Could someone help me? Sebastien OS: Ubuntu Server 14.04 64bit Postgresql: 9.3 -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin ^ permalink raw reply [nested|flat] 4+ messages in thread
* Re: Database corrupted - PSQL 9.3 Ubuntu Server 14.04 2016-12-15 15:07 Database corrupted - PSQL 9.3 Ubuntu Server 14.04 Sébastien Beausoleil <sebastien@nubilogic.com> @ 2016-12-15 15:31 ` Achilleas Mantzios <achill@matrix.gatewaynet.com> 2016-12-15 15:52 ` Re: Database corrupted - PSQL 9.3 Ubuntu Server 14.04 Achilleas Mantzios <achill@matrix.gatewaynet.com> 1 sibling, 1 reply; 4+ messages in thread From: Achilleas Mantzios @ 2016-12-15 15:31 UTC (permalink / raw) To: pgsql-admin On 15/12/2016 17:07, Sébastien Beausoleil wrote: > Hi, > I have a big problem with one of my Postgresql server. > I started a standard package update and during the Postgresql update, something happen that it make it fails. Since when, postgresql isn't able to start. > In the log, here is what it is showed: What postgresql update ? > > 2016-12-15 08:40:03 EST FATAL: "/var/lib/postgresql/9.3/main" is not a valid data directory > 2016-12-15 08:40:03 EST DETAIL: File "/var/lib/postgresql/9.3/main/PG_VERSION" is missing. > > And if I go further, there is a reccuring message: > > 2016-12-14 22:01:14 EST FATAL: could not open relation mapping file "global/pg_filenode.map": No such file or directory > 2016-12-14 22:01:15 EST ERROR: could not open file "base/305852/11848": No such file or directory > 2016-12-14 22:01:15 EST CONTEXT: writing block 0 of relation base/305852/11848 > 2016-12-14 22:01:15 EST WARNING: could not write block 0 of base/305852/11848 > 2016-12-14 22:01:15 EST DETAIL: Multiple failures --- write error might be permanent. > > > I notice, when comparing with a similare server, that 3 db data in the main/base folder are empty, I suppose it's the postgres, template0 et template1 database. That's pretty bad. Can you locate them anywhere else in your file system? > > I try pg_resetxlog on a copy of the data dir, the server came up but the "postgres" user isn't a valide role... > > I had a cron which make dump backup each day but there was un bug in the script that make it right, so I know we should not rely on recovery, but by now, It s really my only hope. Do you take any file system backup by pg_start_backup/pg_stop_backup ? or pg_basebackup? or WAL archiving? > > Could someone help me? > > Sebastien > > > OS: Ubuntu Server 14.04 64bit > Postgresql: 9.3 > > > > > -- Achilleas Mantzios IT DEV Lead IT DEPT Dynacom Tankers Mgmt -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin ^ permalink raw reply [nested|flat] 4+ messages in thread
* Re: Database corrupted - PSQL 9.3 Ubuntu Server 14.04 2016-12-15 15:07 Database corrupted - PSQL 9.3 Ubuntu Server 14.04 Sébastien Beausoleil <sebastien@nubilogic.com> 2016-12-15 15:31 ` Re: Database corrupted - PSQL 9.3 Ubuntu Server 14.04 Achilleas Mantzios <achill@matrix.gatewaynet.com> @ 2016-12-15 15:52 ` Achilleas Mantzios <achill@matrix.gatewaynet.com> 0 siblings, 0 replies; 4+ messages in thread From: Achilleas Mantzios @ 2016-12-15 15:52 UTC (permalink / raw) To: Sébastien Beausoleil <sebastien@nubilogic.com>; pgsql-admin On 15/12/2016 17:43, Sébastien Beausoleil wrote: > Thank you for answering me so fast Achilleas! > > > What postgresql update ? > > postgresql-9.3:amd64 (9.3.10-0ubuntu0.14.04, 9.3.15-0ubuntu0.14.04) I have gone through this as well (the manual way) and didn't face any problem at all. > > That's pretty bad. Can you locate them anywhere else in your file system? > > What you mean? I saw the folder but they are empty. You might try smth like : # locate PG_VERSION and see if the ubuntu upgrade tried at least to salvage some data. > > > Do you take any file system backup by pg_start_backup/pg_stop_backup ? or pg_basebackup? or WAL archiving? > > I had setup un dump backup each day in the postgres cron (I thought it worked...), but it happens that a bug in the script make it not work... > > > Le 2016-12-15 à 10:31, Achilleas Mantzios a écrit : >> On 15/12/2016 17:07, Sébastien Beausoleil wrote: >>> Hi, >>> I have a big problem with one of my Postgresql server. >>> I started a standard package update and during the Postgresql update, something happen that it make it fails. Since when, postgresql isn't able to start. >>> In the log, here is what it is showed: >> What postgresql update ? >>> >>> 2016-12-15 08:40:03 EST FATAL: "/var/lib/postgresql/9.3/main" is not a valid data directory >>> 2016-12-15 08:40:03 EST DETAIL: File "/var/lib/postgresql/9.3/main/PG_VERSION" is missing. >>> >>> And if I go further, there is a reccuring message: >>> >>> 2016-12-14 22:01:14 EST FATAL: could not open relation mapping file "global/pg_filenode.map": No such file or directory >>> 2016-12-14 22:01:15 EST ERROR: could not open file "base/305852/11848": No such file or directory >>> 2016-12-14 22:01:15 EST CONTEXT: writing block 0 of relation base/305852/11848 >>> 2016-12-14 22:01:15 EST WARNING: could not write block 0 of base/305852/11848 >>> 2016-12-14 22:01:15 EST DETAIL: Multiple failures --- write error might be permanent. >>> >>> >>> I notice, when comparing with a similare server, that 3 db data in the main/base folder are empty, I suppose it's the postgres, template0 et template1 database. >> That's pretty bad. Can you locate them anywhere else in your file system? >>> >>> I try pg_resetxlog on a copy of the data dir, the server came up but the "postgres" user isn't a valide role... >>> >>> I had a cron which make dump backup each day but there was un bug in the script that make it right, so I know we should not rely on recovery, but by now, It s really my only hope. >> Do you take any file system backup by pg_start_backup/pg_stop_backup ? or pg_basebackup? or WAL archiving? >>> >>> Could someone help me? >>> >>> Sebastien >>> >>> >>> OS: Ubuntu Server 14.04 64bit >>> Postgresql: 9.3 >>> >>> >>> >>> >>> >> >> > > -- > > si > > Sébastien Beausoleil > Téléphone (Joliette): 450.559.NUBI (6824) > Téléphone (Montréal): 514.447.4087 > 10, 7e avenue > St-Ambroise-de-Kildare (Québec) J0K 1C0 > > > -- Achilleas Mantzios IT DEV Lead IT DEPT Dynacom Tankers Mgmt ^ permalink raw reply [nested|flat] 4+ messages in thread
* Re: Database corrupted - PSQL 9.3 Ubuntu Server 14.04 2016-12-15 15:07 Database corrupted - PSQL 9.3 Ubuntu Server 14.04 Sébastien Beausoleil <sebastien@nubilogic.com> @ 2016-12-15 16:44 ` Payal Singh <payal@omniti.com> 1 sibling, 0 replies; 4+ messages in thread From: Payal Singh @ 2016-12-15 16:44 UTC (permalink / raw) To: Sébastien Beausoleil <sebastien@nubilogic.com>; +Cc: pgsql-admin > > I started a standard package update and during the Postgresql update, > something happen that it make it fails. Since when, postgresql isn't able > to start. > In the log, here is what it is showed: What was the failure/error message? Do you see anything at the time of the package upgrade in syslog? Payal Singh, Database Administrator, OmniTI Computer Consulting Inc. Phone: 240.646.0770 x 253 On Thu, Dec 15, 2016 at 10:07 AM, Sébastien Beausoleil < sebastien@nubilogic.com> wrote: > Hi, > I have a big problem with one of my Postgresql server. > I started a standard package update and during the Postgresql update, > something happen that it make it fails. Since when, postgresql isn't able > to start. > In the log, here is what it is showed: > > 2016-12-15 08:40:03 EST FATAL: "/var/lib/postgresql/9.3/main" is not a > valid data directory > 2016-12-15 08:40:03 EST DETAIL: File "/var/lib/postgresql/9.3/main/PG_VERSION" > is missing. > > And if I go further, there is a reccuring message: > > 2016-12-14 22:01:14 EST FATAL: could not open relation mapping file > "global/pg_filenode.map": No such file or directory > 2016-12-14 22:01:15 EST ERROR: could not open file "base/305852/11848": > No such file or directory > 2016-12-14 22:01:15 EST CONTEXT: writing block 0 of relation > base/305852/11848 > 2016-12-14 22:01:15 EST WARNING: could not write block 0 of > base/305852/11848 > 2016-12-14 22:01:15 EST DETAIL: Multiple failures --- write error might > be permanent. > > > I notice, when comparing with a similare server, that 3 db data in the > main/base folder are empty, I suppose it's the postgres, template0 et > template1 database. > > I try pg_resetxlog on a copy of the data dir, the server came up but the > "postgres" user isn't a valide role... > > I had a cron which make dump backup each day but there was un bug in the > script that make it right, so I know we should not rely on recovery, but by > now, It s really my only hope. > > Could someone help me? > > Sebastien > > > OS: Ubuntu Server 14.04 64bit > Postgresql: 9.3 > > > > > > -- > Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) > To make changes to your subscription: > http://www.postgresql.org/mailpref/pgsql-admin > ^ permalink raw reply [nested|flat] 4+ messages in thread
end of thread, other threads:[~2016-12-15 16:44 UTC | newest] Thread overview: 4+ messages (download: mbox mbox.gz follow: Atom feed) -- links below jump to the message on this page -- 2016-12-15 15:07 Database corrupted - PSQL 9.3 Ubuntu Server 14.04 Sébastien Beausoleil <sebastien@nubilogic.com> 2016-12-15 15:31 ` Achilleas Mantzios <achill@matrix.gatewaynet.com> 2016-12-15 15:52 ` Achilleas Mantzios <achill@matrix.gatewaynet.com> 2016-12-15 16:44 ` Payal Singh <payal@omniti.com>
This inbox is served by DDX for PostgreSQL; see mirroring instructions for how to clone and mirror all data and code used for this inbox