pg.ddx.io pgsql-admin@postgresql.org mailing list archive
help / color / mirror / Atom feedpsql: FATAL: the database system is starting up
5+ messages / 5 participants
[nested] [flat]
* psql: FATAL: the database system is starting up
@ 2006-09-21 15:45 Mr. Dan <bitsandbytes88@hotmail.com>
0 siblings, 2 replies; 5+ messages in thread
From: Mr. Dan @ 2006-09-21 15:45 UTC (permalink / raw)
To: pgsql-admin
Hi,
We had to kill postmaster, and it's been ugly. The last backup finished
successfully not last night, but the night before. This is 161 GB database.
How long should I expect this to take before it starts. Developers are
coming into my office every 5 minutes asking for updates. It's never taken
this long to come back. We did have an awful lot of transactions last
night. Is the server replaying everything
fhttp://by116fd.bay116.hotmail.msn.com/cgi-bin/compose?&curmbox=00000000%2d0000%2d0000%2d0000%2d000000000001&a=3b0ef010ec78a7ca825dcdc7953aaf4c22ff15917d66f2ef8a3ddf1fd5dbd659#
Sendrom the last succesful backup? Is it hanging because it can't find
some WAL files that were archived? It's been an hour and a half so far.
Would a reboot help?
~DjK
ep 21 10:07:05 p postgres[28301]: [2-3] recovery.
Sep 21 10:07:05 p postgres[28301]: [3-1] < % %2006-09-21 10:07:05 EDT>LOG:
checkpoint record is at 14D/69FFBD8
Sep 21 10:07:05 p postgres[28301]: [4-1] < % %2006-09-21 10:07:05 EDT>LOG:
redo record is at 14D/696AC20; undo record is at 0/0; shutdown FALSE
Sep 21 10:07:05 p postgres[28301]: [5-1] < % %2006-09-21 10:07:05 EDT>LOG:
next transaction ID: 39405490; next OID: 1799955
Sep 21 10:07:05 p postgres[28301]: [6-1] < % %2006-09-21 10:07:05 EDT>LOG:
next MultiXactId: 5696; next MultiXactOffset: 11694
Sep 21 10:07:05 p postgres[28301]: [7-1] < % %2006-09-21 10:07:05 EDT>LOG:
database system was not properly shut down; automatic recovery in progress
Sep 21 10:07:05 p postgres[28301]: [8-1] < % %2006-09-21 10:07:05 EDT>LOG:
redo starts at 14D/696AC20
Sep 21 10:07:20 p postgres[28305]: [2-1] <[unknown] %[unknown] %2006-09-21
10:07:20 EDT>LOG: invalid length of startup packet
^ permalink raw reply [nested|flat] 5+ messages in thread
* Re: psql: FATAL: the database system is starting up
@ 2006-09-21 15:51 Shoaib Mir <shoaibmir@gmail.com>
parent: Mr. Dan <bitsandbytes88@hotmail.com>
1 sibling, 0 replies; 5+ messages in thread
From: Shoaib Mir @ 2006-09-21 15:51 UTC (permalink / raw)
To: Mr. Dan <bitsandbytes88@hotmail.com>; +Cc: pgsql-admin
Try using the fast shutdown switch with pg_ctl i.e. -mf, that might help.
Thanks,
--
Shoaib Mir
EnterpriseDB (www.enterprisedb.com)
On 9/21/06, Mr. Dan <bitsandbytes88@hotmail.com> wrote:
>
> Hi,
>
> We had to kill postmaster, and it's been ugly. The last backup finished
> successfully not last night, but the night before. This is 161 GB
> database.
> How long should I expect this to take before it starts. Developers
> are
> coming into my office every 5 minutes asking for updates. It's never
> taken
> this long to come back. We did have an awful lot of transactions last
> night. Is the server replaying everything
>
> fhttp://by116fd.bay116.hotmail.msn.com/cgi-bin/compose?&curmbox=00000000%2d0000%2d0000%2d0000%2d000000000001&a=3b0ef010ec78a7ca825dcdc7953aaf4c22ff15917d66f2ef8a3ddf1fd5dbd659#
> Sendrom the last succesful backup? Is it hanging because it can't find
> some WAL files that were archived? It's been an hour and a half so far.
> Would a reboot help?
>
> ~DjK
>
>
>
>
>
> ep 21 10:07:05 p postgres[28301]: [2-3] recovery.
> Sep 21 10:07:05 p postgres[28301]: [3-1] < % %2006-09-21 10:07:05 EDT>LOG:
> checkpoint record is at 14D/69FFBD8
> Sep 21 10:07:05 p postgres[28301]: [4-1] < % %2006-09-21 10:07:05 EDT>LOG:
> redo record is at 14D/696AC20; undo record is at 0/0; shutdown FALSE
> Sep 21 10:07:05 p postgres[28301]: [5-1] < % %2006-09-21 10:07:05 EDT>LOG:
> next transaction ID: 39405490; next OID: 1799955
> Sep 21 10:07:05 p postgres[28301]: [6-1] < % %2006-09-21 10:07:05 EDT>LOG:
> next MultiXactId: 5696; next MultiXactOffset: 11694
> Sep 21 10:07:05 p postgres[28301]: [7-1] < % %2006-09-21 10:07:05 EDT>LOG:
> database system was not properly shut down; automatic recovery in progress
> Sep 21 10:07:05 p postgres[28301]: [8-1] < % %2006-09-21 10:07:05 EDT>LOG:
> redo starts at 14D/696AC20
> Sep 21 10:07:20 p postgres[28305]: [2-1] <[unknown] %[unknown] %2006-09-21
> 10:07:20 EDT>LOG: invalid length of startup packet
>
>
>
> ---------------------------(end of broadcast)---------------------------
> TIP 9: In versions below 8.0, the planner will ignore your desire to
> choose an index scan if your joining column's datatypes do not
> match
>
^ permalink raw reply [nested|flat] 5+ messages in thread
* Re: psql: FATAL: the database system is starting up
@ 2006-09-21 15:58 Tom Lane <tgl@sss.pgh.pa.us>
parent: Mr. Dan <bitsandbytes88@hotmail.com>
1 sibling, 1 reply; 5+ messages in thread
From: Tom Lane @ 2006-09-21 15:58 UTC (permalink / raw)
To: Mr. Dan <bitsandbytes88@hotmail.com>; +Cc: pgsql-admin
"Mr. Dan" <bitsandbytes88@hotmail.com> writes:
> We had to kill postmaster, and it's been ugly. The last backup finished
> successfully not last night, but the night before. This is 161 GB database.
> How long should I expect this to take before it starts.
Not longer than the time since the last checkpoint. What does
pg_controldata show? Is the recovery process actually doing any work?
regards, tom lane
^ permalink raw reply [nested|flat] 5+ messages in thread
* Re: psql: FATAL: the database system is starting up
@ 2006-09-21 17:34 theman <bitsandbytes88@hotmail.com>
parent: Tom Lane <tgl@sss.pgh.pa.us>
0 siblings, 0 replies; 5+ messages in thread
From: theman @ 2006-09-21 17:34 UTC (permalink / raw)
To: pgsql-admin
Thanks everyone, it came back up a few minutes after I sent the SOS.
-----Original Message-----
From: pgsql-admin-owner@postgresql.org
[mailto:pgsql-admin-owner@postgresql.org] On Behalf Of Tom Lane
Sent: Thursday, September 21, 2006 11:58 AM
To: Mr. Dan
Cc: pgsql-admin@postgresql.org
Subject: Re: [ADMIN] psql: FATAL: the database system is starting up
"Mr. Dan" <bitsandbytes88@hotmail.com> writes:
> We had to kill postmaster, and it's been ugly. The last backup finished
> successfully not last night, but the night before. This is 161 GB
database.
> How long should I expect this to take before it starts.
Not longer than the time since the last checkpoint. What does
pg_controldata show? Is the recovery process actually doing any work?
regards, tom lane
---------------------------(end of broadcast)---------------------------
TIP 3: Have you checked our extensive FAQ?
http://www.postgresql.org/docs/faq
^ permalink raw reply [nested|flat] 5+ messages in thread
* psql: FATAL: the database system is starting up
@ 2008-06-30 11:11 Valentin Bogdanov <valiouk@yahoo.co.uk>
0 siblings, 0 replies; 5+ messages in thread
From: Valentin Bogdanov @ 2008-06-30 11:11 UTC (permalink / raw)
To: pgsql-admin
Hi,
I run out of disk space on the box and had to delete some files and restart postgres. Ever since I have been getting the above message. PS shows this process:
9351 ? D 0:04 postgres: startup process
Running an strace on this process shows that it is trying to write 8K of zeros to a file called 023D in pg_clog but fails at 224K and it just keeps trying forever.
I tried replacing the file with one I created - 256K as the other files in the pg_clog and filled with zeros. But it keeps doing the same thing :
open("pg_clog/023D", O_RDWR|O_CREAT|O_LARGEFILE, 0600) = 10
_llseek(10, 221184, [221184], SEEK_SET) = 0
write(10, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 8192) = 8192
fsync(10) = 0
close(10)
Any ideas on what might be causing this and what I can do to fix it will be greatly appreciated. Need to get it fixed fast.
Many Thanks
valiouk
__________________________________________________________
Not happy with your email address?.
Get the one you really want - millions of new email addresses available now at Yahoo! http://uk.docs.yahoo.com/ymail/new.html
^ permalink raw reply [nested|flat] 5+ messages in thread
end of thread, other threads:[~2008-06-30 11:11 UTC | newest]
Thread overview: 5+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2006-09-21 15:45 psql: FATAL: the database system is starting up Mr. Dan <bitsandbytes88@hotmail.com>
2006-09-21 15:51 ` Re: psql: FATAL: the database system is starting up Shoaib Mir <shoaibmir@gmail.com>
2006-09-21 15:58 ` Re: psql: FATAL: the database system is starting up Tom Lane <tgl@sss.pgh.pa.us>
2006-09-21 17:34 ` Re: psql: FATAL: the database system is starting up theman <bitsandbytes88@hotmail.com>
2008-06-30 11:11 psql: FATAL: the database system is starting up Valentin Bogdanov <valiouk@yahoo.co.uk>
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox