X-Original-To: pgsql-admin-postgresql.org@localhost.postgresql.org Received: from localhost (unknown [200.46.204.144]) by svr1.postgresql.org (Postfix) with ESMTP id 2F194528D0 for ; Fri, 17 Jun 2005 18:46:45 -0300 (ADT) Received: from svr1.postgresql.org ([200.46.204.71]) by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024) with ESMTP id 33156-05 for ; Fri, 17 Jun 2005 21:46:42 +0000 (GMT) Received: from sagstl1.scottrade.com (sagstl1.scottrade.com [12.144.145.178]) by svr1.postgresql.org (Postfix) with SMTP id 5C014528BB for ; Fri, 17 Jun 2005 18:46:41 -0300 (ADT) Received: from gfistl1.scottrade.com ([172.28.146.61]) by sagstl1.scottrade.com (SMSSMTP 4.0.0.59) with SMTP id M2005061716490310040 for ; Fri, 17 Jun 2005 16:49:03 -0500 Received: from exchstl1.scottrade.com ([172.28.140.45]) by gfistl1.scottrade.com with Microsoft SMTPSVC(5.0.2195.6713); Fri, 17 Jun 2005 17:46:42 -0400 Received: from EXCHSTL2.scottrade.com ([172.28.142.8]) by exchstl1.scottrade.com with Microsoft SMTPSVC(5.0.2195.6713); Fri, 17 Jun 2005 16:46:42 -0500 X-MimeOLE: Produced By Microsoft Exchange V6.0.6603.0 Content-class: urn:content-classes:message MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----_=_NextPart_001_01C57386.0C429FAD" Subject: Re: startup subprocess hangs Date: Fri, 17 Jun 2005 17:46:41 -0400 Message-ID: <80AD4CD06F9D904EAB15D6A1792268D50F2E04@EXCHSTL2.scottrade.com> X-MS-Has-Attach: X-MS-TNEF-Correlator: Thread-Topic: [ADMIN] startup subprocess hangs thread-index: AcVzehTxGB8PjGBbStWHShlNN/oACgAAPnBgAAAr4AAAAllywAAAMs5Q From: "Andrew Janian" To: "Anjan Dave" , X-OriginalArrivalTime: 17 Jun 2005 21:46:42.0442 (UTC) FILETIME=[0C9DFEA0:01C57386] X-Virus-Scanned: by amavisd-new at hub.org X-Spam-Status: No, hits=0.001 tagged_above=0 required=5 tests=HTML_MESSAGE X-Spam-Level: X-Archive-Number: 200506/138 X-Sequence-Number: 17893 This is a multi-part message in MIME format. ------_=_NextPart_001_01C57386.0C429FAD Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable It seems that I have made things significantly worse. I am in the process of restoring from last night's backup. Then I should be able to get the data that I missed today back in. =20 Thanks for the help, =20 Andrew =20 _____ =20 From: Anjan Dave [mailto:adave@vantage.com]=20 Sent: Friday, June 17, 2005 4:45 PM To: Andrew Janian; pgsql-admin@postgresql.org Subject: RE: [ADMIN] startup subprocess hangs =20 Without any actual messages, not sure what to say in regards to whether it is still recovering, or finished recovering successfully (from the logs). =20 There are a few ways to check if the postmaster is up. A simple check is to try a psql and see if you're up. =20 Thanks, Anjan =20 =20 =20 _____ =20 From: Andrew Janian [mailto:ajanian@scottrade.com]=20 Sent: Friday, June 17, 2005 4:37 PM To: Anjan Dave; pgsql-admin@postgresql.org Subject: RE: [ADMIN] startup subprocess hangs =20 Do you want me to stop the recovery to get the console messages? After issuing the start command I did not capture the logs because I did not notice a problem right away. Now I cannot see them anymore. =20 Is there anything I can do? =20 The database is 99GB with almost all the data in one table. =20 How long should the recovery process take? =20 Thanks, =20 Andrew =20 _____ =20 From: Anjan Dave [mailto:adave@vantage.com]=20 Sent: Friday, June 17, 2005 3:32 PM To: Andrew Janian; pgsql-admin@postgresql.org Subject: RE: [ADMIN] startup subprocess hangs =20 Probably some kind of a hardware issue (you lost a path to the array for e.g.), or someone may have issued a kill -9 to postmaster? =20 Open another terminal and check the system log (/var/log/messages) if you are not redirecting logs anywhere. =20 Can you paste the console messages on the list so people can see what exactly might be going on? =20 Thanks, Anjan =20 _____ =20 From: Andrew Janian [mailto:ajanian@scottrade.com]=20 Sent: Friday, June 17, 2005 4:21 PM To: pgsql-admin@postgresql.org Subject: [ADMIN] startup subprocess hangs =20 I am running Postgres 7.4.5 and I have recently run into a problem. My database was running fine for days and then today in the middle of the day it seems that the startup subprocess kicked in and started recovering. I am not sure from what, and I am not sure how it started, but nothing was allowed to connect and it has been running for quite some time (30 minutes). The process said it was starting to recover, but how long am I to wait? =20 Is there a way to get the status? =20 Can I just skip the recovery and get it going? =20 The environment is RH EL 3 2.4.21-4.ELsmp, with and EMC SAN for storage and QLogix cards for fibre access. =20 Thanks, =20 Andrew ------_=_NextPart_001_01C57386.0C429FAD Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

It seems that I have made things significantly worse.  I am in the process of restoring from last = night’s backup.  Then I should be able to get the data that I missed today back = in.

 

Thanks for the = help,

 

Andrew

 


From: Anjan = Dave [mailto:adave@vantage.com]
Sent: Friday, June 17, = 2005 4:45 PM
To: Andrew Janian; pgsql-admin@postgresql.org
Subject: RE: [ADMIN] = startup subprocess hangs

 

Without any actual messages, not = sure what to say in regards to whether it is still recovering, or finished = recovering successfully (from the logs).

 

There are a few ways to check if = the postmaster is up. A simple check is to try a psql <dbname> and see = if you’re up.

 

Thanks,
Anjan

 

 

 


From: = Andrew Janian [mailto:ajanian@scottrade.com]
Sent: Friday, June 17, = 2005 4:37 PM
To: Anjan Dave; pgsql-admin@postgresql.org
Subject: RE: [ADMIN] = startup subprocess hangs

 

Do you want me to stop the recovery = to get the console messages?  After issuing the start command I did not = capture the logs because I did not notice a problem right away.  Now I = cannot see them anymore.

 

Is there anything I can = do?

 

The database is 99GB with almost = all the data in one table.

 

How long should the recovery = process take?

 

Thanks,

 

Andrew

 


From: Anjan = Dave [mailto:adave@vantage.com]
Sent: Friday, June 17, = 2005 3:32 PM
To: Andrew Janian; pgsql-admin@postgresql.org
Subject: RE: [ADMIN] = startup subprocess hangs

 

Probably some kind of a hardware = issue (you lost a path to the array for e.g.), or someone may have issued a = kill -9 to postmaster?

 

Open another terminal and check the = system log (/var/log/messages) if you are not redirecting logs = anywhere.

 

Can you paste the console messages = on the list so people can see what exactly might be going on?

 

Thanks,
Anjan

 


From: = Andrew Janian [mailto:ajanian@scottrade.com]
Sent: Friday, June 17, = 2005 4:21 PM
To: = pgsql-admin@postgresql.org
Subject: [ADMIN] startup subprocess hangs

 

I am running Postgres 7.4.5 and I have recently run = into a problem.  My database was running fine for days and then today in = the middle of the day it seems that the startup subprocess kicked in and = started recovering.  I am not sure from what, and I am not sure how it = started, but nothing was allowed to connect and it has been running for quite = some time (30 minutes).  The process said it was starting to recover, but how = long am I to wait?

 

Is there a way to get the status?

 

Can I just skip the recovery and get it = going?

 

The environment is RH EL 3 2.4.21-4.ELsmp, with and = EMC SAN for storage and QLogix cards for fibre access.

 

Thanks,

 

Andrew

------_=_NextPart_001_01C57386.0C429FAD--