X-Original-To: pgsql-admin-postgresql.org@localhost.postgresql.org Received: from localhost (unknown [200.46.204.144]) by svr1.postgresql.org (Postfix) with ESMTP id 051C45639E for ; Mon, 14 Mar 2005 07:52:09 +0000 (GMT) Received: from svr1.postgresql.org ([200.46.204.71]) by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024) with ESMTP id 14420-07 for ; Mon, 14 Mar 2005 07:52:05 +0000 (GMT) Received: from vms040pub.verizon.net (vms040pub.verizon.net [206.46.252.40]) by svr1.postgresql.org (Postfix) with ESMTP id AD6325612C for ; Mon, 14 Mar 2005 07:52:05 +0000 (GMT) Received: from RavChaim.rishonim.com ([151.202.103.251]) by vms040.mailsrvcs.net (Sun Java System Messaging Server 6.2 HotFix 0.04 (built Dec 24 2004)) with ESMTPA id <0IDC00E9V0ITAMW1@vms040.mailsrvcs.net> for pgsql-admin@postgresql.org; Mon, 14 Mar 2005 01:52:06 -0600 (CST) Date: Mon, 14 Mar 2005 02:53:51 -0500 From: Mitchell Laks Subject: Re: Severe Badness On My Server: psql: FATAL: the database To: "Pgsql-Admin (E-mail)" Message-id: <200503140253.51653.mlaks@verizon.net> MIME-version: 1.0 Content-type: text/plain; charset=us-ascii Content-transfer-encoding: 7bit Content-disposition: inline User-Agent: KMail/1.7.2 X-Virus-Scanned: by amavisd-new at hub.org X-Spam-Status: No, hits=1.35 tagged_above=0 required=5 tests=AWL, DNS_FROM_RFC_ABUSE, DNS_FROM_RFC_POST, FORGED_RCVD_HELO X-Spam-Level: * X-Archive-Number: 200503/205 X-Sequence-Number: 16703 Thank you Tom and Frank! As usual you gurus were 100% on target. I had a raid1 failure on my data drive which caused the /var partition on my system drive to fill with kernel messages in /var/log/messages from the failing /dev/hdg1 drive. Therefore, when I logged in remotely and tried to work with the system, I first made room in /var by deleting stuff from /var/log/messages. But I didnt want to power down the machine cause it is in a different borough here in NYC :). I wanted to reboot remotely, which I could not do cause /var filling must of messed up other processes which refused to allow me to reboot via software. So finally I pushed the button. I drove over and rebooted and removed /dev/md0 from the /etc/fstab and booted into linux, pg_dumped the database and moved it to another server and all is fine. I suspect I should move /var/lib/postgresql to its own partition to separate out the point of failure of the hard drives from postgresql. What do you think? Thanks again both of you!, Mitchell Laks