Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1VS8dJ-0007MG-Na for pgsql-admin@arkaria.postgresql.org; Fri, 04 Oct 2013 16:53:41 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.80) (envelope-from ) id 1VS8dJ-0006Jd-7t for pgsql-admin@arkaria.postgresql.org; Fri, 04 Oct 2013 16:53:41 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1VS8dI-0006JW-4O for pgsql-admin@postgresql.org; Fri, 04 Oct 2013 16:53:40 +0000 Received: from mail.pasteleros.org.ar ([200.49.144.54]) by magus.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1VS8dD-0002zd-2J for pgsql-admin@postgresql.org; Fri, 04 Oct 2013 16:53:39 +0000 Received: from mail.pasteleros.org.ar (unknown [127.0.0.1]) by mail.pasteleros.org.ar (Postfix) with ESMTP id BF005229A7 for ; Fri, 4 Oct 2013 13:53:10 -0300 (ART) X-Virus-Scanned: amavisd-new at pasteleros.org.ar Received: from mail.pasteleros.org.ar ([127.0.0.1]) by mail.pasteleros.org.ar (mail.pasteleros.org.ar [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id K7QRt-7TTpsy for ; Fri, 4 Oct 2013 13:53:04 -0300 (ART) Received: from [192.169.100.54] (unknown [192.169.100.54]) by mail.pasteleros.org.ar (Postfix) with ESMTP id 677E72297A for ; Fri, 4 Oct 2013 13:53:04 -0300 (ART) Message-ID: <524EF280.5040502@pasteleros.org.ar> Date: Fri, 04 Oct 2013 13:53:20 -0300 From: Alejandro Brust Reply-To: alejandrob@pasteleros.org.ar User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:17.0) Gecko/20130503 Thunderbird/17.0.5 MIME-Version: 1.0 To: pgsql-admin@postgresql.org Subject: Re: ERROR: could not open file "base/125542/12631" Corruption? References: In-Reply-To: Content-Type: multipart/alternative; boundary="------------070306080302000300010207" X-Pg-Spam-Score: -2.6 (--) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-admin Precedence: bulk Sender: pgsql-admin-owner@postgresql.org This is a multi-part message in MIME format. --------------070306080302000300010207 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8bit El 04/10/2013 11:40, Mike Broers escribió: > Hello, our postgresql 9.2.4 qa database (thankfully its just qa) seems > to be hosed. > > Starting at around 3:39am last night I started seeing errors about > missing files and now I cannot run a pgdump or a vacuum without it > complaining about files that it cannot find with errors like this: > ERROR: could not open file "base/125542/12631". When I check the > filesystem the files are indeed not there. The 1am regular vacuum > completed and its log is clean. The postgres log is clean before > these errors occurred. > > Since this is qa we do not perform backups, and the solution if we > cannot repair the problem will be to create a fresh qa server but I am > intrigued about how to determine the source of the problem and the > extent of the problem. > > Is there a way to force vacuum to continue on errors or an alternate > way to help determine all the missing files? > > It might be totally unrelated, but yesterday morning on this qa server > I stopped postgres, and created a symlink to pg_xlog so that it was > writing to a different volume, and restarted. This was working fine > all day so its possibly a red herring but I thought I should mention it. > > Any advice is appreciated, thanks! > > /Hello U could try some like "SET/ zero_damaged_pages = on" and perform a vacuum-db and may be pg_dump hope it help! --------------070306080302000300010207 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit
El 04/10/2013 11:40, Mike Broers escribió:
Hello, our postgresql 9.2.4 qa database (thankfully its just qa) seems to be hosed.  

Starting at around 3:39am last night I started seeing errors about missing files and now I cannot run a pgdump or a vacuum without it complaining about files that it cannot find with errors like this: ERROR: could not open file "base/125542/12631". When I check the filesystem the files are indeed not there.  The 1am regular vacuum completed and its log is clean.  The postgres log is clean before these errors occurred.

Since this is qa we do not perform backups, and the solution if we cannot repair the problem will be to create a fresh qa server but I am intrigued about how to determine the source of the problem and the extent of the problem.  

Is there a way to force vacuum to continue on errors or an alternate way to help determine all the missing files?  

It might be totally unrelated, but yesterday morning on this qa server I stopped postgres, and created a symlink to pg_xlog so that it was writing to a different volume, and restarted.  This was working fine all day so its possibly a red herring but I thought I should mention it.

Any advice is appreciated, thanks!  


Hello

U could try  some like "SET
zero_damaged_pages = on"    and perform a vacuum-db and may be pg_dump
hope it help!
--------------070306080302000300010207--