X-Original-To: pgsql-admin-postgresql.org@localhost.postgresql.org Received: from localhost (av.hub.org [200.46.204.144]) by svr1.postgresql.org (Postfix) with ESMTP id E4AD5D710D for ; Thu, 8 Sep 2005 11:46:41 -0300 (ADT) Received: from svr1.postgresql.org ([200.46.204.71]) by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024) with ESMTP id 12085-09 for ; Thu, 8 Sep 2005 14:46:35 +0000 (GMT) Received: from sss.pgh.pa.us (sss.pgh.pa.us [66.207.139.130]) by svr1.postgresql.org (Postfix) with ESMTP id 9736BD8728 for ; Thu, 8 Sep 2005 11:46:36 -0300 (ADT) Received: from sss2.sss.pgh.pa.us (tgl@localhost [127.0.0.1]) by sss.pgh.pa.us (8.13.1/8.13.1) with ESMTP id j88Ekaeb006690; Thu, 8 Sep 2005 10:46:36 -0400 (EDT) To: Adam Witney Cc: Alvaro Herrera , pgsql-admin , Michael Fuhr Subject: Re: pg_dump error... Follow up In-reply-to: References: Comments: In-reply-to Adam Witney message dated "Thu, 08 Sep 2005 15:22:31 +0100" Date: Thu, 08 Sep 2005 10:46:36 -0400 Message-ID: <6689.1126190796@sss.pgh.pa.us> From: Tom Lane X-Virus-Scanned: by amavisd-new at hub.org X-Spam-Status: No, hits=0.006 required=5 tests=[AWL=0.006] X-Spam-Level: X-Archive-Number: 200509/80 X-Sequence-Number: 18817 Adam Witney writes: > Here you go.... > pg_filedump-3.0/pg_filedump -i -f -R 34318 34320 134401986.1 Thanks. What it looks like to me is that block 34320 (really 165392) is data from some other file altogether. It's evidently still Postgres heap data, but instead of having 3 non-null columns as any toast row ought to have, these rows have 77 columns many of which are nulls. They've got OIDs, too. Possibly you can work out which table these rows really belong to. It looks like this ought to be block 415664 of whatever table it belongs to (which would make it block 22448 of the xxx.3 file of that table, if I did the math right). So the diagnosis is that somebody wrote a data block to the wrong offset in the wrong file. Whether this is the fault of Postgres, the kernel, or the disk drive is difficult to say. We've seen a number of cases in which table pages got overwritten with data that was obviously of non-Postgres origin, and in those cases we could blame the kernel or disk drive with a clear conscience. In this case, since the bogus data is Postgres data, it could be that it's a bug lurking within Postgres itself --- or it could be that it's like those past cases. It might be worth your while to run some memory and disk drive tests. There's no particular reason to suspect a hardware fault more than a software one, but this is at least something simple to do. Check for availability of kernel updates, too. regards, tom lane