Received: from maia.hub.org (maia-2.hub.org [200.46.204.251]) by mail.postgresql.org (Postfix) with ESMTP id 1590E1337BD3 for ; Wed, 2 Mar 2011 20:30:02 -0400 (AST) Received: from mail.postgresql.org ([200.46.204.86]) by maia.hub.org (mx1.hub.org [200.46.204.251]) (amavisd-maia, port 10024) with ESMTP id 02300-10; Thu, 3 Mar 2011 00:29:54 +0000 (UTC) X-Greylist: from auto-whitelisted by SQLgrey-1.7.6 X-Greylist: from auto-whitelisted by SQLgrey-1.7.6 Received: from a.mail.sonic.net (a.mail.sonic.net [64.142.16.245]) by mail.postgresql.org (Postfix) with ESMTP id 3699A133616B; Wed, 2 Mar 2011 20:29:54 -0400 (AST) Received: from newshell.sonic.net (bolt.sonic.net [208.201.242.19]) by a.mail.sonic.net (8.13.8.Beta0-Sonic/8.13.7) with ESMTP id p230TqCs014089 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Wed, 2 Mar 2011 16:29:52 -0800 Received: from bolt.sonic.net (IDENT:heegd++PX8urwqX4IWlClwSSCxZVZh2g@localhost.localdomain [127.0.0.1]) by newshell.sonic.net (8.13.6/8.12.1) with ESMTP id p230Tqej031737; Wed, 2 Mar 2011 16:29:52 -0800 Received: (from daveg@localhost) by bolt.sonic.net (8.13.6/8.12.1/Submit) id p230TqI8031736; Wed, 2 Mar 2011 16:29:52 -0800 Date: Wed, 2 Mar 2011 16:29:52 -0800 From: daveg To: bricklen Cc: pgsql-admin , PostgreSQL-development Subject: Re: [HACKERS] Re: PD_ALL_VISIBLE flag was incorrectly set happend during repeatable vacuum Message-ID: <20110303002952.GQ26397@sonic.net> References: <4D2D6A56.9060808@enterprisedb.com> <20110228212832.GH26397@sonic.net> <4D6C1B16.6030708@enterprisedb.com> <20110301212043.GN26397@sonic.net> <20110302213034.GO26397@sonic.net> <1299101996-sup-4206@alvh.no-ip.org> <20110302235354.GP26397@sonic.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4.2.3i X-Virus-Scanned: Maia Mailguard 1.0.1 X-Spam-Status: No, hits=-1.91 tagged_above=-10 required=5 tests=BAYES_00=-1.9, RCVD_IN_DNSWL_NONE=-0.0001, T_RP_MATCHES_RCVD=-0.01 X-Spam-Level: X-Archive-Number: 201103/21 X-Sequence-Number: 36893 On Wed, Mar 02, 2011 at 04:20:24PM -0800, bricklen wrote: > On Wed, Mar 2, 2011 at 3:53 PM, daveg wrote: > >> > Postgresql version is 8.4.4. > >> > >> I don't see how this could be related, but since you're running on NFS, > >> maybe it is, somehow: > >> http://archives.postgresql.org/message-id/4D40DDB7.1010000@credativ.com > >> (for example what if the visibility map fork's last page is overwritten?) > > > > Running on ISCSI, not nfs. But it is still a Netapp, so who knows. I'll look. > > Also, we are not seeing any of the "unexpected data beyond EOF" errors, > > just thousands per day of the PD_ALL_VISIBLE error. > > > > -dg > > FWIW, we had a couple occurrences of that message about a month ago on 9.0.2 > > http://archives.postgresql.org/pgsql-general/2011-01/msg00887.php > > Haven't seen it since we ran a cluster-wide vacuum. We did a shutdown and restart to clear the buffer cache (but did not reboot the host) and a vacuum on all dbs in the cluster last night. That cleared it up for a couple hours, but we are still getting lots of these messages. Most of them are pg_statistic and we create and drop hundreds of thousands of temp tables daily, so there is a good chance there is a concurrancy issue. -dg -- David Gould daveg@sonic.net 510 536 1443 510 282 0869 If simplicity worked, the world would be overrun with insects.