Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1WqLjh-0006gE-SB for pgsql-bugs@arkaria.postgresql.org; Fri, 30 May 2014 12:16:38 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.80) (envelope-from ) id 1WqLjh-0008EI-6C for pgsql-bugs@arkaria.postgresql.org; Fri, 30 May 2014 12:16:37 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:DHE_RSA_AES_256_CBC_SHA256:256) (Exim 4.80) (envelope-from ) id 1WqLjg-0008EC-IK for pgsql-bugs@postgresql.org; Fri, 30 May 2014 12:16:36 +0000 Received: from mail.anarazel.de ([217.115.131.40]) by magus.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1WqLjc-0004h1-Ur for pgsql-bugs@postgresql.org; Fri, 30 May 2014 12:16:35 +0000 Received: from intern.anarazel.de (p5DDC7B35.dip0.t-ipconnect.de [93.220.123.53]) (Authenticated sender: andres@anarazel.de) by mail.anarazel.de (Postfix) with ESMTPSA id A8DDE4E8003; Fri, 30 May 2014 14:16:31 +0200 (CEST) Date: Fri, 30 May 2014 14:16:31 +0200 From: Andres Freund To: PostgreSQL Bugs , Alvaro Herrera Subject: pg_upgrade < 9.3 -> >=9.3 misses a step around multixacts Message-ID: <20140530121631.GE25431@alap3.anarazel.de> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-Pg-Spam-Score: -2.6 (--) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-bugs Precedence: bulk Sender: pgsql-bugs-owner@postgresql.org Hi, When upgrading a < 9.3 cluster pg_upgrade doesn't bother to keep the old multixacts around because they won't be read after the upgrade (and aren't compatible). It just resets the new cluster's nextMulti to the old + 1. Unfortunately that means that there'll be a offsets/0000 file created by initdb around. Sounds harmless enough, but that'll actually cause problems if the old cluster had a nextMulti that's bigger than that page. When vac_truncate_clog() calls TruncateMultiXact() that'll scan pg_multixact/offsets to find the earliest existing segment. That'll be 0000. If the to-be-truncated data is older than the last existing segment it returns. Then it'll try to determine the last required data in members/ by accessing the oldest data in offsets/. Unfortunately, due to the existing 0000/ segment, that means it'll sometimes try to access a nonexistant offsets/ file. Preventing vacuum et al from succeeding. It seems to me the fix for this is to a) rmtree("pg_multixact/members", false) in copy_clog_xlog_xid() in the oldcluster < 9.3 case b) add a warning to the release notes that everyone that used pg_upgrade and has a 0000 file lying around should report to the mailinglist. b) is a bit unsatisfactory, but I don't want to suggest removing the file. In too many situations it might actually still be needed. Greetings, Andres Freund -- Andres Freund http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Training & Services -- Sent via pgsql-bugs mailing list (pgsql-bugs@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-bugs