Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1VqEt5-0006I6-2h for pgsql-bugs@arkaria.postgresql.org; Tue, 10 Dec 2013 04:25:35 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.80) (envelope-from ) id 1VqEt4-0003bA-Ff for pgsql-bugs@arkaria.postgresql.org; Tue, 10 Dec 2013 04:25:34 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1VqEt3-0003b3-BX for pgsql-bugs@postgresql.org; Tue, 10 Dec 2013 04:25:33 +0000 Received: from smtprelay0130.b.hostedemail.com ([64.98.42.130] helo=smtprelay.b.hostedemail.com) by magus.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1VqEsv-0001Ge-3x for pgsql-bugs@postgresql.org; Tue, 10 Dec 2013 04:25:32 +0000 Received: from filter.hostedemail.com (b-bigip1 [10.5.19.254]) by smtprelay05.b.hostedemail.com (Postfix) with ESMTP id 4612632AF6D; Tue, 10 Dec 2013 04:25:23 +0000 (UTC) X-Session-Marker: 616C76686572726540616C76682E6E6F2D69702E6F7267 X-Spam-Summary: 13, 1.2, 0, , d41d8cd98f00b204, alvherre@alvh.no-ip.org, :::::, RULES_HIT:41:355:379:421:599:966:967:973:988:989:1260:1277:1311:1312:1313:1314:1345:1359:1437:1515:1516:1518:1519:1534:1542:1593:1594:1595:1596:1711:1730:1747:1777:1792:2196:2199:2393:2525:2560:2563:2682:2685:2693:2828:2859:2933:2937:2939:2942:2945:2947:2951:2954:3022:3138:3139:3140:3141:3142:3354:3865:3866:3867:3868:3870:3871:3872:3873:3874:3934:3936:3938:3941:3944:3947:3950:3953:3956:3959:4321:4385:4605:4659:5007:6119:6261:7875:8957:9025:9121:10008:10400:10848:10967:11026:11232:11256:11257:11658:11914:12296:12438:12517:12519:12555:12663:12740:13161:13229:13255:13894:13895, 0, RBL:none, CacheIP:none, Bayesian:0.5, 0.5, 0.5, Netcheck:none, DomainCache:0, MSF:not bulk, SPF:fn, MSBL:0, DNSBL:none, Custom_rules:0:1:0 X-HE-Tag: dust33_4c11a58dd0e55 X-Filterd-Recvd-Size: 3456 Received: from eldon.alvh.no-ip.org (pc-223-216-160-190.cm.vtr.net [190.160.216.223]) (Authenticated sender: alvherre@alvh.no-ip.org) by omf12.b.hostedemail.com (Postfix) with ESMTPA; Tue, 10 Dec 2013 04:25:22 +0000 (UTC) Received: by eldon.alvh.no-ip.org (Postfix, from userid 1000) id D86481FC8; Tue, 10 Dec 2013 01:25:20 -0300 (CLST) Date: Tue, 10 Dec 2013 01:25:20 -0300 From: Alvaro Herrera To: Andres Freund Cc: Serge Negodyuck , pgsql-bugs@postgresql.org Subject: Re: BUG #8673: Could not open file "pg_multixact/members/xxxx" on slave during hot_standby Message-ID: <20131210042520.GN6777@eldon.alvh.no-ip.org> References: <20131209142525.GA1123@awork2.anarazel.de> <20131209150345.GB1123@awork2.anarazel.de> <20131209182701.GD9519@awork2.anarazel.de> <20131209190031.GK6777@eldon.alvh.no-ip.org> <20131210010054.GE27840@awork2.anarazel.de> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <20131210010054.GE27840@awork2.anarazel.de> User-Agent: Mutt/1.5.21 (2010-09-15) X-Pg-Spam-Score: -1.9 (-) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-bugs Precedence: bulk Sender: pgsql-bugs-owner@postgresql.org Andres Freund wrote: > On 2013-12-09 16:00:32 -0300, Alvaro Herrera wrote: > > As a note, the SlruScanDirectory code has a flaw because it only looks > > at four-digit files; the reason only files up to 0xFFFF are missing and > > not the following ones is because those got ignored. This needs a fix > > as well. > > While I agree it's a bug, I don't think it's relevant for the case at > hand. For offset's there's no following page (or exactly 1, not sure > about the math offhand), and we only use SlruScanDirectory() for > offsets not for members. Sure we do for members, through SimpleLruTruncate which calls SlruScanDirectory underneath. > > > I've recently remarked that I find it dangerous that we only do > > > anti-wraparound stuff for pg_multixact/offsets, not for /members. So, > > > here we have the proof that that's bad. > > > > It's hard to see how to add this post-facto, though. I mean, I am > > thinking we would need some additional pg_control info etc. We'd better > > figure out a way to add such controls without having to add that. > > Couldn't we just get the oldest multi, check where in offsets it points > to, and compare that with nextOffset? That should be doable without > additional data. Hmm, that seems a sensible approach ... > > > I think problems should be preventable if you issue a systemwide VACUUM > > > FREEZE, but please let others chime in before you execute it. > > > > I wouldn't freeze anything just yet, at least until the patch to fix > > multixact freezing is in. > > Well, it seems better than getting errors because of multixact members > that are gone. > Maybe PGOPTIONS='-c vacuum_freez_table_age=0 -c vacuum_freeze_min_age=1000000 vacuumdb -a' > - that ought not to cause problems with current data and should freeze > enough to get rid of problematic multis? TBH I don't feel comfortable with predicting what will it freeze with the broken code. -- Álvaro Herrera http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Training & Services -- Sent via pgsql-bugs mailing list (pgsql-bugs@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-bugs