Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.84_2) (envelope-from ) id 1bBTUA-0001VB-PH for pgsql-hackers@arkaria.postgresql.org; Fri, 10 Jun 2016 20:56:58 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.84_2) (envelope-from ) id 1bBTUA-0002hU-BI for pgsql-hackers@arkaria.postgresql.org; Fri, 10 Jun 2016 20:56:58 +0000 Received: from makus.postgresql.org ([2001:4800:1501:1::229]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1bBTSn-000872-6b for pgsql-hackers@postgresql.org; Fri, 10 Jun 2016 20:55:33 +0000 Received: from smtprelay0179.b.hostedemail.com ([64.98.42.179] helo=smtprelay.b.hostedemail.com) by makus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1bBTSk-00052f-0Q for pgsql-hackers@postgresql.org; Fri, 10 Jun 2016 20:55:31 +0000 Received: from filter.hostedemail.com (10.5.19.248.rfc1918.com [10.5.19.248]) by smtprelay06.b.hostedemail.com (Postfix) with ESMTP id 0651D8D247; Fri, 10 Jun 2016 20:55:28 +0000 (UTC) X-Session-Marker: 616C76686572726540616C76682E6E6F2D69702E6F7267 X-Spam-Summary: 50,0,0,,d41d8cd98f00b204,alvherre@alvh.no-ip.org,:::::::::::::,RULES_HIT:41:355:379:599:965:966:967:973:988:989:1260:1263:1277:1311:1312:1313:1314:1345:1359:1437:1515:1516:1518:1519:1534:1541:1593:1594:1595:1596:1711:1730:1747:1777:1792:1801:2196:2199:2393:2525:2560:2563:2682:2685:2693:2828:2859:2933:2937:2939:2942:2945:2947:2951:2954:3022:3138:3139:3140:3141:3142:3353:3865:3866:3867:3868:3870:3871:3872:3874:3934:3936:3938:3941:3944:3947:3950:3953:3956:3959:4385:4390:4395:4423:4605:4659:5007:6261:8957:9025:9121:10004:10400:10450:10455:10848:11026:11232:11256:11257:11658:11914:12043:12438:12517:12519:13069:13311:13357:13439:13894:13895:14721:14764:19904:19999:21080:30012:30054:30070:30091,0,RBL:none,CacheIP:none,Bayesian:0.5,0.5,0.5,Netcheck:none,DomainCache:0,MSF:not bulk,SPF:fn,MSBL:0,DNSBL:none,Custom_rules:0:0:0,LFtime:2,LUA_SUMMARY:none X-HE-Tag: look72_1288848e98d48 X-Filterd-Recvd-Size: 3039 Received: from alvin.alvh.no-ip.org (unknown [216.155.90.98]) (Authenticated sender: alvherre@alvh.no-ip.org) by omf12.b.hostedemail.com (Postfix) with ESMTPA; Fri, 10 Jun 2016 20:55:27 +0000 (UTC) Received: by alvin.alvh.no-ip.org (Postfix, from userid 1000) id 936814A7; Fri, 10 Jun 2016 16:55:24 -0400 (CLT) Date: Fri, 10 Jun 2016 16:55:24 -0400 From: Alvaro Herrera To: Robert Haas Cc: Andres Freund , Amit Kapila , Stephen Frost , Michael Paquier , Masahiko Sawada , "pgsql-hackers@postgresql.org" Subject: Re: Reviewing freeze map code Message-ID: <20160610205524.GA260270@alvherre.pgsql> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: User-Agent: Mutt/1.5.23 (2014-03-12) X-Pg-Spam-Score: -0.4 (/) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-hackers Precedence: bulk Sender: pgsql-hackers-owner@postgresql.org Robert Haas wrote: > 3. vacuumlazy.c includes this code: > > if (heap_prepare_freeze_tuple(tuple.t_data, FreezeLimit, > MultiXactCutoff, &frozen[nfrozen])) > frozen[nfrozen++].offset = offnum; > else if (heap_tuple_needs_eventual_freeze(tuple.t_data)) > all_frozen = false; > > That's wrong, because a "true" return value from > heap_prepare_freeze_tuple() means only that it has done *some* > freezing work on the tuple, not that it's done all of the freezing > work that will ever need to be done. So, if the tuple's xmin can be > frozen and is aborted but not older than vacuum_freeze_min_age, then > heap_prepare_freeze_tuple() won't free xmax, but the page will still > be marked all-frozen, which is bad. I think it normally won't matter > because the xmax will probably be hinted invalid anyway, since we just > pruned the page which should have set hint bits everywhere, but if > those hint bits were lost then we'd eventually end up with an > accessible xmax pointing off into space. Good catch. Also consider multixact freezing: if there is a long-running transaction which is a lock-only member of tuple's Xmax, and the multixact needs freezing because it's older than the multixact cutoff, we set the xmax to a new multixact which includes that old locker. See FreezeMultiXactId. > My first thought was to just delete the "else" but that would be bad > because we'd fail to set all-frozen immediately in a lot of cases > where we should. This needs a bit more thought than I have time to > give it right now. How about changing the return tuple of heap_prepare_freeze_tuple to a bitmap? Two flags: "Freeze [not] done" and "[No] more freezing needed" -- Álvaro Herrera http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Remote DBA, Training & Services -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers