Received: from malur.postgresql.org ([2a02:16a8:dc51::56]) by arkaria.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.89) (envelope-from ) id 1fpXp8-0004NI-Df for pgsql-hackers@arkaria.postgresql.org; Tue, 14 Aug 2018 11:49:18 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.89) (envelope-from ) id 1fpXp5-0006TD-WA for pgsql-hackers@arkaria.postgresql.org; Tue, 14 Aug 2018 11:49:15 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.89) (envelope-from ) id 1fpXp5-0006St-Nt for pgsql-hackers@lists.postgresql.org; Tue, 14 Aug 2018 11:49:15 +0000 Received: from mail-wm0-x22d.google.com ([2a00:1450:400c:c09::22d]) by magus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.89) (envelope-from ) id 1fpXoz-0002v5-2W for pgsql-hackers@postgresql.org; Tue, 14 Aug 2018 11:49:15 +0000 Received: by mail-wm0-x22d.google.com with SMTP id t25-v6so11888450wmi.3 for ; Tue, 14 Aug 2018 04:49:08 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=2ndquadrant-com.20150623.gappssmtp.com; s=20150623; h=subject:to:cc:references:from:message-id:date:user-agent :mime-version:in-reply-to:content-language:content-transfer-encoding; bh=JbRQ8PgRrFtrXTKUwcd5pNxBMbHuZ2MKhD2J3r3sk/8=; b=R9CpzGiFO8IlitT1jY/kRRkcJQib0rVGl+Fc1Gfrb2QwdI1wzD7Y7CF5nfulP4CLrH cfs2AQ/KlCcNCIht5nkTHLiqZEuFjTMydEzu3r6znjbFTTdU63h+SzhYYIBR2Db3hy0Y mNUlCatG5IEtQS7q4BsU6R4WXX7rnptHAxC8402kVoBmlcnKoV4cVo/x/MAwi1kC4zLn g2B0T9+SZuSW6uZT9Tr/lnzfqWMB/9IOqMmHX1x61uF8izmzGbyJ0VXYKldqbO3EEbcG J+G2byDBcE8R8VDgCjfKF/TUSiz12NlQO5MrSqfNvRF1OmwAcMjsZivdj0FSvo7RR4iw zUPA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=JbRQ8PgRrFtrXTKUwcd5pNxBMbHuZ2MKhD2J3r3sk/8=; b=LWXGAxSBlZQG8r160s+ArgoPNJ7//sx2RdaetHYNZWv/SgVoZXdAoKn27aPX7uhiEd ne05MHIcyPKJmO7Ct6U5F8PhIN7aTzJDW5eKNogAklpqQZraT0gbQ7YvtPNUECokctH4 9mfhrbBUxzTSmRD9laM4GJ27+lRMHFDIlAD6n8ycOLyRMRKtC1nxtJNkQZTpGvbepwqd z2xfI5vczvDfEsEiJOJzfhEuAP+v5w3QoEmZ1PlZ4UZId/u/Hn61E7o1uZQbVit5jkno GvJH13jw/XUfUOQ49QK29LfWzzEihN06OZ9tuv5+HEHUTTIcJuNMyBGJIijLUymXRnkn AG5A== X-Gm-Message-State: AOUpUlFOZPlOafmcPeUQa0vsRZq4dWbAVonckohYUqzoeDjjpynjekpS qzyvnbKIVHuCoZPgHu5gocFSin99ikt7OnlS6bZAt6HOO43LUBpS+1uu8tmmQlaIEk3MC5rJS8+ tKOXIuRyZl6C0T17lqmC8OoMIhqG3S9t7TeXh2FQ33UpvzjuvtEIiUVVhM6+aoHbvVGK9Voy1Pm IUOW7DNKeBHfg= X-Google-Smtp-Source: AA+uWPyLwEHAF2K5UJUGm/3/YznO8eZfA29d2SVVrZegknomWibo2vWZ5DaGbaCE9cL/hXNr2IEl8w== X-Received: by 2002:a1c:5e08:: with SMTP id s8-v6mr2152053wmb.88.1534247347629; Tue, 14 Aug 2018 04:49:07 -0700 (PDT) Received: from [10.137.2.21] (static-84-42-175-93.net.upcbroadband.cz. [84.42.175.93]) by smtp.gmail.com with ESMTPSA id q3-v6sm8137751wmf.21.2018.08.14.04.49.06 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 14 Aug 2018 04:49:06 -0700 (PDT) Subject: Re: logical decoding / rewrite map vs. maxAllocatedDescs To: Andres Freund , Alvaro Herrera Cc: PostgreSQL-development References: <20180813144630.hmzdrbviwao64ube@alvherre.pgsql> <20180813144946.fn4zpdwpucx43emz@alap3.anarazel.de> From: Tomas Vondra Message-ID: Date: Tue, 14 Aug 2018 13:49:03 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.5.2 MIME-Version: 1.0 In-Reply-To: <20180813144946.fn4zpdwpucx43emz@alap3.anarazel.de> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Precedence: bulk On 08/13/2018 04:49 PM, Andres Freund wrote: > Hi, > > On 2018-08-13 11:46:30 -0300, Alvaro Herrera wrote: >> On 2018-Aug-11, Tomas Vondra wrote: >> >>> Hmmm, it's difficult to compare "bt full" output, but my backtraces look >>> somewhat different (and all the backtraces I'm seeing are 100% exactly >>> the same). Attached for comparison. >> >> Hmm, looks similar enough to me -- at the bottom you have the executor >> doing its thing, then an AcceptInvalidationMessages in the middle >> section atop which sit a few more catalog accesses, and further up from >> that you have another AcceptInvalidationMessages with more catalog >> accesses. AFAICS that's pretty much the same thing Andres was >> describing. > > It's somewhat different because it doesn't seem to involve a reload of a > nailed table, which my traces did. I wasn't able to reproduce the crash > more than once, so I'm not at all sure how to properly verify the issue. > I'd appreciate if Thomas could try to do so again with the small patch I > provided. > I'll try in the evening. I've tried reproducing it on my laptop, but I can't make that happen for some reason - I know I've seen some crashes here, but all the reproducers were from the workstation I have at home. I wonder if there's some subtle difference between the two boxes, making it more likely on one of them ... the whole environment (distribution, packages, compiler, ...) should be exactly the same, though. The only thing I can think of is different CPU speed, possibly making some race conditions more/less likely. No idea. regards -- Tomas Vondra http://www.2ndQuadrant.com PostgreSQL Development, 24x7 Support, Remote DBA, Training & Services