Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.84_2) (envelope-from ) id 1coQzN-00089c-GX for pgsql-hackers@arkaria.postgresql.org; Thu, 16 Mar 2017 08:42:29 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.84_2) (envelope-from ) id 1coQzN-0002Jj-2y for pgsql-hackers@arkaria.postgresql.org; Thu, 16 Mar 2017 08:42:29 +0000 Received: from makus.postgresql.org ([2001:4800:1501:1::229]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1coQxr-0006L1-CH for pgsql-hackers@postgresql.org; Thu, 16 Mar 2017 08:40:55 +0000 Received: from mail-wr0-x234.google.com ([2a00:1450:400c:c0c::234]) by makus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.84_2) (envelope-from ) id 1coQxp-000577-2M for pgsql-hackers@postgresql.org; Thu, 16 Mar 2017 08:40:54 +0000 Received: by mail-wr0-x234.google.com with SMTP id g10so26703310wrg.2 for ; Thu, 16 Mar 2017 01:40:52 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=2ndquadrant-com.20150623.gappssmtp.com; s=20150623; h=from:subject:to:references:message-id:date:user-agent:mime-version :in-reply-to:content-transfer-encoding; bh=IMjHg+X80LKBRBXQXHFU6tgilIOM5XWYUCkauFIzGEk=; b=UiuH43tQm2QMjSJ1ve4a5dO/aUeNBhq5bkYGND7FVOiXzrRdb1SMFBjpLBjo5wYI2Q nfaBufP4n6BbGgAAj7V/rGjYQpc7+lKBrsYxy3RlcDD0txXgmEC6QXGMZ+VHxZDlEZf0 wPARIEwm/6N1BiI541D0YjlLkUegg4rusBqX5DoAtpdaWpG1XzD8+cDvpz7lK6Q2HmhG bGfoGRwYLLyDxM5HlcX4rZlXcqk51lgMV/6dsIQIt19I4v62R1v9rzyze0Hnei9wHi/G VGXGNEOFx2Q131Efx5KaAJaGPn2Ly0YrQn0qJ8fkfA/ox8jGsWzFXFfRbKLRej7jExCB x5Pw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:subject:to:references:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding; bh=IMjHg+X80LKBRBXQXHFU6tgilIOM5XWYUCkauFIzGEk=; b=NBoBFA9ULs3XdQcj1fZPF4EVyVb/9ja1ZDgbSpwxfGU8uqOX7aAmeKAylyfDr891jI 2BEa/2KOuwaGxHGcwIVo3TW33tLpImBhNEil0mCiYSX/vOh+r4/3DFLIQLmnS05uP7C+ Tu96ySd6I4FC3fpgg9HWdLD/qWS0E+9/agDuYP90TBOsqX/kFIhjdtvEbtZ/ATwUJHAz udalR4GWrkBbVTXTNqg4STsR4rPSvaq/VhssXK2DFp7sca32jxFAvtCWoE/kVeqsX9u0 AwEOSSbmn37b2GMl5BdYTOzO9Aj4cMxHsxUAdR+uHGCc9bythpqVd57Hsmal0KBx+Ot5 +wbA== X-Gm-Message-State: AFeK/H3B+lvoIRHOmMOXb3smqHOWa9Iia0LwkCGkchYHi+Px19nUIk7JiN/wr/HJct+06n46 X-Received: by 10.223.152.215 with SMTP id w81mr7566045wrb.151.1489653651223; Thu, 16 Mar 2017 01:40:51 -0700 (PDT) Received: from [192.168.0.105] (150.123.broadband11.iol.cz. [90.178.123.150]) by smtp.gmail.com with ESMTPSA id z88sm5322013wrb.26.2017.03.16.01.40.49 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 16 Mar 2017 01:40:50 -0700 (PDT) From: Petr Jelinek Subject: Re: logical replication launcher crash on buildfarm To: Andres Freund , pgsql-hackers@postgresql.org, Petr Jelinek , Peter Eisentraut References: <20170316032833.2zxfnqe3sl3ktrbt@alap3.anarazel.de> <20170316034246.3uurliezczmka6cn@alap3.anarazel.de> Message-ID: Date: Thu, 16 Mar 2017 09:40:48 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.7.0 MIME-Version: 1.0 In-Reply-To: <20170316034246.3uurliezczmka6cn@alap3.anarazel.de> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-Pg-Spam-Score: -1.9 (-) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-hackers Precedence: bulk Sender: pgsql-hackers-owner@postgresql.org On 16/03/17 04:42, Andres Freund wrote: > On 2017-03-15 20:28:33 -0700, Andres Freund wrote: >> Hi, >> >> I just unstuck a bunch of my buildfarm animals. That triggered some >> spurious failures (on piculet, calliphoridae, mylodon), but also one >> that doesn't really look like that: >> https://buildfarm.postgresql.org/cgi-bin/show_log.pl?nm=culicidae&dt=2017-03-16%2002%3A40%3A03 >> >> with the pertinent point being: >> >> ================== stack trace: pgsql.build/src/test/regress/tmp_check/data/core ================== >> [New LWP 1894] >> [Thread debugging using libthread_db enabled] >> Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". >> Core was generated by `postgres: bgworker: logical replication launcher '. >> Program terminated with signal SIGSEGV, Segmentation fault. >> #0 0x000055e265bff5e3 in ?? () >> #0 0x000055e265bff5e3 in ?? () >> #1 0x000055d3ccabed0d in StartBackgroundWorker () at /home/andres/build/buildfarm-culicidae/HEAD/pgsql.build/../pgsql/src/backend/postmaster/bgworker.c:792 >> #2 0x000055d3ccacf4fc in SubPostmasterMain (argc=3, argv=0x55d3cdbb71c0) at /home/andres/build/buildfarm-culicidae/HEAD/pgsql.build/../pgsql/src/backend/postmaster/postmaster.c:4878 >> #3 0x000055d3cca443ea in main (argc=3, argv=0x55d3cdbb71c0) at /home/andres/build/buildfarm-culicidae/HEAD/pgsql.build/../pgsql/src/backend/main/main.c:205 >> >> it's possible that me killing things and upgrading caused this, but >> given this is a backend running EXEC_BACKEND, I'm a bit suspicous that >> it's more than that. The machine is a bit backed up at the moment, so >> it'll probably be a while till it's at that animal/branch again, >> otherwise I'd not have mentioned this. > > For some reason it ran again pretty soon. And I'm afraid it's indeed an > issue: > https://buildfarm.postgresql.org/cgi-bin/show_log.pl?nm=culicidae&dt=2017-03-16%2003%3A30%3A02 > Hmm, I tried with EXEC_BACKEND (and with --disable-spinlocks) and it seems to work fine on my two machines. I don't see anything else different on culicidae though. Sadly the backtrace is not that informative either. I'll try to investigate more but it will take time... -- Petr Jelinek http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Training & Services -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers