Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.89) (envelope-from ) id 1gIEdK-0007Q5-FQ for pgsql-general@arkaria.postgresql.org; Thu, 01 Nov 2018 15:11:42 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.89) (envelope-from ) id 1gIEdI-0006tI-5W for pgsql-general@arkaria.postgresql.org; Thu, 01 Nov 2018 15:11:40 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.89) (envelope-from ) id 1gIEdH-0006tB-S2 for pgsql-general@lists.postgresql.org; Thu, 01 Nov 2018 15:11:39 +0000 Received: from mout.gmx.net ([212.227.17.22]) by magus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.89) (envelope-from ) id 1gIEdE-0002Wi-Rp for pgsql-general@lists.postgresql.org; Thu, 01 Nov 2018 15:11:38 +0000 Received: from hermes ([84.165.111.43]) by mail.gmx.com (mrgmx103 [212.227.17.168]) with ESMTPSA (Nemesis) id 0Lqhaw-1feCmq1ueA-00eLaU for ; Thu, 01 Nov 2018 16:11:34 +0100 Received: from hermes ([84.165.111.43]) by mail.gmx.com (mrgmx103 [212.227.17.168]) with ESMTPSA (Nemesis) id 0Lqhaw-1feCmq1ueA-00eLaU for ; Thu, 01 Nov 2018 16:11:34 +0100 Received: from ncq by hermes with local (Exim 4.91) (envelope-from ) id 1gIEdB-0003nf-7B for pgsql-general@lists.postgresql.org; Thu, 01 Nov 2018 16:11:33 +0100 Date: Thu, 1 Nov 2018 16:11:33 +0100 From: Karsten Hilbert To: pgsql-general@lists.postgresql.org Subject: Re: backend crash on DELETE, reproducible locally Message-ID: <20181101151133.GE2954@hermes.hilbert.loc> References: <20181101140216.GA2954@hermes.hilbert.loc> <20181101144257.GD2954@hermes.hilbert.loc> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20181101144257.GD2954@hermes.hilbert.loc> Ma_X_il-Followup-to: d Re_X_turn-receipt-to: Karsten.Hilbert@gmx.net Di_X_sposition-Notification-To: Karsten.Hilbert@gmx.net X-Confi_X_rm-Reading-To: Karsten.Hilbert@gmx.net X-Pri_X_ority: 2 (High) User-Agent: Mutt/1.10.1 (2018-07-13) Sender: X-Provags-ID: V03:K1:DqRD1orlt3KTb1+FoiWIy+BvVXeJjpdO8gHDpvBS7INf3bFP6J7 FChsuIOYtnsiGesuZNNMB2ZCYNBWt9xCwZIWccnElMfmmFfXP5+yK+o8xlga5C0Gw41/GER qJqFS3EYxAccxmJd77ncoFjfI+GU1/hF9r37NW4I5vAr0JUVbvV23sm15YfTw7+/hhztBcF /0RIkrf5dkv+d+ZEWjTSQ== X-Spam-Flag: NO X-UI-Out-Filterresults: notjunk:1;V01:K0:rf4No3OFio4=:VfpBDlRev0RyXsaZ1wl0nD GJgRMKcqLNp92MNqLDK1kPppEuX/tEPVi08e+ZfSiaHyzbdGLb15P+mz0z26DNBZTFPrOXnei W1l+tYOIoNnZ9ZvSW5DaPShAxi4I7i1BbSizXpfAuOelglfCBGKiLpQDkVvI0n1IxxbrmEonx W2Z8fJ1zjpQqbu4lcqE/iVhszsHQgqLjRJNmnAGl54Wt+s+zNXK5zi26vV4oqwXwST5vjkKh3 xEOOHVeh3NAo2vHaBKBfiFF/DKhEty7GsaZ1ht8byPqLbuWpNIS9FreNm1RBN+2ZxZ8Nu+VqC 0gjGJ4Ke0S2KVmQGHGG6ud96l/MHNunL3U1Chxszeqc75Jl12n4fp5yMCLn2YT9MEkedDfEjq XHOD74T0W2R2SZRlvEgUdP9al6osu7zjpRaMsjGIif3PFuEIwaJqJhYtzrMfxt7ZKX6wDUxd5 giymDAX4OJuyd9hRKT1/HNwNd2YOJJ5p1CuLbtLjpKaVt6hDnlFPxlbE1N6CJVINgV1TnDbsO tDA6Qi2EOhrexQxaY6zA0wP4ZEmogbBvOUIjdqXXPp5Z9+LXk/MfvLcztM0kgj8gPd7q/3wgS RJvP1LZSsON/canPgnbJXpffBUMQ3H+vVT3/u8ZSPKUWnwqbFlE6e2dMqGCYu92xNkXYDqH9r tWAmmCDEqhUuyrILLMCsgoMgLMsDB4VwDHwmjX2Ojk2OgQL73oO7TdRGt4wcYAcip9q1IKQn3 /J4JKEcm5N/U+z4Sqa8IkCgKQ5+S/9cIepZoaW5cER5q2zKzlAnfep3MUehUXJTWCCIyzYM5H K6C8NJSXHA6MVCZv350t+Bw0EULyQ== List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Precedence: bulk On Thu, Nov 01, 2018 at 03:42:57PM +0100, Karsten Hilbert wrote: > Will attempt to get a stack trace ... Meanwhile, in case it helps, an strace of the crash. epoll_wait(7, [{EPOLLIN, {u32=47607120, u64=35184419695952}}], 1, -1) = 1 recv(13, "Q\0\0\0`DELETE FROM ref.auto_hint W"..., 8192, 0) = 97 gettimeofday({tv_sec=1541084179, tv_usec=197395}, NULL) = 0 gettimeofday({tv_sec=1541084179, tv_usec=197442}, NULL) = 0 write(2, "2018-11-01 14:56:19 GMT LOG: 00"..., 209) = 209 _llseek(45, 0, [16384], SEEK_END) = 0 _llseek(47, 0, [16384], SEEK_END) = 0 _llseek(48, 0, [16384], SEEK_END) = 0 _llseek(49, 0, [16384], SEEK_END) = 0 _llseek(45, 0, [16384], SEEK_END) = 0 kill(10377, SIGUSR1) = 0 _llseek(45, 0, [0], SEEK_SET) = 0 read(45, "\0\0\0\0\234\270\246F\10\373\0\0D\0x\n\0 \4 I\337\1\0\0\236\0\4\0\200\1\0"..., 8192) = 8192 _llseek(43, 81920, [81920], SEEK_SET) = 0 read(43, "\0\0\0\0x{pF8o\0\0\264\1\34\33\360\37\4 \0\0\0\0\344\237\30\0\330\237\30\0"..., 8192) = 8192 _llseek(44, 925696, [925696], SEEK_SET) = 0 read(44, "\0\0\0\0\310\324\231FE\231\1\0L\0l\1\0 \4 \0\0\0\0\24\234\326\7<\231\254\5"..., 8192) = 8192 openat(AT_FDCWD, "base/139580/139695", O_RDWR|O_LARGEFILE) = 56 read(56, "\0\0\0\0\350\347\220E`B\0\0<\0\360\37\360\37\4 \0\0\0\0b1\5\0\3\0\0\0"..., 8192) = 8192 read(56, "\0\0\0\0h\347\220E\1,\0\0(\0\300\37\360\37\4 \0\0\0\0\344\237\30\0\330\237\30\0"..., 8192) = 8192 openat(AT_FDCWD, "base/139580/2612", O_RDWR|O_LARGEFILE) = 57 read(57, "\0\0\0\0\200\334s\1a\6\4\0(\0@\36\0 \4 \0\0\0\0\220\237\340\0 \237\340\0"..., 8192) = 8192 _llseek(43, 65536, [65536], SEEK_SET) = 0 read(43, "\0\0\0\0\214e^F\215w\0\0H\7`\n\360\37\4 \0\0\0\0x\212\30\0\344\237\30\0"..., 8192) = 8192 _llseek(44, 606208, [606208], SEEK_SET) = 0 read(44, "\0\0\0\0\20\206\237FVP\1\0p\0\230\3\0 \4 \361\360\1\0000\237\232\1T\236\266\1"..., 8192) = 8192 stat64("/usr/lib/postgresql/11/lib/plpgsql", 0xbfbda4ec) = -1 ENOENT (No such file or directory) stat64("/usr/lib/postgresql/11/lib/plpgsql.so", {st_mode=S_IFREG|0644, st_size=197944, ...}) = 0 stat64("/usr/lib/postgresql/11/lib/plpgsql.so", {st_mode=S_IFREG|0644, st_size=197944, ...}) = 0 futex(0xb78b904c, FUTEX_WAKE_PRIVATE, 2147483647) = 0 openat(AT_FDCWD, "/usr/lib/postgresql/11/lib/plpgsql.so", O_RDONLY|O_CLOEXEC) = 58 read(58, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0\300a\0\0004\0\0\0"..., 512) = 512 fstat64(58, {st_mode=S_IFREG|0644, st_size=197944, ...}) = 0 mmap2(NULL, 201108, PROT_READ, MAP_PRIVATE|MAP_DENYWRITE, 58, 0) = 0xb293f000 mmap2(0xb2944000, 102400, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 58, 0x5000) = 0xb2944000 mmap2(0xb295d000, 69632, PROT_READ, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 58, 0x1e000) = 0xb295d000 mmap2(0xb296e000, 12288, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 58, 0x2e000) = 0xb296e000 close(58) = 0 mprotect(0xb296e000, 8192, PROT_READ) = 0 openat(AT_FDCWD, "global/139651", O_RDWR|O_LARGEFILE) = 58 read(58, "\0\0\0\0\320\200zE\324\16\0\0<\0\360\37\360\37\4 \0\0\0\0b1\5\0\3\0\0\0"..., 8192) = 8192 read(58, "\0\0\0\0P\200zE.+\0\0\320\0\310\35\360\37\4 \0\0\0\0\344\237\30\0\330\237\30\0"..., 8192) = 8192 openat(AT_FDCWD, "base/139580/139719", O_RDWR|O_LARGEFILE) = 59 read(59, "\0\0\0\0x\347\232E\226s\0\0<\0\360\37\360\37\4 \0\0\0\0b1\5\0\3\0\0\0"..., 8192) = 8192 read(59, "\0\0\0\0l\250\16F\22\340\0\0h\0\0\37\360\37\4 \0\0\0\0\344\237\30\0\330\237\30\0"..., 8192) = 8192 read(42, "\0\0\0\0`\235^\1\177\242\4\0\320\0\30\1\0 \4 \0\0\0\0T\237X\1\250\236X\1"..., 8192) = 8192 openat(AT_FDCWD, "base/139580/139606", O_RDWR|O_LARGEFILE) = 60 read(60, "\0\0\0\0\244E{F\206q\0\0<\0\360\37\360\37\4 \0\0\0\0b1\5\0\3\0\0\0"..., 8192) = 8192 _llseek(60, 24576, [24576], SEEK_SET) = 0 read(60, "\0\0\0\0\224\272wE\re\0\0008\0\20\37\360\37\4 \0\0\0\0\350\237\20\0\320\2370\0"..., 8192) = 8192 read(60, "\0\0\0\0tD{F\34S\0\0\220\3\324\6\360\37\4 \0\0\0\0t\2078\0\300\237`\0"..., 8192) = 8192 brk(0x2e07000) = 0x2e07000 _llseek(41, 32768, [32768], SEEK_SET) = 0 read(41, "\0\0\0\0\320B{F\23I\0\0\230\6p\f\360\37\4 \0\0\0\0p\214\30\0\344\237\30\0"..., 8192) = 8192 _llseek(42, 335872, [335872], SEEK_SET) = 0 read(42, "\0\0\0\0 \"|FB\177\5\0\340\0\320\7\0 \4 Z\362\1\0\0\0\0\0\0\0\0\0"..., 8192) = 8192 openat(AT_FDCWD, "base/139580/139666", O_RDWR|O_LARGEFILE) = 61 read(61, "\0\0\0\0\244\326\212E\354\30\0\0<\0\360\37\360\37\4 \0\0\0\0b1\5\0\3\0\0\0"..., 8192) = 8192 _llseek(61, 24576, [24576], SEEK_SET) = 0 read(61, "\0\0\0\0$\326\212E\217\235\0\0\220\0`\31\360\37\4 \0\0\0\0\350\237\20\0\254\237x\0"..., 8192) = 8192 _llseek(61, 8192, [8192], SEEK_SET) = 0 read(61, "\0\0\0\0008\365XF\253\246\0\0\30\2\214\3\360\37\4 \0\0\0\0000\205x\0\270\237p\0"..., 8192) = 8192 read(43, "\0\0\0\0H>mFL\204\0\0D\7l\n\360\37\4 \0\0\0\0\344\237\30\0\330\237\30\0"..., 8192) = 8192 brk(0x2e29000) = 0x2e29000 _llseek(31, 40960, [40960], SEEK_SET) = 0 read(31, "\0\0\0\0\270\244.F}8\0\0\220\1\354\22\360\37\4 \0\0\0\0\320\237@\0\254\237H\0"..., 8192) = 8192 _llseek(16, 2605056, [2605056], SEEK_SET) = 0 read(16, "\0\0\0\0\304\347\220FX\37\5\0\10\1d\7\0 \4 \0\0\0\0\0\0\0\0\0\0\0\0"..., 8192) = 8192 read(33, "\0\0\0\0\230x\375