Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.89) (envelope-from ) id 1ipmfC-0006Dw-Qu for pgsql-hackers@arkaria.postgresql.org; Fri, 10 Jan 2020 05:16:50 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.89) (envelope-from ) id 1ipmfA-00059Z-Ty for pgsql-hackers@arkaria.postgresql.org; Fri, 10 Jan 2020 05:16:48 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.89) (envelope-from ) id 1ipmfA-00059R-Kz for pgsql-hackers@lists.postgresql.org; Fri, 10 Jan 2020 05:16:48 +0000 Received: from sss.pgh.pa.us ([66.207.139.130]) by magus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1ipmf8-0001q6-2J for pgsql-hackers@lists.postgresql.org; Fri, 10 Jan 2020 05:16:48 +0000 Received: from sss1.sss.pgh.pa.us (localhost [127.0.0.1]) by sss.pgh.pa.us (8.14.4/8.14.4) with ESMTP id 00A5Gbst000398; Fri, 10 Jan 2020 00:16:37 -0500 From: Tom Lane To: Noah Misch cc: Amit Khandekar , Amit Kapila , Alvaro Herrera from 2ndQuadrant , Andres Freund , Juan =?iso-8859-1?Q?Jos=E9_Santamar=EDa?= Flecha , PostgreSQL Hackers , Robert Haas , Thomas Munro , Tomas Vondra Subject: Re: logical decoding : exceeded maxAllocatedDescs for .spill files In-reply-to: <20200110015736.GA2525917@rfd.leadboat.com> References: <20200104185148.GA2270238@rfd.leadboat.com> <20200109053704.GA2502006@rfd.leadboat.com> <22498.1578548741@sss.pgh.pa.us> <20200110015736.GA2525917@rfd.leadboat.com> Comments: In-reply-to Noah Misch message dated "Thu, 09 Jan 2020 17:57:36 -0800" MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-ID: <396.1578633397.1@sss.pgh.pa.us> Content-Transfer-Encoding: quoted-printable Date: Fri, 10 Jan 2020 00:16:37 -0500 Message-ID: <397.1578633397@sss.pgh.pa.us> List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Precedence: bulk Noah Misch writes: > On Thu, Jan 09, 2020 at 12:45:41AM -0500, Tom Lane wrote: >> (1) Why did we get a crash and not some more-decipherable out-of-resour= ces >> error? Can we improve that experience? > By default, 32-bit AIX binaries have maxdata:0x00000000. Specifying > maxdata:0x10000000 provides the same 256M of RAM, yet it magically chang= es the > SIGSEGV to ENOMEM: > ... > We could add -Wl,-bmaxdata:0x10000000 (or a higher value) to LDFLAGS whe= n > building for 32-bit AIX. +1, seems like that would improve matters considerably on that platform. >> (2) Should we be dialing back the resource consumption of this test? >> Even on machines where it doesn't fail outright, I'd imagine that it's >> costing a lot of buildfarm cycles. Is it actually worth that? > The test's resource usage, being quite low, should not be a factor in th= e > test's fate. On my usual development machine, the entire > 006_logical_decoding.pl file takes just 3s and ~250 MiB of RAM. Yeah, as I noted downthread, it appears that initdb itself can't succeed with less than ~250MB these days. My old-school self feels like that's excessive, but I must admit I'm not motivated to go reduce it right now. But I think it's a clear win to fail with "out of memory" rather than "SIGSEGV", so I think we ought to adjust the AIX build options as you suggest. regards, tom lane