Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1qJSpw-0005hI-EQ for pgsql-hackers@arkaria.postgresql.org; Wed, 12 Jul 2023 05:56:28 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1qJSpu-00040S-NU for pgsql-hackers@arkaria.postgresql.org; Wed, 12 Jul 2023 05:56:26 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1qJSpu-00040J-8T for pgsql-hackers@lists.postgresql.org; Wed, 12 Jul 2023 05:56:26 +0000 Received: from mail-il1-x136.google.com ([2607:f8b0:4864:20::136]) by makus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.94.2) (envelope-from ) id 1qJSpo-003Oco-UP for pgsql-hackers@lists.postgresql.org; Wed, 12 Jul 2023 05:56:24 +0000 Received: by mail-il1-x136.google.com with SMTP id e9e14a558f8ab-3457157a164so24421335ab.1 for ; Tue, 11 Jul 2023 22:56:20 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=telsasoft-com.20221208.gappssmtp.com; s=20221208; t=1689141380; x=1691733380; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:from:to:cc:subject:date:message-id:reply-to; bh=TgleLn3KYZt6QDfi+4h/epqG+NBITZ4TUUofc++RVek=; b=IvODJMze4m6c4h0zixdA+sG87gna+y28ne+nlG7mIRTywF3q68+lld54bb6E5q+RC+ ujYY8zdLx9ogQl4mGG/FAq30SJNUK2LCM3g7/1S5k9nTWV1rVgb82A2KzcFVbLwEQnTN X313XKrqnDuEePg/3VQHFC+Zxq2IqO8U5Y4Dq5lpFmr0y+xtJSkAoP8Bo3DClEAcr0mL 62MFQM+jl0aZfGoEhDGbWr6IWqlAc5u4oW31axE5iEuzwE5COnsH2HKVVggmEzphB0cV xEXiEqMR8e4m0/CXHZ6clZjvJfjDbSgKbfEVWBIDHQZC9oxdw1PoaKrmBrdemigCKFwm +/yQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1689141380; x=1691733380; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=TgleLn3KYZt6QDfi+4h/epqG+NBITZ4TUUofc++RVek=; b=ZQEdhWqSYHnJtHwunDavCwikoR4TNhJeJutWFC3PdsdGdJKCWSY/BFXNniyzgFRKUN Nf752lwxgPmdDjQAYpqEIt6hwzvRln4XQDOblcedxWBuF8cAZ5R/w1S2/t9JI6DlHqcU lTomtYDN1vyWCB/oFzg7vGGKp57BAxo5UCh6QeElWNDYFAinFfL9oP8Xwto8jnLDisyt QPRffpnBAvh/taEzUJ3IxCg+pSW9jJMVpdjQmzFxW8vohgtm655tCfgt6ZKYj8dL/gZ2 tzw3sVI3DLlKB341d4gGOiyG+S6pL8gQhcp4ztLitdiLg5lgu7JHYi9q4wuu3Sg3eSrE cu9w== X-Gm-Message-State: ABy/qLYXJjC2d/j68iQbvwbJVikxZFqPZmRdHaLwvfyL7mRbCB+tIXM+ FSGNEO3txOtRW6xSbs0nqB/VzA== X-Google-Smtp-Source: APBJJlEudFrKRuxWmdtfGsZXFdE+uiTBguk0xbVUNikzT4K09dvcskU/pww1SB6o4AsR1yEdtjIqng== X-Received: by 2002:a92:c08e:0:b0:346:ddb:c05 with SMTP id h14-20020a92c08e000000b003460ddb0c05mr16226799ile.6.1689141380205; Tue, 11 Jul 2023 22:56:20 -0700 (PDT) Received: from pryzbyj.telsasoft (charmander.telsasoft.com. [50.244.222.1]) by smtp.gmail.com with ESMTPSA id t4-20020a92c904000000b00342612c48f6sm1113099ilp.53.2023.07.11.22.56.19 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 11 Jul 2023 22:56:19 -0700 (PDT) Received: by pryzbyj.telsasoft (Postfix, from userid 1000) id 1594D8001C9; Wed, 12 Jul 2023 00:56:18 -0500 (CDT) Date: Wed, 12 Jul 2023 00:56:17 -0500 From: Justin Pryzby To: Andres Freund Cc: Andrew Dunstan , Thomas Munro , pgsql-hackers@lists.postgresql.org, Noah Misch , Michael Paquier , Anastasia Lubennikova , Tom Lane , Robert Haas , Melanie Plageman , Peter Eisentraut , Daniel Gustafsson , samay sharma Subject: Re: CI and test improvements Message-ID: References: <20220828171029.GO2342@telsasoft.com> <20220828212802.r6eymfffrgr3lxxt@awork3.anarazel.de> <20220910200542.GX31833@telsasoft.com> <20221104235412.GE16921@telsasoft.com> <20221105015946.yrxijqb7h4rqhp6d@awork3.anarazel.de> <20221113235303.GA26337@telsasoft.com> <20221121224542.p2zapvyvb7objluw@alap3.anarazel.de> <20221122225744.GF11463@telsasoft.com> <20230104234424.GE3109@telsasoft.com> <20230117173509.GV9837@telsasoft.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20230117173509.GV9837@telsasoft.com> List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk On Tue, Jan 17, 2023 at 11:35:09AM -0600, Justin Pryzby wrote: > However, this finds two real problems and one false-positive with > missing regress/isolation tests: > > $ for makefile in `find src contrib -name Makefile`; do for testname in `sed -r '/^(REGRESS|ISOLATION) =/!d; s///; :l; /\\\\$/{s///; N; b l}; s/\n//g' "$makefile"`; do meson=${makefile%/Makefile}/meson.build; grep -Fw "$testname" "$meson" >/dev/null || echo "$testname is missing from $meson"; done; done And, since 681d9e462: security is missing from contrib/seg/meson.build