Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1ozzLM-0005Yo-WD for pgsql-hackers@arkaria.postgresql.org; Tue, 29 Nov 2022 12:04:09 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1ozzKM-0007c6-4B for pgsql-hackers@arkaria.postgresql.org; Tue, 29 Nov 2022 12:03:06 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1ozzKL-0007bx-RE for pgsql-hackers@lists.postgresql.org; Tue, 29 Nov 2022 12:03:05 +0000 Received: from mail-yw1-x112a.google.com ([2607:f8b0:4864:20::112a]) by magus.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.92) (envelope-from ) id 1ozzKE-0000SZ-W5 for pgsql-hackers@postgresql.org; Tue, 29 Nov 2022 12:03:05 +0000 Received: by mail-yw1-x112a.google.com with SMTP id 00721157ae682-3691e040abaso136130547b3.9 for ; Tue, 29 Nov 2022 04:02:57 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=enterprisedb.com; s=google; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=BG7TMQz7tvyJQkUK3tTPIcZffFE26tkVVRLA84jduoI=; b=U36/tIXBfO7e2+tYOA6EP1Xt2R01YqNJwkG0qRVL2zJ7IchU8R1CBAzjLQo6Os7Hop IAe5ku/ioPfIDvcoT7M8gK5gfAi7ltDSpDSVccMrpThBGH5vklrgMeBrifCiwPbnjtPz R0i+mMhfy/+Uoy2TBsQTdhQtXpXGFNgI0vx3DWxGtQwU4W6cPH0L0wT/DEUJd0jd5H59 lM10Mxh6Gnao/G7U6T5T5F0DnwJN8bFfKx7GjzLXnX+zmhBUIIsMl9DzYfcOhkAjf4CU dO+AQE4waM/UfNL3PnqVKDxE+CqlxAr3YJKOyxyOyYMtpKGRHLmmqbFfgINKddqACqe9 Db+g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=BG7TMQz7tvyJQkUK3tTPIcZffFE26tkVVRLA84jduoI=; b=IlY9itOvtP2bXWHArqbo1Z2U92q6n6x2DcRCK2yu5O6wc1dNzMnMYsMQ5hF8Q3iehQ 2ubhYNvmCG5iJl8J5OKEk2DTxpakUjySidcVf7iLkZw7b+9MaYCN/LIvIv7I3v6aEUu+ ImXrcQA6pRIiiJH1SrK1oqLbIb8XSIyW19UwtaIW/vgFFsfOHDdHaVcHfJXTMdrGJlDv uqAlbHXNDo6i2H8VK0y2VOJntME2x++l5/VjNwwEl+Y+VwBtPWKL2u3Wm03k2Uxsf+Yv vDjFQK8qNCTEb52ykzV2KyK3O0URveXO4T0LkxX1/dV65i1C/R43dkUGrdhHpB26ZeMJ c6Aw== X-Gm-Message-State: ANoB5pmleAL9kIfc0462EfkPcmSzy+kq8x08RQBoVIWk3SKm7fH7JAj8 i0poQIxIT+fMEl5QVG6soxr84WlIyWkzS9ec7tGe4vvijt0zkEzjhrSnaeZnBr6DmIzpiRxiW62 v3uJxRdKZxdGasH74f5aSWI+NfJ2TR2N1/zDZmdadY8DjJ/lqN7DZF4IBOF08MAelUx+SJDY2vv eNE2GSTm8WqhXuzNIf6Urkjw5++LT/KvpZGkEbeGaLni4ZEB85r8MZpA8D/5aa+/Rj6CKyAg04j nZIGVf8tl1rSMvD84McoGiUli2XbWXouKcQ0Fm87/PrRMVxOrV9 X-Google-Smtp-Source: AA0mqf6vf0mJx3IF5h4E2HUw4POvt1Kq4jkUat3FaTVHiUmou8Nhl9Gn39KKXARCJzTpXI2Q54I7pUfCNokj8uSVN4o= X-Received: by 2002:a05:690c:841:b0:370:572f:ca23 with SMTP id bz1-20020a05690c084100b00370572fca23mr51281159ywb.281.1669723376051; Tue, 29 Nov 2022 04:02:56 -0800 (PST) MIME-Version: 1.0 References: <20220824164624.GA1302727@nathanxps13> <20220902220744.GA1261322@nathanxps13> <20220923174154.GA1111614@nathanxps13> <20221106223842.GA620653@nathanxps13> <20221124001907.GA576983@nathanxps13> <20221127233434.GA878043@nathanxps13> <20221128183129.ip3g5vrcbjrngpp2@awork3.anarazel.de> <20221128234039.GA1119654@nathanxps13> In-Reply-To: <20221128234039.GA1119654@nathanxps13> From: Simon Riggs Date: Tue, 29 Nov 2022 12:02:44 +0000 Message-ID: Subject: Re: O(n) tasks cause lengthy startups and checkpoints To: Nathan Bossart Cc: Robert Haas , Andres Freund , "Bossart, Nathan" , Bharath Rupireddy , Maxim Orlov , Amul Sul , Bruce Momjian , "pgsql-hackers@postgresql.org" Content-Type: text/plain; charset="UTF-8" X-CLOUD-SEC-AV-Info: enterprisedb,google_mail,monitor X-CLOUD-SEC-AV-Sent: true X-Gm-Spam: 0 X-Gm-Phishy: 0 List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk On Mon, 28 Nov 2022 at 23:40, Nathan Bossart wrote: > > Okay, here is a new patch set. 0004 adds logic to prevent custodian tasks > from delaying shutdown. That all seems good, thanks. The last important point for me is tests, in src/test/modules probably. It might be possible to reuse the final state of other modules' tests to test cleanup, or at least integrate a custodian test into each module. -- Simon Riggs http://www.EnterpriseDB.com/