Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.89) (envelope-from ) id 1hi8rV-0002wK-1E for pgsql-hackers@arkaria.postgresql.org; Tue, 02 Jul 2019 02:49:41 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.89) (envelope-from ) id 1hi8rT-0007zz-5G for pgsql-hackers@arkaria.postgresql.org; Tue, 02 Jul 2019 02:49:39 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.89) (envelope-from ) id 1hi8rS-0007zs-Pd for pgsql-hackers@lists.postgresql.org; Tue, 02 Jul 2019 02:49:38 +0000 Received: from wout1-smtp.messagingengine.com ([64.147.123.24]) by makus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.89) (envelope-from ) id 1hi8rQ-0004bt-Ie for pgsql-hackers@lists.postgresql.org; Tue, 02 Jul 2019 02:49:37 +0000 Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailout.west.internal (Postfix) with ESMTP id ECFB954C; Mon, 1 Jul 2019 22:49:34 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute4.internal (MEProxy); Mon, 01 Jul 2019 22:49:35 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=paquier.xyz; h= date:from:to:cc:subject:message-id:references:mime-version :content-type:in-reply-to; s=fm2; bh=Bit7D8Moynh1f6gWycbx9jXfK8d ci+LENLJyNCEK7KM=; b=ogl5oFUrgsrwTqUPULFRoP0sXrb6sxxzsbi/sfAONEc 8hrBZIn+VC+uBO3xD+NtSrjHdRToAeTn4KdcvD8ms7WM8VkG3IoIqyuJXMvyVALq ZNf9E3njAUYZtNgAqjdh5u9sPLkshV/ifBu4DWkHuhdxvEelm3F5qTw3ZCFeqOGl GwtiE/N0KHSaAR4qJ0Rsjb5wMVMRE6QUSyTdE+XD4RmYNqcWneBJICcpP1/7dWcU T5y4rCFn3IUq2hVzXQSaXpPKoNWR8Pph4Pvs8XLbr+Vmh7r672SmQvyy0BQe62Mw NkGCdMTzddMLVaZ3qwXtb2sAyUkLScAg5J99PnXttGw== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm3; bh=Bit7D8 Moynh1f6gWycbx9jXfK8dci+LENLJyNCEK7KM=; b=YM4kx1VhaiWA/as8gnPIKF n2KUOSQwkcfIrLHTyvTSUsp8MvXCc/fWUGyWd63m3qcN+JT8ZE6gmDGi7TGDfW6T Fpp1Orl8hOW7/Ycr52h1Pg96kkOK5EfCf3sNscwRP5kUsnpVBhNQhJ6bBCfaOQAW jthl5IOnwCX0l/qdK05AQ8vJzDAmACHxPPBSFvTkfspNbKkgiWXdAyads5ymWKHg xfJSLiYJzT1vwkU8Xvhghcp9BnMNnxE3nReQ8l588Q46gAIUKzADO9zieEwDtSIX FYbNDghnVH6cFg5jpbnGPOtOpxzjKd9RexlfMWoUeszinNjNot2+8ZgN8Y1F/2dQ == X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduvddrvdejgdeiudcutefuodetggdotefrodftvf curfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfghnecu uegrihhlohhuthemuceftddtnecusecvtfgvtghiphhivghnthhsucdlqddutddtmdenfg hrlhcuvffnffculdefhedmnecujfgurhepfffhvffukfhfgggtuggjsehgtderredttddv necuhfhrohhmpefoihgthhgrvghlucfrrghquhhivghruceomhhitghhrggvlhesphgrqh huihgvrhdrgiihiieqnecukfhppeduuddurddutddvrddukedtrddukeehnecurfgrrhgr mhepmhgrihhlfhhrohhmpehmihgthhgrvghlsehprghquhhivghrrdighiiinecuvehluh hsthgvrhfuihiivgeptd X-ME-Proxy: Received: from paquier.xyz (ee0822lan1.rev.em-net.ne.jp [111.102.180.185]) by mail.messagingengine.com (Postfix) with ESMTPA id BABE980060; Mon, 1 Jul 2019 22:49:32 -0400 (EDT) Date: Tue, 2 Jul 2019 11:49:28 +0900 From: Michael Paquier To: Julien Rouhaud Cc: Tom Lane , PostgreSQL Hackers , Kevin Grittner Subject: Re: Add parallelism and glibc dependent only options to reindexdb Message-ID: <20190702024928.GC1388@paquier.xyz> References: <20190701085453.GA1388@paquier.xyz> <26518.1561990251@sss.pgh.pa.us> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="WfZ7S8PLGjBY9Voh" Content-Disposition: inline In-Reply-To: List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Precedence: bulk --WfZ7S8PLGjBY9Voh Content-Type: text/plain; charset=us-ascii Content-Disposition: inline On Mon, Jul 01, 2019 at 06:28:13PM +0200, Julien Rouhaud wrote: > On Mon, Jul 1, 2019 at 4:10 PM Tom Lane wrote: >> Couldn't we make this enormously simpler and less bug-prone by just >> dictating that --jobs applies only to reindex-table operations? I had the same argument about the first patch sets actually, but... :) > That would also mean that we'll have to fallback on doing reindex at > table-level, even if we only want to reindex indexes that depends on > glibc. I'm afraid that this will often add a huge penalty. Yes, I would expect that most of the time glibc-sensible indexes are also mixed with other ones which we don't care about here. One advantage of the argument from Tom though is that it is possible to introduce --jobs with minimal steps: 1) Refactor the code for connection slots, without the cell addition 2) Introduce --jobs without INDEX support. In short, the conflict business between indexes is something which could be tackled afterwards and with a separate patch. Parallel indexes at table-level has value in itself, particularly with CONCURRENTLY coming in the picture. -- Michael --WfZ7S8PLGjBY9Voh Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCgAdFiEEG72nH6vTowiyblFKnvQgOdbyQH0FAl0axjgACgkQnvQgOdby QH0Z6w/9F06FweR/rwnradL3DYjiwF8SkGjjlyLqW33eCwpZ9+72FJoXE2Fv9hrP uuFQvxmr+ppaAYKyOfro1+rqd1Q/hEO/yUTrK/32VdcqIZ2uiSmFuTtCQp3jXb4z LIH3ASW1ctwm1YCmg4pAcDR3vpsHn7g4NsfYUfJirUNxPOQWuH/3D9veIBR/w59i ria3UpNBm/4E8msi5NwK1hU/tLdZfTrjek6yt0tzwOL1w5uAABcN+neqcxNLhp0A Q2TBvFGy8ccEk3YSf6GP/+ThQWwoccBSfKLxDQMJKiiLGIIxcMz7Ftpv/l7zWefe 60Va9v3pHx9y7AkdKNC5bynXX3gPtCjXO4cI6ml+iLB1Wqz+jT5YOcdqmF8LYcrK XrxtUSw/iEpWUbp1HByuPYBOUGuB/ISpnhYOSvF9ngoTjf8QAMy9NV48uv7wk8ww x8FhtA6wQMWtc/AgbHhRYgTwCQa0xooAlNjw6Nw/fHTlNudVZA8XSIQbU4grqmy0 AG9njSsT+nY2fmhVYREz2Uq6kfjQWw+K8oTgoGrpYs34PFt48Uv8j0FZAyfGUqCG vWI0GCrz3PWDBfR/7uiuj8wj13vTJ1t5X8B0A2oMe4JhmY0sPK5xT/HSk01Md+bN 3USRbeTG0EBwiUq5Y84l2qP4zgH1leei81h2JLx/WLoRoKUIumo= =pu5l -----END PGP SIGNATURE----- --WfZ7S8PLGjBY9Voh--