Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1qyFeW-0077jw-PL for pgsql-general@arkaria.postgresql.org; Wed, 01 Nov 2023 18:09:16 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1qyFeV-008FW2-1M for pgsql-general@arkaria.postgresql.org; Wed, 01 Nov 2023 18:09:15 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1qyFeU-008FVt-MX for pgsql-general@lists.postgresql.org; Wed, 01 Nov 2023 18:09:14 +0000 Received: from mail-yw1-x1133.google.com ([2607:f8b0:4864:20::1133]) by makus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.94.2) (envelope-from ) id 1qyFeS-003Ty9-4e for pgsql-general@lists.postgresql.org; Wed, 01 Nov 2023 18:09:13 +0000 Received: by mail-yw1-x1133.google.com with SMTP id 00721157ae682-5a7c95b8d14so1010317b3.3 for ; Wed, 01 Nov 2023 11:09:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1698862151; x=1699466951; darn=lists.postgresql.org; h=content-transfer-encoding:subject:from:content-language:to :user-agent:mime-version:date:message-id:from:to:cc:subject:date :message-id:reply-to; bh=0ubu8MbOUPLpnY9mG8EqzC1FE26mC2WOfC32F5eKJBA=; b=kh+RWN1sgldIQV7RJjxTazkdNhumhFVwtpWF0rbu3Z0eYYECAH/40sIsPt3o9p2Y0V +EiUxPtX6efVNKgg/Ojk+ww8SNsb2nwzRsaTQcfrgRNm06EVafL7h9HbRYqUqX21v79j OHQh7dxhnFCR8sFD3MlgpgJSh/qMD+bPokXNPLunvdlhAEaH5LTm/6OsCWjFkIeSDQuu p8gKSJR0Fs1fAg9pstsyqCBFxWrN5D91vFaudqIYHZ9acJdPjb8wVdXsZdp3lIpNmNjZ Mk8l8Ku1eOcf3IjSUeA70VIFDHFsj6AKeP18Z3XuvRqSt6+yvwujfqJrMWceDCneYrwf ksFA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1698862151; x=1699466951; h=content-transfer-encoding:subject:from:content-language:to :user-agent:mime-version:date:message-id:x-gm-message-state:from:to :cc:subject:date:message-id:reply-to; bh=0ubu8MbOUPLpnY9mG8EqzC1FE26mC2WOfC32F5eKJBA=; b=VRpCRLOBcAu4NdypAz1eMnLDJUifmwoyhpBjS0SJC3fkTEoMj/861Z38IvCNmnfxkj gaTxVe0gd/QckjA2JF4Yg8LZmzkc1JXH+fDnqu1dkAQAdALXjJz3CrPFHrOoHgyMGH1Y 9XFHC7o4ICJ72RD/iPQ7VP3591CV4PSsCce9fqdJTFTux0ijA0GB7S15+qyDKgPs1m2o sh2y7IctnKBuPbvUfxuQ3YmFaXrhtnAA7WcOfi4rWT62FF0qLoKIkUix6vM5UUAL3ODQ wM9elBPaS3n7COXChKPI2igrqgPE7tW67cQwqneOgnXIO0mMIgjZWczEhVJk6CP9JGs7 HFQg== X-Gm-Message-State: AOJu0YwO9hPi88XeLCV9uPWujrtsMVKB7AgEw4QNW9B3qX3vBs8UhM5M i3JaR/0++6G5GBaEdrIW/fAlTdHIYPQ= X-Google-Smtp-Source: AGHT+IEXHIQBMg0NmZdim3vEpE7UR+iPUbrkCUksOs2vXnZdYRI1Mxp82Ckz+oKAbtiy0XZTWL16Pg== X-Received: by 2002:a81:8b48:0:b0:5a8:d790:87df with SMTP id e8-20020a818b48000000b005a8d79087dfmr13643424ywk.19.1698862151063; Wed, 01 Nov 2023 11:09:11 -0700 (PDT) Received: from ?IPV6:2600:1700:bd2c:b810::44? ([2600:1700:bd2c:b810::44]) by smtp.googlemail.com with ESMTPSA id w4-20020a817b04000000b005a815346d95sm232467ywc.71.2023.11.01.11.09.10 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Wed, 01 Nov 2023 11:09:10 -0700 (PDT) Message-ID: Date: Wed, 1 Nov 2023 13:09:10 -0500 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird To: pgsql-general@lists.postgresql.org Content-Language: en-US From: Ron Subject: pg_dump/pg_restore --jobs practical limit? Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk I will "soon" migrate some 1+ TB database from Pg 9.6.24 on RHEL 6 VMs to Pg 14.latest on RHEL 8 VMs.  The VMs have 10Gbps "NICs", SAN-based LUNs managed by LVM, and are all on ESX blades.  nproc count on some is 16 and on others is 32. Does anyone have experience as to the point of diminishing returns? IOW, can I crank them processes up to --jobs=30, will I see no gain -- or even degradation -- after, for example, --jobs=24? This would be for both pg_dump and pg_restore (which would be run on the RHEL 8 VM). -- Born in Arizona, moved to Babylonia.