Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1q1HUK-00032E-F5 for pgsql-general@arkaria.postgresql.org; Tue, 23 May 2023 02:11:00 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1q1HUH-0004JH-5F for pgsql-general@arkaria.postgresql.org; Tue, 23 May 2023 02:10:57 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1q1HUG-0004J7-Oy for pgsql-general@lists.postgresql.org; Tue, 23 May 2023 02:10:56 +0000 Received: from mail-yb1-xb36.google.com ([2607:f8b0:4864:20::b36]) by makus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.94.2) (envelope-from ) id 1q1HUA-001JNQ-5Z for pgsql-general@lists.postgresql.org; Tue, 23 May 2023 02:10:55 +0000 Received: by mail-yb1-xb36.google.com with SMTP id 3f1490d57ef6-ba89d797197so7586764276.3 for ; Mon, 22 May 2023 19:10:50 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1684807849; x=1687399849; h=content-transfer-encoding:in-reply-to:from:references:to :content-language:subject:user-agent:mime-version:date:message-id :from:to:cc:subject:date:message-id:reply-to; bh=HBaMJEFN6GLugJ1gnLZM1oJX57I/RPloB35hjuewHJw=; b=oueG6nreJsGnpoo3vSEF2KUI0o169RGli8DHmK8RfoI/dqQ3m3O1XQbySIEOX3xCFg SF5EYEtHrwfUSr8/UotlNUegcCBH9+MV6rciabIBtKNmOZ8Uqy6lyevY7Qz5OjQQzS5D Fx/W1QTFS0QW44mOR0ftrDMO79i6c4S5s3LlmApNoJMUxmzS9dylKlIjDS7iksXfxWl6 PtCht+WM7NGCMtCFcy0gS7hz0YKO0Fi3OCBIft+aTaawmSNB9xQKXhKqr5kJO5kxLRpW cXOrWooX0ArEdJFkpqfaMBe+pUTugiZt3gb+fs1YmT/VxD+YZrrqOpxH8IRoYD8Szh2n 8kQA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1684807849; x=1687399849; h=content-transfer-encoding:in-reply-to:from:references:to :content-language:subject:user-agent:mime-version:date:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=HBaMJEFN6GLugJ1gnLZM1oJX57I/RPloB35hjuewHJw=; b=TvZkLMS4OPkrEJq/c+a7LQ7yMcz6J5OpRp+HgNDpNVHd6DYQo8KY7YI8IyShnh6oeu 8oSmJn6BBEYh73xK1tkg9rVM16IuDT34N7x5gu3pdjcJ728C7GTQn1Z9nXPCpCBfbkqz bM+Ci1r60BsBg1YIUSMmoHq/sIpBT/GYifgU3axL4qa3E1DVqm77iPyaNbE6Eal69KTY 8UlF+N5U/fZ8GMv0RimMWEN14ViR6bJEGJ4k66Ii0POQcKZhJr/TCDvuckyCl6A002u2 /pz+HqUVrbUn9w0sfttV+TKHm4X7NfnBVtM14NjDu/GdOop9t+hBZ5VmtSKwRDZUTHBJ FrSA== X-Gm-Message-State: AC+VfDxOL+WLUyD5iRZK5JdglWHAAcBgvJlIgrW3paCRTVg5597vvMnB t7/RnP5ZaA0JptsEhxFEMYxyjkT8h0E= X-Google-Smtp-Source: ACHHUZ4rt46LuCiDY78FU1YMi50+oahoGJKnE0SxRt/SOESnAxxpUen6wi5A14lIqGfQ7CuoHZ5opg== X-Received: by 2002:a25:ae9e:0:b0:ba8:147b:7469 with SMTP id b30-20020a25ae9e000000b00ba8147b7469mr15381118ybj.36.1684807849114; Mon, 22 May 2023 19:10:49 -0700 (PDT) Received: from ?IPV6:2600:1700:bd2c:b810:f43c:ec55:430:48c2? ([2600:1700:bd2c:b810:f43c:ec55:430:48c2]) by smtp.googlemail.com with ESMTPSA id b200-20020a2534d1000000b00ba72da47017sm1823225yba.60.2023.05.22.19.10.48 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Mon, 22 May 2023 19:10:48 -0700 (PDT) Message-ID: Date: Mon, 22 May 2023 21:10:48 -0500 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.10.0 Subject: Re: 15 pg_upgrade with -j Content-Language: en-US To: pgsql-general@lists.postgresql.org References: <85a18793-627a-2a8b-1296-c965505694e6@openvistas.net> <13b3d746-a980-22d9-c88b-e74451536a11@aklaver.com> <5fdaee55-81df-4be8-73c9-8e496bd02368@openvistas.net> <774330.1684798934@sss.pgh.pa.us> From: Ron In-Reply-To: <774330.1684798934@sss.pgh.pa.us> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk On 5/22/23 18:42, Tom Lane wrote: > Jeff Ross writes: >> On 5/22/23 5:24 PM, Adrian Klaver wrote: >>> So is the 1400G mostly in one database in the cluster? >>> >> Yes, one big database with about 80 schemas and several other smaller >> databases so -j should help, right? > AFAICT from a quick look at the code, you won't get any meaningful > parallelism unless you have several large DBs and/or several large > tablespaces. Hmm.  I'm glad I'm reading this now. > It looks like the assumption was that issuing link() > requests in parallel wouldn't help much but just swamp your disk > if they're all on the same filesystem. > Maybe that could use rethinking, not sure. It does need rethinking in the era of VMs and SANs. /var/lib/pgsql/15 is going to be on a different LUN from /var/lib/pgsql/9.6 just like /var/lib/pgsql/backups is on a different LUN. -- Born in Arizona, moved to Babylonia.