Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1qTSy9-009fx4-BU for pgsql-hackers@arkaria.postgresql.org; Tue, 08 Aug 2023 20:06:17 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1qTSy7-000PRH-JG for pgsql-hackers@arkaria.postgresql.org; Tue, 08 Aug 2023 20:06:15 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1qTSy7-000PR8-8h for pgsql-hackers@lists.postgresql.org; Tue, 08 Aug 2023 20:06:15 +0000 Received: from mail-pl1-x630.google.com ([2607:f8b0:4864:20::630]) by magus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.94.2) (envelope-from ) id 1qTSy3-001LXb-Cq for pgsql-hackers@postgresql.org; Tue, 08 Aug 2023 20:06:15 +0000 Received: by mail-pl1-x630.google.com with SMTP id d9443c01a7336-1bc8045e09dso8593335ad.0 for ; Tue, 08 Aug 2023 13:06:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1691525169; x=1692129969; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:from:to:cc:subject:date:message-id:reply-to; bh=uTyCpGVCiDUhLsqbnZPo9Z2713wy1LIDkw6ZpywKfvQ=; b=IPv6rFdGYsAs5h6F64JR3sH8XtvoHnfOKHhEtjz/LQhYzUpvVdpFsz3JoAD2D+zbiF 2JZkK/OmTTetzM1v8FApHgWQOIpuVnnYOVZ8lpNEMdew/nJkSYeX9TEr6TzQg/crpgcq tnn2rBMdiCPrYdZgz7frWQUGJtwCEY4pVSY42BlkLB3O7EoBVwOjo1xgikWoQWctDK/S Wh8ZZL3rDAo2qqyFq5R/WNzSw9kbkgZ484ZMZqyGpX8R5AjuoYI5FqTyUqhbb0LlHAmO slAflLzx6P0lXXwDE5k3uRtJKrX4aSbhCmb5k1ADKwlAtzjTNQ0buNAS+OUO+UKDbiza 8rrw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1691525169; x=1692129969; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=uTyCpGVCiDUhLsqbnZPo9Z2713wy1LIDkw6ZpywKfvQ=; b=AWPnL48vKI2nlRmG4CNCOk5lIJH6Wrz0g+atrjvEJ+/ub+e2W4TxRzSVodyvKe4AeC IQgB1TACYPYFre749v4BWvBOQxdfdEi6ls+GKXXbGtTHavSmcNZW3jVyPKMCwV7UuO8K sfall3+o3qOPpShKYWikenqSv+QuHJakB6a+GPAf5D5/eA/oCFmqKAA+tdbBi1IEnjwc AJoXqAL/opGhme/pEgxvhD8QtPKHpkm3RD2Iav9p48VozvxbKSbnNGmccWj8VGzVqmak 41qn/T/jUgU8mA/YxRhu6Fzj3iv5bgiXIdaPpZNtsjuejY+8ooIm/WWoQbq3k3WuogWa Ibqw== X-Gm-Message-State: AOJu0YzUBxBepp4BGRjZ25XUDhlrYTvlwrgYqCqgN7lYBiw3p27Aui7C 9wU6jxnL1ZiZ1dpX++aI5iI= X-Google-Smtp-Source: AGHT+IHqItB6Tds+NXqJ1cFIXtWUPXZcOpKTy4x7knN3SlY1QxAxyNt2tFXB93On7DusiNwTX+/W2g== X-Received: by 2002:a17:902:d2c8:b0:1bc:8748:8bbf with SMTP id n8-20020a170902d2c800b001bc87488bbfmr574689plc.52.1691525169305; Tue, 08 Aug 2023 13:06:09 -0700 (PDT) Received: from nathanxps13 ([50.47.162.83]) by smtp.gmail.com with ESMTPSA id u16-20020a170902e81000b001ab2b4105ddsm9413296plg.60.2023.08.08.13.06.08 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 08 Aug 2023 13:06:08 -0700 (PDT) Date: Tue, 8 Aug 2023 13:06:06 -0700 From: Nathan Bossart To: Justin Pryzby Cc: Michael Paquier , Thomas Munro , David Steele , Fujii Masao , Bruce Momjian , Tom Lane , Michael Brown , pgsql-hackers@postgresql.org Subject: Re: should frontend tools use syncfs() ? Message-ID: <20230808200606.GA1384393@nathanxps13> References: <20210930004340.GM831@telsasoft.com> <20220413115412.GM26620@telsasoft.com> <20230729214010.GA189456@nathanxps13> <20230731175138.GA432880@nathanxps13> <20230731183946.GB537853@nathanxps13> <20230801163707.GA862840@nathanxps13> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20230801163707.GA862840@nathanxps13> List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk I ran a couple of tests for pg_upgrade with 100k tables (created using the script here [0]) in order to demonstrate the potential benefits of this patch. pg_upgrade --sync-method fsync real 5m50.072s user 0m10.606s sys 0m40.298s pg_upgrade --sync-method syncfs real 3m44.096s user 0m8.906s sys 0m26.398s pg_upgrade --no-sync real 3m27.697s user 0m9.056s sys 0m26.605s [0] https://postgr.es/m/3612876.1689443232%40sss.pgh.pa.us -- Nathan Bossart Amazon Web Services: https://aws.amazon.com