Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1nNLyy-0007zX-7n for pgsql-hackers@arkaria.postgresql.org; Thu, 24 Feb 2022 21:49:04 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1nNLyw-0006OJ-DZ for pgsql-hackers@arkaria.postgresql.org; Thu, 24 Feb 2022 21:49:02 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1nNLyw-0006O9-2o for pgsql-hackers@lists.postgresql.org; Thu, 24 Feb 2022 21:49:02 +0000 Received: from mail-pl1-x634.google.com ([2607:f8b0:4864:20::634]) by magus.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.92) (envelope-from ) id 1nNLys-0005MC-L0 for pgsql-hackers@postgresql.org; Thu, 24 Feb 2022 21:49:01 +0000 Received: by mail-pl1-x634.google.com with SMTP id s1so3007300plg.12 for ; Thu, 24 Feb 2022 13:48:58 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to; bh=lisznCCp0gB8T8EBZpGn2OGvbckPqLvJJ/PX+WdXYDM=; b=iqjMD64I0kMGxtoQBOnygeOxyfeRum6olozB6/5Gyj+gWQRHV6t++TIuOgy5KAAbgu +51JSNJ+xUKcNkps0K9g8PHyMZUjjx5FI0DL2ZfvptZ3MUGNaLk38VE4MWTPiSoUYNfa VHFcGc5VVZMn2XtwEd20Bk5udUHccAKNLy0tIrvvx181iE8ACv/TBSgXQm03oVJFtifN qF5u5zgqg8CHIgQaix5XrwU+mTzwRGjlCqxA354DIWRd3ubatGQzej58ZDe/zDDZ0khd 8InunSABzfmv6J8v7gQ1rpdm4Lsnip8E43nxxUdZ35zc1vF/dkuVgZ+vR/Xg4xzPWlPT DinQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to; bh=lisznCCp0gB8T8EBZpGn2OGvbckPqLvJJ/PX+WdXYDM=; b=nBeKTaF/UIg5yn/6iA7kkT942ee7bhNRyJ/dIZm1alhZzpq5xLJMOGQ25Un9yuZRPJ fAehkwr6McoOX2/uR5kKIvsp8Xr9O19BkCsQZhCctmrH/jOyOYi1ylc4cbNHt788ObC9 DwIGALvw6wAxvUd9xQONkSvOM0A+JSWc0VXCXhUkHkDh8VW8aj0Y5KCIkMMRvgKOsHxS JQJYfertSOv21HhTp+wSdn6S1ZYF03LOT5M1KXGQAiquAN7XDjQCO+1/7mPUdsvp+CkT C0RzIRp4XO+ifq3zvTXbmkyySSQOivTwkM1SZ9lp3Sp00M1VSgteFPHrW/vzPRyPqSd2 wgtQ== X-Gm-Message-State: AOAM533ZezrMn55RpD3/ckZUeoCooTIwoEbhti+At6NBYnrHke/4I87X /0O1njA95fP+b258o/+0Nfk= X-Google-Smtp-Source: ABdhPJxyV97RkyPljBHly08imsrgzhI3ig0/SEZnGx8NkWr1Ow8o/A4xBQzA56r5Tp7AsSosmGKFsQ== X-Received: by 2002:a17:902:7c06:b0:14e:f6c2:62a5 with SMTP id x6-20020a1709027c0600b0014ef6c262a5mr4917680pll.22.1645739336253; Thu, 24 Feb 2022 13:48:56 -0800 (PST) Received: from nathanxps13 ([50.54.155.70]) by smtp.gmail.com with ESMTPSA id x11-20020a056a00188b00b004e1c075c6fbsm469302pfh.52.2022.02.24.13.48.55 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 24 Feb 2022 13:48:55 -0800 (PST) Date: Thu, 24 Feb 2022 13:48:53 -0800 From: Nathan Bossart To: Kyotaro Horiguchi Cc: pgsql-hackers@postgresql.org Subject: Re: remove more archiving overhead Message-ID: <20220224214853.GA661650@nathanxps13> References: <20220222011948.GA3850532@nathanxps13> <20220222173711.GA3852671@nathanxps13> <20220222195229.GA42988@nathanxps13> <20220224.141349.1809640551882183816.horikyota.ntt@gmail.com> <20220224175553.GA660690@nathanxps13> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20220224175553.GA660690@nathanxps13> List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk I tested this again with many more WAL files and a much larger machine (r5d.24xlarge with data directory on an NVMe SSD instance store volume). As before, I am using a bare-bones archive module that does nothing but return true. Without the patch, archiving ~120k WAL files took about 109 seconds. With the patch, it took around 62 seconds, which amounts to a ~43% reduction in overhead. -- Nathan Bossart Amazon Web Services: https://aws.amazon.com