Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1oaVFH-0004mP-LQ for pgsql-hackers@arkaria.postgresql.org; Tue, 20 Sep 2022 04:52:31 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1oaVFG-0006Fo-GN for pgsql-hackers@arkaria.postgresql.org; Tue, 20 Sep 2022 04:52:30 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1oaVFF-0006Ff-UI for pgsql-hackers@lists.postgresql.org; Tue, 20 Sep 2022 04:52:30 +0000 Received: from mail-qv1-xf34.google.com ([2607:f8b0:4864:20::f34]) by magus.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.92) (envelope-from ) id 1oaVFB-00051p-8f for pgsql-hackers@postgresql.org; Tue, 20 Sep 2022 04:52:29 +0000 Received: by mail-qv1-xf34.google.com with SMTP id ml1so1294432qvb.1 for ; Mon, 19 Sep 2022 21:52:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=leadboat.com; s=google; h=user-agent:in-reply-to:content-disposition:mime-version:references :message-id:subject:cc:to:from:date:from:to:cc:subject:date; bh=plAPatok/reb9NHO16bfw2ZZp93nmgDpzR5KLf5jKEo=; b=BIlCIJJUMKAPrV4+VS5UY15vtdNGrd6qmdblHQsjlVx/C5aAubdIiwItoyQbnUovA3 r29PgLZNqOq7g4T+zkGcRNeRhmaEHRtf3+b6m8uu45+cip3CEkFc4pQWZmVOMq4Gz1IG 7XSyuVrHhMXic87qVfr5z2qxzO1nn5NNqs0Kw= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=user-agent:in-reply-to:content-disposition:mime-version:references :message-id:subject:cc:to:from:date:x-gm-message-state:from:to:cc :subject:date; bh=plAPatok/reb9NHO16bfw2ZZp93nmgDpzR5KLf5jKEo=; b=XQy6gK4YpdS21WllHK9DPvHisPEfpt0XgkCGUnULs69O9d00QTUkdW4wfowrdo0PSf f69IRRuPYWvpXg1viEH9FNmllU3noXsdBB54pW5xgNlmGAQzUaO8saErEKBj5tTWGxpc SsZgtONauYOSMMYfL4nI7i/C8PaRixQCLZQjYm8DX2YNSdOii1wNrJuaibFnIYRD2Qvc 6fDzu41GLd00WDsg+frfuzSf4qWJYl/ATC0eW+PTkxQQutSeLCrOYQ8Q3D6U8bObABa4 MfOOeoaEN+bLJAA7D5fR309Z04YM22sZNjuuiJvRUsQoQcU0avElcOQOarPaPtL4fk8z Twmw== X-Gm-Message-State: ACrzQf1K3Z6ro6XklfVCd6t8ebc+io2r7U2epTORcuUdkNsiAFJZQXWr 8YQ0nc8A9bEQEyerKBMFlDf5uA== X-Google-Smtp-Source: AMsMyM5vL2ulTRUoz5AT4pqfWyo/OobSLrdGK752aiKqO5rXvyIq59Kzqx6ybm/gzZOKRBoeVSllEA== X-Received: by 2002:a05:6214:f6a:b0:4a7:fe99:a39f with SMTP id iy10-20020a0562140f6a00b004a7fe99a39fmr17793442qvb.26.1663649541985; Mon, 19 Sep 2022 21:52:21 -0700 (PDT) Received: from rfd.leadboat.com ([2600:1702:a20:5750::2e]) by smtp.gmail.com with ESMTPSA id a23-20020ac84d97000000b00342fc6a8e25sm238240qtw.50.2022.09.19.21.52.20 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 19 Sep 2022 21:52:21 -0700 (PDT) Date: Mon, 19 Sep 2022 21:52:18 -0700 From: Noah Misch To: Robert Haas Cc: Peter Eisentraut , Nathan Bossart , David Steele , Kyotaro Horiguchi , Fujii Masao , "pgsql-hackers@postgresql.org" Subject: Re: remove more archiving overhead Message-ID: <20220920045218.GA1724802@rfd.leadboat.com> References: <20220708165450.GA2356733@nathanxps13> <20220731065156.GA3694276@rfd.leadboat.com> <20220802050219.GA475090@nathanxps13> <20220803071617.GA3817792@rfd.leadboat.com> <20220917215427.GB3189289@nathanxps13> <20220918071312.GB1658466@rfd.leadboat.com> <7476bc05-3b8d-dab4-64e9-b569c54631d6@enterprisedb.com> <20220919143923.GA1706070@rfd.leadboat.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.24 (2015-08-30) List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk On Mon, Sep 19, 2022 at 12:49:58PM -0400, Robert Haas wrote: > On Mon, Sep 19, 2022 at 10:39 AM Noah Misch wrote: > > I wanted it to stop saying anything like the second paragraph, hence commit > > d263ced. Implementing a proper archiving setup is not especially difficult, > > and inviting the operator to work around a wrong implementation invites > > damaging mistakes under time pressure. > > I agree wholeheartedly with the second sentence. I do think that we > need to be a little careful not to be too prescriptive. Telling people > what they have to do when they don't really have to do it often leads > to non-compliance. It can be more productive to spell out the precise > consequences of non-compliance, so I think Peter's proposal has some > merit. Good point. We could say it from a perspective like, "if you don't do this, your setup will appear to work most of the time, but your operator will be stuck with dangerous manual fixes at times." > On the other hand, I don't see any real problem with the > current language, either. > > Unfortunately, no matter what we do here, it is not likely that we'll > soon be able to eliminate the phenomenon where people use a buggy > home-grown archive_command, both because we've been encouraging that > in our documentation for a very long time, and also because the people > who are most likely to do something half-baked here are probably the > least likely to actually read the updated documentation. True. If I wanted to eliminate such setups, I would make the server double-archive one WAL file each time the archive setup changes.