Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1my5Os-0005I5-3Y for pgsql-hackers@arkaria.postgresql.org; Fri, 17 Dec 2021 05:03:22 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1my5Or-0007xm-0u for pgsql-hackers@arkaria.postgresql.org; Fri, 17 Dec 2021 05:03:21 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1my5Oq-0007xd-Mh for pgsql-hackers@lists.postgresql.org; Fri, 17 Dec 2021 05:03:20 +0000 Received: from mail-pl1-x636.google.com ([2607:f8b0:4864:20::636]) by makus.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.92) (envelope-from ) id 1my5Ok-0003Ej-4L for pgsql-hackers@lists.postgresql.org; Fri, 17 Dec 2021 05:03:19 +0000 Received: by mail-pl1-x636.google.com with SMTP id x15so467288plg.1 for ; Thu, 16 Dec 2021 21:03:13 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=date:message-id:to:cc:subject:from:in-reply-to:references :user-agent:mime-version:content-transfer-encoding; bh=lz8ZmlQ18pC8FNohVSCgtv2hEeL8MPObuZZ34ssHPdc=; b=VAoGvUzm61k75YnEnELxKV+qdr4799oTJjPpmigx+TmGK412YTPPe0gCD7a9680p7w TwOY+xLVSL4jX2CzYqfmi407LoGU87GnNqYyKVJW2J6xnjYts1EpFcGAV7GgzmuSi1M8 qpxJj5q4cPCM4aYt6VzXBJpRwQ/GAzFS+JeI3LkgljCzTBqxVUQoyViaIWmOpYFRbfx3 X9ko+vqxkEXgPhb9FvoLZb8afwZrNHiPOoMQwnlpm/WKeq4T+oZSsrE1ruTZfKWdqreN CUs+5uFUsgEM1mIIM16SWdFVlHAWva6LS3qIeVpC2AqZKiOnFgxS52Wf6sPx/w5pZANI vkKg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:date:message-id:to:cc:subject:from:in-reply-to :references:user-agent:mime-version:content-transfer-encoding; bh=lz8ZmlQ18pC8FNohVSCgtv2hEeL8MPObuZZ34ssHPdc=; b=joXIymPZET0rf55XX8zD3A8sQsA/OOt9IRNvqoel7Er0CWZUTGEx4NyD+gmYAte6nv kjS06CIyNNUuUPzx5SGRHJKbFla+eGeGudkL6tVQ9vIxB/oYNU6ZjqfYomN5DPMmS5nW 8nJohHp+I/na11mXPEZ+YOZ5DqBGhwAuoXdES1KRn3YmkpfWB40lpqOcY9/ZEIFCbMYl vtHjXCdb8mUwT4Iv/Za4n5CBef9tuky1RTgnZBc413eYDlmYkhvmfr3665aHf51LPKm5 E+2Qni3o0DPNeq0uXGlF4zRJ2ZD85wbbAFiYg32kVVJgXvbus7Cd1j9VYq/bOK9YW/xi HcmA== X-Gm-Message-State: AOAM532ZexKeeXR+GNibwjNKGfyK9GIKVNQgugtgbR2iOoGNXzKw7BLo NZaKp0gZoiTXrAzkeX5T0xA= X-Google-Smtp-Source: ABdhPJwX+iUOrvEFOyGsmD5zeHWBaE1uPOPlAKxEpoq007WjMThmbVaGJ1bqMGm5mwT2hXCx/2rqlg== X-Received: by 2002:a17:90b:4b03:: with SMTP id lx3mr1830526pjb.18.1639717392877; Thu, 16 Dec 2021 21:03:12 -0800 (PST) Received: from localhost (KD036014041111.ppp-bb.dion.ne.jp. [36.14.41.111]) by smtp.gmail.com with ESMTPSA id g17sm6775718pgh.46.2021.12.16.21.03.10 (version=TLS1_3 cipher=TLS_CHACHA20_POLY1305_SHA256 bits=256/256); Thu, 16 Dec 2021 21:03:12 -0800 (PST) Date: Fri, 17 Dec 2021 14:03:09 +0900 (JST) Message-Id: <20211217.140309.1173685089580065514.horikyota.ntt@gmail.com> To: osumi.takamichi@fujitsu.com Cc: vignesh21@gmail.com, amit.kapila16@gmail.com, sawada.mshk@gmail.com, gregn4422@gmail.com, houzj.fnst@fujitsu.com, pgsql-hackers@lists.postgresql.org Subject: Re: Failed transaction statistics to measure the logical replication progress From: Kyotaro Horiguchi In-Reply-To: References: User-Agent: Mew version 6.8 on Emacs 26.1 Mime-Version: 1.0 Content-Type: Text/Plain; charset=us-ascii Content-Transfer-Encoding: 7bit List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk At Thu, 16 Dec 2021 11:36:46 +0000, "osumi.takamichi@fujitsu.com" wrote in > On Thursday, December 16, 2021 4:00 PM I wrote: > > Thank you, everyone for confirming the direction. > > I'll follow the consensus of the community and fix the patch, including other > > comments. > > I'll treat only the stats for apply workers. > Hi, created a new version v17 according to the recent discussion > with changes to address other review comments. > > Kindly have a look at it. It sends stats packets at every commit-like operation on apply workers. The current pgstat is so smart that it refrain from sending stats packets at too high frequency. We already suffer frequent stats packets so apply workers need to bahave the same way. That is, the new stats numbers are once accumulated locally then the accumulated numbers are sent to stats collector by pgstat_report_stat. regards. -- Kyotaro Horiguchi NTT Open Source Software Center