Message-ID:
 <SN4P221MB068396C0ED53AA4E1DB9934CF77F2@SN4P221MB0683.NAMP221.PROD.OUTLOOK.COM>
Date: Wed, 9 Oct 2024 11:40:16 -0700
User-Agent: Mozilla Thunderbird
Subject: Re: txid_current vs xact_commit stats
To: "pgsql-general@lists.postgresql.org" <pgsql-general@lists.postgresql.org>
References: <SJ0P221MB06894F3D6D38DE5C61E82B30F77F2@SJ0P221MB0689.NAMP221.PROD.OUTLOOK.COM>
 <fedd43e27a744a8d15dc574d1ba53d4c46b76cf8.camel@cybertec.at>
Content-Language: en-US
From: Eddie Mishler <frio_cervesa@hotmail.com>
In-Reply-To: <fedd43e27a744a8d15dc574d1ba53d4c46b76cf8.camel@cybertec.at>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
MIME-Version: 1.0
X-MS-Exchange-MessageSentRepresentingType: 1
X-MS-PublicTrafficType: Email
X-MS-TrafficTypeDiagnostic: SN4P221MB0683:EE_|LV3P221MB1312:EE_
X-MS-Office365-Filtering-Correlation-Id: f443370f-6cd6-4d7b-1bf6-08dce891d23a
X-Microsoft-Antispam:
	BCL:0;ARA:14566002|461199028|19110799003|15080799006|5072599009|6090799003|7092599003|8060799006|440099028|3412199025;
X-Microsoft-Antispam-Message-Info:
	wqnFfaGU3ssnRxd/2sqsNlkjnrQSxCaPmXhAmMXvrnY4g6jiTrxKrOEGK2TOLBTPUjJ52aPZ8ZkYRq32VyVEWceC0srjpy2R3wkHAlPMdP/CrvaTNegEp84APUOGve+aGkC4dC/ibWXQNGNYeNg4DQC9uwIZiuJ5ckSYGBx0g6C+VsDkwBNTWgI6fjTn+G/uizmqKYL4Xy6mcymo03bdXQdLkHAVuLK22yxu7TDV87bM88n99+84qkcPcdX2PZC24dvFXcR7IRqBU9sXPsXmUFYIZxwiDI+kemR+DmEVAVXxW7IWLR5NgPRBHLIKYOGROdk9lDCXCzB/v7l6l0dEmZC6ukjybNJr52vlvAdQXG/YiFgweE6J7zenVa+8TAoPvb2xhbY5mxqTaOLCECMeZsNP3TjSrE4WALJTGjTC+fHuKNCKevbvQnv543P8Uej9CnXpPGDjYrTjOtXz4zj3g2x0QAltrgdqxchtJfe/fF+1Sl6xUzQ4aboCVRZoww0NfqSwha9p2CBfSSygVq/XYhWxjo0FBy8742IaIP5KlXbwJ68gkz9dr6rPE2AeqIi15TVD4dfyf9ngGXKo7O3Cw/2OW5noFDUmuV7jD3J9ep22foPL4ac6hDag4J0tfqQhETeBXztKTUhOl+oqvCDnbZoeaPJGY2P+uxE2uIOaEnilO6+Lkxj2gR2Abi3phBvCyme4oIMNStZTiB+w7MsplgLJuHBQVVpsxkKF74yXrGUYloC+WGvyX/PVExaTH3boNFDpOveAL744G+oftmtAIg==
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0:
	=?utf-8?B?Sm9saUxOeENYUDBSYVF5YkNGWWNSSE1IOU9kcnZGNEM1V2gzbkNLQVFpZllC?=
 =?utf-8?B?ZVV0MHZBS0R2V213ZXpxNENmZU0rcXNhRktIMHMvRExrU0U0WW1VN3Voa0NS?=
 =?utf-8?B?dU9vdEQwTGQrYTlQbytBWklERGRwUVVTYi9CLzUrWWVHcFRZZzZkTHRTYWhl?=
 =?utf-8?B?MEJ0R1QvV1Jndy85UXBQUG1LWDVMbEZQQnFtckl1Z09rUktGckhJZmNIbE9O?=
 =?utf-8?B?YWN5ekE1c21IS3UyV3lnbnF2UzB0eXRhWGFueHNHdkZoc1pjVVdzdS9Qa3VT?=
 =?utf-8?B?bTZPYjR4SGtqZlh0aDZaRUpHRWM5RGJBZmJyMzFsRXEzMWkxck9uTXI1dnNI?=
 =?utf-8?B?YlZtVndvZ2VtbHJIS214TCtyRnBuZ0ZKOVVqL09zRDByaDJlUjhpSlpDaHUr?=
 =?utf-8?B?bGlkN3JOcy9aOFJ3VWxnUjcvQS8ySWp3cHJBT01tc3crOHltektaSGxJZ0VC?=
 =?utf-8?B?KzV5aWlpd1VnWXNhOVNGVTdGU3lqak9iUlFEVUVMcGFvVlhsYTEzeUV1bk4y?=
 =?utf-8?B?VVpXTGZ3MG1HNjJHY2RXM0E1SkNEeUEvQkhRZndBN3pOWk16ZXVyOFFYNWZW?=
 =?utf-8?B?TjNpRzNabjFlcW9IOHduVWNNWkdUNnlwR0tSSmZkVFJxaXVuVFc2aWZlYkQv?=
 =?utf-8?B?Qk1hQjNEQzVJcVdXR1hLbEdmTVd3RXQyOTRua1kxZFV1bnU4bHVmYnFDTG9X?=
 =?utf-8?B?NUNFc3BzbFRzVDhTZ2ZVNGw0M2hMcUY5TlcxWlF5a1luWkk2RVhaaXRDc2dp?=
 =?utf-8?B?S3N3dXlIRlJ4QlJSQ3NGUnMrdFR0T2NDc2QyZkYwMDlLVE9jY05haGVLZ3ow?=
 =?utf-8?B?dlcvSkh3VkNvbmh2TSt6SEZTdndTUFNuMUtESWZpVmJ4c0ZjTEJvRkc2ZGI0?=
 =?utf-8?B?cEEvN1B1UE0vSlBqdDlOc2R5ZWRrU1RybmtmRnNPNzdsUG81ZDd6dWl3aHcz?=
 =?utf-8?B?dSt2cllhNzMyZmI2dmxjZnF3VVlmb2tnK1JxdHYvTGJxSk9NbjVDN3kzZWk0?=
 =?utf-8?B?cDdMUTdJSU1HMVNNRlRVQmpaemUyZVpGL0pXQUJUS3ZoQ2l1elRRTW1ZVlc1?=
 =?utf-8?B?V1ozcElNSzlOZ3dYTFU3Mk9RVDNTYUVpcGg3YnVJd2REY1JmdC9ZektQVHJz?=
 =?utf-8?B?VU92czlmSFZIM2JNbUsvNUszSUdZV3lTWCs4QVNST0JMZFc1QStSRzJsUWZs?=
 =?utf-8?B?TXBLTk9sR2Y1ZTNBbUZqakk2a2hpL2dBWktwU0NxTTRFMEFxUjR4NklLSkdk?=
 =?utf-8?B?MFg4T1gyZnpqb24rMGJxaUFycW9FZXFvQnRqbUowUDJ6UUw4dmdLYTVpc05B?=
 =?utf-8?B?ZFZLT1M2aHU1MnZwaTJycmRqTXljaUQ0S0ZuZ1MybmdkRG11SXl1MVBZYUJY?=
 =?utf-8?B?eUV2Umttd1c2WnJpZVZjdjZrV2pHYkV0ZVpjcDlLbUtPR2hjNVpKSmZtRGQ2?=
 =?utf-8?B?VDMvTVo4WlVqcGpQOFFZZ2tDcm5iNnNBVnhxdEtMTU5KKytuWWlBWDYrTkI4?=
 =?utf-8?B?ZnlXRnp3RjRocDdwUWt2UXVvMjNvNHpUeW5ZTlFvSGdnbGZGMko0U09rZjM5?=
 =?utf-8?B?Y0NDaUhqeFhVa0ViVmJ4Wm1lSzh2OG9wQVVjVTBXRjNXTFB5dHZZSGNuTzg3?=
 =?utf-8?B?ZWZrcGhZUVEwYWMraHZvc2cyNlVyUEVMVE1tZi9MTFg4REJ4Ynp0NmhHL01z?=
 =?utf-8?Q?ykzNPQE/jDOTZ1hiNu7I?=
X-OriginatorOrg: sct-15-20-7762-17-msonline-outlook-7d150.templateTenant
X-MS-Exchange-CrossTenant-Network-Message-Id: f443370f-6cd6-4d7b-1bf6-08dce891d23a
X-MS-Exchange-CrossTenant-AuthSource: SN4P221MB0683.NAMP221.PROD.OUTLOOK.COM
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 09 Oct 2024 18:40:17.6756
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 84df9e7f-e9f6-40af-b435-aaaaaaaaaaaa
X-MS-Exchange-CrossTenant-RMS-PersistedConsumerOrg:
	00000000-0000-0000-0000-000000000000
X-MS-Exchange-Transport-CrossTenantHeadersStamped: LV3P221MB1312
List-Id: <pgsql-general.lists.postgresql.org>
List-Help: <https://lists.postgresql.org/manage/>
List-Subscribe: <https://lists.postgresql.org/manage/>
List-Post: <mailto:pgsql-general@lists.postgresql.org>
List-Owner: <mailto:pgsql-general-owner@lists.postgresql.org>
List-Archive: <https://www.postgresql.org/list/pgsql-general>
Archived-At: <https://www.postgresql.org/message-id/SN4P221MB068396C0ED53AA4E1DB9934CF77F2%40SN4P221MB0683.NAMP221.PROD.OUTLOOK.COM>
Precedence: bulk


On 10/8/2024 23:39, Laurenz Albe wrote:
> On Wed, 2024-10-09 at 04:22 +0000, senor wrote:
>> I was under the impression that all transactions must end with a commit or a
>> rollback but watching stats doesn't support this. Web searches tend to return
>> info on what a transaction is or the ratio of commits to rollbacks. I found
>> nothing contradicting what I think I know.
> The rollback can be implicit, for example when you terminate the connection or
> crash the server...
>
> Also, PostgreSQL has autocommit, so every data modifying statement that's not
> in an explicit transaction will implicitly commit at the end of the statement.
This part I'm aware of but I assume whether implicit or explicit it 
would show up in the stats I'm monitoring.
>> I've sampled pg_stat_database.xact_commit, pg_stat_database.xact_rollback and
>> txid_current() at intervals on a few independent clusters and see that commits
>> increase anywhere from 50% to 300% of the rate of transaction increase. Rollback
>> remains very near zero for all clusters. Each cluster tends to stay consistently
>> within a range (i.e. 120-130% or 50-70%).
> Perhaps what I wrote above explains that.
How is it that I'm seeing more commits than transactions? I thought I 
should see something as simple as commits + rollbacks = transactions.  
In some cases I'm seeing 3 times as many commits. I'm not aware of 
multiple commits possible per transaction or commits without a 
transaction.  There doesn't seem to be a problem other than my 
understanding.
>> PG version 11 & 12 on Linux
> That's too old.
100% agree.
> Yours,
> Laurenz Albe

Thank you Laurenz for the response. Your replies to my previous posts 
helped to identify there is an ongoing issue with the stats collection 
in some clusters. I'm looking forward to an upgrade to PG v16 to manage 
that.  This current question came up while looking into that but I don't 
think it's involved.

Thanks,

Senor