From: Benoit Lobréau <benoit.lobreau@dalibo.com>
To: Amit Kapila <amit.kapila16@gmail.com>
To: Masahiko Sawada <sawada.mshk@gmail.com>
Cc: Zhijie Hou (Fujitsu) <houzj.fnst@fujitsu.com>
Cc: Shlok Kyal <shlok.kyal.oss@gmail.com>
Cc: vignesh C <vignesh21@gmail.com>
Cc: Nitin Motiani <nitinmotiani@google.com>
Cc: Andres Freund <andres@anarazel.de>
Cc: PostgreSQL Hackers <pgsql-hackers@lists.postgresql.org>
Subject: Re: long-standing data loss bug in initial sync of logical replication
Date: Fri, 28 Feb 2025 09:28:13 +0100
Message-ID: <2e2b2aba-c285-4bfc-a3bd-c55ac2df9568@dalibo.com> (raw)
In-Reply-To: <CAA4eK1LZFthizh6LOy7D2-5Kf7vrMJfUqkV3AcYZN0CagCEVJg@mail.gmail.com>
References: <CAD21AoDoWc8MWTyKtmNF_606bcW6J0gV==r=VmPXKUN-e3o9ew@mail.gmail.com>
<CAA4eK1KDPryBr-ewsW_Rkh5x0oiqpcOHAF3GAocDUrK2CV+atA@mail.gmail.com>
<OS0PR01MB5716C54EE863184A35C735DE94CD2@OS0PR01MB5716.jpnprd01.prod.outlook.com>
<CAD21AoBcOkeBgx_c9XXWgjw1YW8KUc9dNtg8XaPY2Q2Vwq7WgQ@mail.gmail.com>
<CAA4eK1+ubqorurkbWOtpbEd2Vc8QZ_vmUHY3mFgL1fp_1+wK=g@mail.gmail.com>
<CAA4eK1LZFthizh6LOy7D2-5Kf7vrMJfUqkV3AcYZN0CagCEVJg@mail.gmail.com>
Hi,
It took me a while but I ran the test on my laptop with 20 runs per
test. I asked for a dedicated server and will re-run the tests if/when I
have it.
count of partitions | Head (sec) | Fix (sec) | Degradation (%)
----------------------------------------------------------------------
1000 | 0,0265 | 0,028 | 5,66037735849054
5000 | 0,091 | 0,0945 | 3,84615384615385
10000 | 0,1795 | 0,1815 | 1,11420612813371
Concurrent Txn | Head (sec) | Patch (sec) | Degradation in %
---------------------------------------------------------------------
50 | 0,1797647 | 0,1920949 | 6,85907744957
100 | 0,3693029 | 0,3823425 | 3,53086856344
500 | 1,62265755 | 1,91427485 | 17,97158617972
1000 | 3,01388635 | 3,57678295 | 18,67676928162
2000 | 7,0171877 | 6,4713304 | 8,43500897435
I'll try to run test2.pl later (right now it fails).
hope this helps.
--
Benoit Lobréau
Consultant
http://dalibo.comAttachments:
[application/vnd.oasis.opendocument.spreadsheet] cache_inval_bug_v1.ods (30.7K, ../2e2b2aba-c285-4bfc-a3bd-c55ac2df9568@dalibo.com/2-cache_inval_bug_v1.ods)
download
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-hackers@postgresql.org
Cc: benoit.lobreau@dalibo.com, amit.kapila16@gmail.com, sawada.mshk@gmail.com, houzj.fnst@fujitsu.com, shlok.kyal.oss@gmail.com, vignesh21@gmail.com, nitinmotiani@google.com, andres@anarazel.de, pgsql-hackers@lists.postgresql.org
Subject: Re: long-standing data loss bug in initial sync of logical replication
In-Reply-To: <2e2b2aba-c285-4bfc-a3bd-c55ac2df9568@dalibo.com>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox