MIME-Version: 1.0
References: <cb014f00-66b2-4328-a65e-d11c681c9f45@gmail.com>
 <CAEvyyTj0rEsgcQOQgkARbRPbupHR_mc=TUzHBBLNzd8JByUUTw@mail.gmail.com>
 <4c1d0b97-a5f8-472c-afdd-bdeb09b93f33@gmail.com>
 <OS9PR01MB12149A6CEE200E1A5A88D9F14F563A@OS9PR01MB12149.jpnprd01.prod.outlook.com>
 <CAEvyyTiQqd=rv3XUxc0YEaW-feopksBveZKKjVZNeSVG=GrY+A@mail.gmail.com>
 <TYRPR01MB121560B291DA3CD262CC7A09AF568A@TYRPR01MB12156.jpnprd01.prod.outlook.com>
 <CAEvyyTjPWfvJLn3c_G_zLRffZ3=YqzMYj6c5znaNxpHyZAg3XQ@mail.gmail.com>
 <10868918-cdf9-49dc-99af-8e8ccd6e368c@gmail.com>
 <CAEvyyTircZ-tHgap=J6Aog0CBgXp4Dqx6dHYyK1iqgfoT+8D_A@mail.gmail.com>
 <eb80b601-7600-4fa1-8b99-550d40c1745b@iki.fi>
 <ddca6fbd-1e99-4756-8b02-38f7962d464d@gmail.com>
 <OS9PR01MB12149E0E2CAAB378D264A35B1F5242@OS9PR01MB12149.jpnprd01.prod.outlook.com>
 <4eca7d9b-c611-4f1e-8eaf-67724484e3bc@gmail.com>
In-Reply-To: <4eca7d9b-c611-4f1e-8eaf-67724484e3bc@gmail.com>
From: lakshmi <lakshmigcdac@gmail.com>
Date: Sat, 9 May 2026 13:32:44 +0530
Message-ID: 
 <CAEvyyTgbQWO9aFtAB+T6O_wHpuwnGGbOUp7qzM8Gjt+mBwAXCw@mail.gmail.com>
Subject: Re: parallel data loading for pgbench -i
To: Mircea Cadariu <cadariu.mircea@gmail.com>
Cc: "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>,
	PostgreSQL Hackers <pgsql-hackers@lists.postgresql.org>,
 "tomas@vondra.me" <tomas@vondra.me>,
	Heikki Linnakangas <hlinnaka@iki.fi>
Content-Type: multipart/alternative; boundary="00000000000015176706515df3e5"
Archived-At: 
 <https://www.postgresql.org/message-id/CAEvyyTgbQWO9aFtAB%2BT6O_wHpuwnGGbOUp7qzM8Gjt%2BmBwAXCw%40mail.gmail.com>
Precedence: bulk

--00000000000015176706515df3e5
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

On Fri, May 8, 2026 at 11:41=E2=80=AFPM Mircea Cadariu <cadariu.mircea@gmai=
l.com>
wrote:

> Hi Lakshmi and Hayato,
>
>
> Thanks a lot for your feedback.
>
> Attached for your consideration is v4, in which I address your remarks.
>
Hi Mircea, Hayato,

I tested the v4 patch on 19devel with a few different thread/partition
combinations.

The updated API looks much better now. I verified that:

   - parallel loading works correctly with -j
   - uneven partition distribution (for example 5 partitions with 2
   threads) also works fine
   - serial mode with -j 1 works again as expected

The workers appear to run concurrently, and VACUUM time remains relatively
small in my tests.

Overall, the new approach looks much cleaner and more flexible compared to
the earlier versions.

Thanks again for the update.

Best regards,
Lakshmi

--00000000000015176706515df3e5
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div dir=3D"ltr"><br></div><br><div class=3D"gmail_quote g=
mail_quote_container"><div dir=3D"ltr" class=3D"gmail_attr">On Fri, May 8, =
2026 at 11:41=E2=80=AFPM Mircea Cadariu &lt;<a href=3D"mailto:cadariu.mirce=
a@gmail.com">cadariu.mircea@gmail.com</a>&gt; wrote:<br></div><blockquote c=
lass=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px soli=
d rgb(204,204,204);padding-left:1ex">Hi Lakshmi and Hayato,<br>
<br>
<br>
Thanks a lot for your feedback.<br>
<br>
Attached for your consideration is v4, in which I address your remarks.<br>=
</blockquote><p class=3D"gmail-isSelectedEnd">Hi Mircea, Hayato,</p><p clas=
s=3D"gmail-isSelectedEnd">I tested the v4 patch on 19devel with a few diffe=
rent thread/partition combinations.</p><p class=3D"gmail-isSelectedEnd">The=
 updated API looks much better now. I verified that:</p><ul><li>parallel lo=
ading works correctly with <code dir=3D"ltr">-j</code></li><li>uneven parti=
tion distribution (for example 5 partitions with 2 threads) also works fine=
</li><li>serial mode with <code dir=3D"ltr">-j 1</code> works again as expe=
cted</li></ul><p class=3D"gmail-isSelectedEnd">The workers appear to run co=
ncurrently, and VACUUM time remains relatively small in my tests.</p><p cla=
ss=3D"gmail-isSelectedEnd">Overall, the new approach looks much cleaner and=
 more flexible compared to the earlier versions.</p><p class=3D"gmail-isSel=
ectedEnd">Thanks again for the update.</p><p>Best regards,<br></p><div>Laks=
hmi=C2=A0</div></div></div>

--00000000000015176706515df3e5--