MIME-Version: 1.0
References: 
 <CAOzEurSW8cNr6TPKsjrstnPfhf4QyQqB4tnPXGGe8N4e_v7Jig@mail.gmail.com>
 <CAN55FZ247JdiT8Sd1SRiyOJxk3Ei=pDCL4kpdP=HqLRjOhKf1Q@mail.gmail.com>
 <CAN55FZ2AxiwSah7TiQoMB==r=JKT0bOtooCB7ov4xRrGkVmJ1A@mail.gmail.com>
 <CAOzEurR5nFt=-SijfU7y0BHVcrT6RG9ovvdVfKt_uBZfEQew9w@mail.gmail.com>
 <CAOzEurSqgA69er9SzhPnXwmsVpO7-piUOuOy3dXcHOi__nSQcg@mail.gmail.com>
 <CA+K2RumC79NwWxBdofHOYo8SCSs0YCJic05Du=xOszRmoPf9FA@mail.gmail.com>
 <CAN55FZ0houfWHn8_MEEefhprZvc33jr07GrBYo+Bp2yw=TVnKA@mail.gmail.com>
 <CA+K2Ru=jHuz_Wpgar4Sobtxeb33qxx=o59ToOhZ=vpmkMqErnA@mail.gmail.com>
 <CAN55FZ1J+6eM=F5GreWEBMJcNV_gifYyYY1b6xpYzun=nWPhMQ@mail.gmail.com>
 <CAN55FZ109W90Ux_EBEqkkU2TyNqBNhdhN_1XPRGo3iiZ2L9b=A@mail.gmail.com>
 <8615c983-1662-43b4-b0c9-49d194ac33aa@dunslane.net>
 <CAN55FZ1KF7XNpm2XyG=M-sFUODai=6Z8a11xE3s4YRBeBKY3tA@mail.gmail.com>
 <CA+K2RunFNDMxCWMX3PFSBa_r6REVwfEekaKHwg1C8KYYGePsnA@mail.gmail.com>
 <CAN55FZ3e31ddFyf7XHW5G3ytuQwcXpetsb3wkx6q9oSp_zekhQ@mail.gmail.com>
 <CA+K2RumH-b=3-v0rfQ-oAbuQFxY8JLSSpVhmaJn+gRnX3t1_vg@mail.gmail.com>
In-Reply-To: 
 <CA+K2RumH-b=3-v0rfQ-oAbuQFxY8JLSSpVhmaJn+gRnX3t1_vg@mail.gmail.com>
From: KAZAR Ayoub <ma_kazar@esi.dz>
Date: Tue, 21 Oct 2025 08:44:06 +0200
Message-ID: 
 <CA+K2RunC5qD4ZM8cTmzEADgobsjf+pC-nQwB+nu5_u1YHa6isw@mail.gmail.com>
Subject: Re: Speed up COPY FROM text/CSV parsing using SIMD
To: Nazir Bilal Yavuz <byavuz81@gmail.com>, nathandbossart@gmail.com,
 ants.aasma@cybertec.at
Cc: Andrew Dunstan <andrew@dunslane.net>,
 Shinya Kato <shinya11.kato@gmail.com>,
	Pg Hackers <pgsql-hackers@postgresql.org>
Content-Type: multipart/alternative; boundary="00000000000074b3a50641a587c4"
Archived-At: 
 <https://www.postgresql.org/message-id/CA%2BK2RunC5qD4ZM8cTmzEADgobsjf%2BpC-nQwB%2Bnu5_u1YHa6isw%40mail.gmail.com>
Precedence: bulk

--00000000000074b3a50641a587c4
Content-Type: text/plain; charset="UTF-8"

On Tue, Oct 21, 2025, 8:17 AM KAZAR Ayoub <ma_kazar@esi.dz> wrote:

>
> Currently we are at 200-400Mbps which isn't that terrible compared to
> production and non production grade parsers (of course we don't only parse
> in our case), also we are using SSE2 only so theoretically if we add
> support for avx later on we'll have even better numbers.
> Maybe more micro optimizations to the current heuristic can squeeze it
> more.
>
>
> [1]
> https://branchfree.org/2019/03/06/code-fragment-finding-quote-pairs-with-carry-less-multiply-pclmulqdq/
> [2]
> https://github.com/AyoubKaz07/postgres/commit/73c6ecfedae4cce5c3f375fd6074b1ca9dfe1daf
> [3] https://agner.org/optimize/instruction_tables.pdf
> [4] https://www.uops.info/table.html
>
> Regards,
> Ayoub Kazar.
>
Sorry, I meant 200-400MB/s.


Regards.
Ayoub Kazar.

>

--00000000000074b3a50641a587c4
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"auto"><div><br><br><div class=3D"gmail_quote gmail_quote_contai=
ner"><div dir=3D"ltr" class=3D"gmail_attr">On Tue, Oct 21, 2025, 8:17 AM KA=
ZAR Ayoub &lt;<a href=3D"mailto:ma_kazar@esi.dz">ma_kazar@esi.dz</a>&gt; wr=
ote:<br></div><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;=
border-left:1px #ccc solid;padding-left:1ex"><div dir=3D"ltr"><div dir=3D"l=
tr"><div dir=3D"ltr"><br></div><div class=3D"gmail_quote"><div>Currently we=
 are at 200-400Mbps which isn&#39;t that terrible compared to production an=
d non production grade parsers (of course we don&#39;t only parse in our ca=
se), also we are using SSE2 only so theoretically if we add support for avx=
 later on we&#39;ll have even better numbers.<br></div><div>Maybe more micr=
o optimizations to the current heuristic can squeeze it more.</div><div><br=
></div><div><br>[1] <a href=3D"https://branchfree.org/2019/03/06/code-fragm=
ent-finding-quote-pairs-with-carry-less-multiply-pclmulqdq/" target=3D"_bla=
nk" rel=3D"noreferrer">https://branchfree.org/2019/03/06/code-fragment-find=
ing-quote-pairs-with-carry-less-multiply-pclmulqdq/<br></a>[2] <a href=3D"h=
ttps://github.com/AyoubKaz07/postgres/commit/73c6ecfedae4cce5c3f375fd6074b1=
ca9dfe1daf" target=3D"_blank" rel=3D"noreferrer">https://github.com/AyoubKa=
z07/postgres/commit/73c6ecfedae4cce5c3f375fd6074b1ca9dfe1daf</a></div><div>=
[3]=C2=A0<a href=3D"https://agner.org/optimize/instruction_tables.pdf" targ=
et=3D"_blank" rel=3D"noreferrer">https://agner.org/optimize/instruction_tab=
les.pdf</a></div><div>[4]=C2=A0<a href=3D"https://www.uops.info/table.html"=
 target=3D"_blank" rel=3D"noreferrer">https://www.uops.info/table.html</a><=
/div><div><br></div><div>Regards,<br></div><div>Ayoub Kazar.</div></div></d=
iv></div></blockquote></div></div><div dir=3D"auto">Sorry, I meant 200-400M=
B/s.</div><div dir=3D"auto"><br></div><div dir=3D"auto"><br></div><div dir=
=3D"auto">Regards.</div><div dir=3D"auto">Ayoub Kazar.</div><div dir=3D"aut=
o"><div class=3D"gmail_quote gmail_quote_container"><blockquote class=3D"gm=
ail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-le=
ft:1ex"><div dir=3D"ltr">
</div>
</blockquote></div></div></div>

--00000000000074b3a50641a587c4--