agora inbox for pgsql-hackers@postgresql.org
help / color / mirror / Atom feedFrom: Nathan Bossart <nathandbossart@gmail.com>
To: Manni Wood <manni.wood@enterprisedb.com>
Cc: Nazir Bilal Yavuz <byavuz81@gmail.com>
Cc: KAZAR Ayoub <ma_kazar@esi.dz>
Cc: Neil Conway <neil.conway@gmail.com>
Cc: Andrew Dunstan <andrew@dunslane.net>
Cc: Shinya Kato <shinya11.kato@gmail.com>
Cc: PostgreSQL-development <pgsql-hackers@postgresql.org>
Subject: Re: Speed up COPY FROM text/CSV parsing using SIMD
Date: Fri, 13 Mar 2026 10:00:23 -0500
Message-ID: <abQmh6W9bq-JBoYt@nathan> (raw)
In-Reply-To: <CAKWEB6pMbdMDvhfaX1Z0eSULVQFYhEhssaRHdOxAX_5OYubxKw@mail.gmail.com>
References: <abBQbdFa6OsG8TGu@nathan>
<CAN55FZ3jXs7XDsP_-v_jUBquRu4uAdheN3xcmW=WhAyKwFLSjg@mail.gmail.com>
<abGv0ScUWVa6eogw@nathan>
<CAN55FZ3gdK8dGrEo0M6KFW97OaF8TUbjO_dFoxQKi63davE-jA@mail.gmail.com>
<abG8R6HkOHyUuyWb@nathan>
<CAN55FZ0yfETy4UEA5rOJ9S06JSOtiWF8TW_+yi3yjVAcrLqKLA@mail.gmail.com>
<abHTvkeIK37hj9oS@nathan>
<CAN55FZ1sn-2tVX_n9C5UNBCfDPjSDOCT4zkMeDsB7MaZ9SUBTw@mail.gmail.com>
<abL5ylYjmopRRmvy@nathan>
<CAKWEB6pMbdMDvhfaX1Z0eSULVQFYhEhssaRHdOxAX_5OYubxKw@mail.gmail.com>
On Thu, Mar 12, 2026 at 09:39:38PM -0500, Manni Wood wrote:
> I found some time this evening to run some benchmarks using your v15 patch.
> I hope these help.
Thanks!
> x86 NARROW v15 default_toast_compression = lz4
> TXT : 26019.629000 ms 0.347215% improvement
> CSV : 26379.889000 ms 5.526984% improvement
> TXT with 1/3 escapes: 28865.322750 ms -3.147600% regression
> CSV with 1/3 quotes: 33218.293250 ms 3.399359% improvement
> x86 NARROW v15 default_toast_compression = pglz
> TXT : 26438.415000 ms -0.128382% regression
> CSV : 26869.718000 ms 4.509804% improvement
> TXT with 1/3 escapes: 29379.299750 ms -4.610819% regression
> CSV with 1/3 quotes: 33371.390250 ms 3.278908% improvement
Those 3-5% regressions are interesting, but given there are similar
"improvements" for the surrounding cases, I'm going to consider them as
noise for now and proceed with the patch. If folks feel strongly about
digging deeper here, I'm happy to revisit the subject.
--
nathan
view thread (178+ messages) latest in thread
Message-ID: <abQmh6W9bq-JBoYt@nathan>
Permalink: ../abQmh6W9bq-JBoYt@nathan/
Also on: postgresql.org/message-id/abQmh6W9bq-JBoYt@nathan
reply
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-hackers@postgresql.org
Cc: nathandbossart@gmail.com, manni.wood@enterprisedb.com, byavuz81@gmail.com, ma_kazar@esi.dz, neil.conway@gmail.com, andrew@dunslane.net, shinya11.kato@gmail.com
Subject: Re: Speed up COPY FROM text/CSV parsing using SIMD
In-Reply-To: <abQmh6W9bq-JBoYt@nathan>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox