pg.ddx.io  pgsql-hackers@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Tom Lane <tgl@sss.pgh.pa.us>
To: Joel Jacobson <joel@compiler.org>
Cc: pgsql-hackers@lists.postgresql.org
Subject: Re: Some regular-expression performance hacking
Date: Sat, 13 Feb 2021 12:35:45 -0500
Message-ID: <1662033.1613237745@sss.pgh.pa.us> (raw)
In-Reply-To: <85140bfb-516c-449b-8a03-7930abb42b88@www.fastmail.com>
References: <1340281.1613018383@sss.pgh.pa.us>
	<85140bfb-516c-449b-8a03-7930abb42b88@www.fastmail.com>

"Joel Jacobson" <joel@compiler.org> writes:
> In total, I scraped the first-page of some ~50k websites,
> which produced 45M test rows to import,
> which when GROUP BY pattern and flags was reduced
> down to 235k different regex patterns,
> and 1.5M different text string subjects.

This seems like an incredibly useful test dataset.
I'd definitely like a copy.

> No is_match differences were detected, good!

Cool ...

> However, there were 23 cases where what got captured differed:

I shall take a closer look at that.

Many thanks for doing this work!

			regards, tom lane





view thread (38+ messages)  latest in thread

Message-ID: <1662033.1613237745@sss.pgh.pa.us>
Permalink:  ../1662033.1613237745@sss.pgh.pa.us/
Also on:    postgresql.org/message-id/1662033.1613237745@sss.pgh.pa.us

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-hackers@postgresql.org
  Cc: tgl@sss.pgh.pa.us, joel@compiler.org, pgsql-hackers@lists.postgresql.org
  Subject: Re: Some regular-expression performance hacking
  In-Reply-To: <1662033.1613237745@sss.pgh.pa.us>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox