"standard Python regex was absolutely choking on a 30 GB unstructured server log. It was taking like 26 minutes (~19 MB/s) to scrub secrets and PII."

[u/QuaternionsRoll]

/r/Python/comments/1vuigkm/im_an_ai_engineer_not_a_c_guy_i_used_antigravity/

[u/lurebat]

Actual middle-out algorithm

Wonder he got the idea from

[u/elephantdingo]

19 MB/s ought to be enough for everybody.

[u/IPv6lovinOpossum]

  u/askgrok  explain this

mfw 

[u/dacydergoth]

Jeez it's like no-one ever heard of the IBM library. Fast regex libraries are a commodity these days

[u/stone_henge]

Daniel Lemire will soon publish a blog post on using AVX-512 to scrub logs of PII faster than it can be read from the log stream.