I want to create a publishable and useful regex benchmark. I think making a good one is probably impossible. But people are trying anyway, and I think it's possible to at least make one that is better than what exists today when you search for "regex benchmark."
-
-
What's your regex bias?
-
Just what I mentioned? One of the regex engines being benchmarked would be my own.
- 2 more replies
New conversation -
-
-
Are there existing regex test cases from other engines that you could incorporate, so that you're not creating all of them? Are there known cases that your regex engine doesn't handle well (or at all), that you could consciously include anyway for completeness?
-
The second one is easy: the answer is yes. And indeed, is true for all regex engines I know about! The existing regex benchmark suite even has them. The first one is a great idea. Surveying regex engine benchmark suites would be a good idea. Still could be selection bias though!
End of conversation
New conversation -
-
-
What do you want the benchmark to accomplish, specifically? In my mind, it would help users understand which libraries make which fundamental tradeoffs (or, maybe pessimistically, which libraries fail to make any tradeoffs). If not that, then what?
-
Yes, that sounds like a start. It could help people understand why and which regexes are faster. Generally when I publish benchmarks, that also means attaching some kind of edification or analysis to it.
End of conversation
New conversation -
-
-
I think stating your bias at the beginning and then clearly outlining the method used and most importantly why really gets you a long way.
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
Id say embrace it. It drives others to create their own ones making their favorite regex look better, at which point you bring in their tests to build your one out and keep going.
-
Incidentally that shows you to be the thought leader in it as well. Especially since everyone starts comparing themselves to what you have done only reinforcing it in everyone else's mind.
End of conversation
New conversation -
-
This Tweet is unavailable.
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.