body { -ms-overflow-style: scrollbar; overflow-y: scroll; overscroll-behavior-y: none; } .errorContainer { background-color: #FFF; color: #0F1419; max-width: 600px; margin: 0 auto; padding: 10%; font-family: Helvetica, sans-serif; font-size: 16px; } .errorButton { margin: 3em 0; } .errorButton a { background: #1DA1F2; border-radius: 2.5em; color: white; padding: 1em 2em; text-decoration: none; } .errorButton a:hover, .errorButton a:focus { background: rgb(26, 145, 218); } .errorFooter { color: #657786; font-size: 80%; line-height: 1.5; padding: 1em 0; } .errorFooter a, .errorFooter a:visited { color: #657786; text-decoration: none; padding-right: 1em; } .errorFooter a:hover, .errorFooter a:active { text-decoration: underline; } #placeholder, #react-root { display: none !important; } body { background-color: #FFF !important; }

JavaScript is not available.

We’ve detected that JavaScript is disabled in this browser. Please enable JavaScript or switch to a supported browser to continue using twitter.com. You can see a list of supported browsers in our Help Center.

Terms of Service Privacy Policy Cookie Policy Imprint Ads info © 2023 Twitter, Inc.

Conversation

This Tweet was deleted by the Tweet author. Learn more

Lgd. Viktor Klang

Many many years aho

@CuriousSkeptic

and I adventured into the realm of UTF-8 decoding. A very interesting observation at the time (which may not be true anymore) was that it really boiled down to making a trade-off between best-case and worst-case performance …

1

Lgd. Viktor Klang

Replying to

and

@CuriousSkeptic

… depending on the distribution of the variability in character encoding length.

1

This Tweet was deleted by the Tweet author. Learn more

Lgd. Viktor Klang

In our case we decided to tackle strlen() tofocus more on the decoding rather than validation. Are there any commonly known techniques for optimal performance regardless of input today?

1

Replying to

and

@CuriousSkeptic

There is this library…

GitHub - simdutf/simdutf: Unicode routines (UTF8, UTF16, UTF32): billions of characters per second...

Unicode routines (UTF8, UTF16, UTF32): billions of characters per second using SSE2, AVX2, NEON, AVX-512. Part of Node.js. - GitHub - simdutf/simdutf: Unicode routines (UTF8, UTF16, UTF32): billion...

12:09 PM · Oct 21, 2021

Andriy Plokhotnyuk

Replying to

and

@CuriousSkeptic

...and its adoption for Java: github.com/AugustNagro/ut

3