Also on HN today so feel free to comment there:https://twitter.com/hn_frontpage/status/1216764355263565825 …
-
-
Prikaži ovu nitHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi
-
-
-
I'm getting HTTP 403 from S3 when installing from npm on Mac: Error: 403 status code downloading tarball https://tokenizers-releases.s3.amazonaws.com/node/0.2.2/index-v0.2.2-node-v64-darwin-x64-unknown.tar.gz … Any idea for workaround?
-
Please use nvm to make sure your node version is 12.x, and we’ll add support to other nodes very soon
- Još 2 druga odgovora
Novi razgovor -
-
-
can't wait to play with this! waiting for tokenization to happen is death by a thousand cuts
Congrats to the @huggingface team!Hvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi
-
-
-
Great! Any plans on supporting language-aware "pre-tokenization", i.e., reading ==> read + ing shoes ==> shoe + s deconstructed ==> de + construct + ed
-
This is lemmatization, distinct from tokenisation.
- Još 1 odgovor
Novi razgovor -
-
-
Check this out
@rubensancor@aialmeidaHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi
-
-
-
Old school tokenization too or just BPE/wordpiece-style?
Hvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi
-
-
-
How did you choose Rust? Unfortunately at Google we don't support it internally.
Hvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi
-
-
-
Hvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi
-
Čini se da učitavanje traje već neko vrijeme.
Twitter je možda preopterećen ili ima kratkotrajnih poteškoća u radu. Pokušajte ponovno ili potražite dodatne informacije u odjeljku Status Twittera.
. Natural language processing, Prob languages, Transfer learning.
Introducing Tokenizers: ultra-fast, extensible tokenization for state-of-the-art NLP 
