Tweetovi
- Tweetovi, trenutna stranica.
- Tweetovi i odgovori
- Medijski sadržaj
Blokirali ste korisnika/cu @Smerity
Jeste li sigurni da želite vidjeti te tweetove? Time nećete deblokirati korisnika/cu @Smerity
-
Prikvačeni tweet
Introducing the SHA-RNN :) - Read alternative history as a research genre - Learn of the terrifying tokenization attack that leaves language models perplexed - Get near SotA results on enwik8 in hours on a lone GPU No Sesame Street or Transformers allowed. https://arxiv.org/abs/1911.11423 pic.twitter.com/RN5TPZ3xWH
Hvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
Smerity proslijedio/la je Tweet
Thread
We’ve also had a difficult time with CuDNN as soon as you want to go beyond a basic LSTM and grab cell states, do @yaringal-style dropout, etc. Maybe now that@NvidiaAI has an#NLProc team, things might get better?https://twitter.com/smerity/status/1223366023442644992 …Hvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
Having said that: - I'm all for giving Taika Waititi hold over the Star Wars universe - The Mandalorian is a refreshing take on the Samurai Western elements - Rogue One gave me the same awe upon seeing the Death Star tower as I'm certain Episode 4 audiences had A New Hope/s ;)
Prikaži ovu nitHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
Knives Out was perfect, go see it. The new Jumanjis are a fun addition to the series. In comparison, I watched the original Star Wars trilogy nearly daily as a child yet read the leaked synopsis for Ep 9 as it'd make watching the disaster unfold in cinema less frustrating :(
Prikaži ovu nitHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
At my local cinema: - Knives Out (released: Nov 27th, 2019) has 4 showtimes - Jumanji The Next Level (Dec 13th 2019) has 4 showtimes - Star Wars Rise of Skywalker (Dec 20th 2019) has 3 showtimes Star Wars Ep 4 started in ~40 theatres, expanded to 1700+, screened for 44 weeks.
Prikaži ovu nitHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
For a link to the PyTorch JIT example, which shows brilliant work but I just wasn't able to convert it into a working solution after trying to work through the code (i.e. not really working result + slower than cuDNN - but maybe all my fault!): https://pytorch.org/blog/optimizing-cuda-rnn-with-torchscript/ …pic.twitter.com/VJYWKeMYZp
Prikaži ovu nitHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
Even in self-attention you need fancy tricks to be able to perform certain optimizations, such as reversible layers, in a way that's supported and gets maximal advantage from the framework. I'm glad that JAX exists for such cases!
Prikaži ovu nitHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
The blackbox style of existing RNN implementations mean even simple modifications such as recovering the hidden state, rather than the output, at each timestep is difficult. One of the biggest advantages of non-recurrent self attention is that the tooling is already sufficient.
Prikaži ovu nitHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
Hvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi
-
To note: this isn't necessarily tragedy for open innovation. Both VCs and BigCo make the majority of returns from a short tail of success. VCs can fund from {private capital, IPOs, BigCo returns via acquisitions} to give "externalized R&D" an opportunity and a fate of its own.
Prikaži ovu nitHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
Related curiosity: how much of the ~$200 billion in venture capital raised in the past few years, converted by start-ups to innovation, will end up in {Facebook, Google, Amazon, ...} hands? In some ways VC is like externalized R&D subsidized by a gambling community.https://twitter.com/eliotwb/status/1222607348755120128 …
Prikaži ovu nitHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
Smerity proslijedio/la je Tweet
Fascinating to compare the half-life of content across platforms (time it takes for a piece of content to reach 50% of its total lifetime engagement)
Twitter: 20 mins
Facebook: 5 hrs
Instagram: 20 hrs
LinkedIn: 24 hrs
YouTube: 20 days
Pinterest: 4 mos
Blog post: 2 yrsPrikaži ovu nitHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
Smerity proslijedio/la je Tweet
We tie 6 strongly simplified RNN layers in a CPU-optimized transformer hybrid with very little quality loss. Been doing that for two years now in production, wrote about it only now :)https://www.aclweb.org/anthology/D19-5632/ …
Hvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
The QRNN was used in "Multi-task self-supervised learning for Robust Speech Recognition" =]https://twitter.com/mirco_ravanelli/status/1222180709495967745 …
Hvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
Smerity proslijedio/la je Tweet
Interesting to hear of folks getting better results from ULMFiT / AWD-LSTM and fastai2 vs BERT/transformer based models. Anyone else tried comparing these? cc
@Smerity@seb_ruder https://forums.fast.ai/t/fastai-v2-chat/53518/638 …pic.twitter.com/gGXwyiR8Cb
Prikaži ovu nitHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
Smerity proslijedio/la je Tweet
Amazing: a termite track (top) and an ant track (bottom) • each travelling insect is protected by its own column of soldiers, no fights necessary |
via Mehdi Moussaidpic.twitter.com/5Ofd5LTszqHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
I have a secret smile that turns on when I hit the button to ride an elevator up or down 15 floors in mere seconds. I get to do this every day. What everyday "unseen" engineering or societal miracles make you stop and smile? What magical future should make you smile but doesn't?
Hvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
Smerity proslijedio/la je Tweet
So Apple's market cap is about to eclipse that of the entire Australian stock market.
pic.twitter.com/ntfcGFxtW9
Hvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
Smerity proslijedio/la je Tweet
I finished my side project today! I built a neural network that predicts the categories of a scientific paper given its title and abstract. The model is a smaller version of
@Smerity's SHA-RNN, trained on all of arXiv. Try it out: http://saattrupdan.pythonanywhere.com/scholarly#MachineLearning#NLProcPrikaži ovu nitHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
Smerity proslijedio/la je Tweet
Ramanujan’s first letter to G.H. Hardy reminds me of the difficulties faced by independent, often self-taught researchers working their way into the scientific research community. https://medium.com/cantors-paradise/ramanujans-first-letter-to-g-h-hardy-1913-33244f545e80 …pic.twitter.com/eDKbXo066j
Hvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
Smerity proslijedio/la je Tweet
This reminds me of a fun fact I recently learnt about leaf cutter ants - by moving the body + legs as a compass to cut the leaf in an arc, the ant ends up with a leaf proportional to its size. So, bigger ants carry bigger leaves. :) geometry at work in nature.https://twitter.com/DrAdrianSmith/status/1209149229261709312 …
0:07Hvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi
Čini se da učitavanje traje već neko vrijeme.
Twitter je možda preopterećen ili ima kratkotrajnih poteškoća u radu. Pokušajte ponovno ili potražite dodatne informacije u odjeljku Status Twittera.
in SF.


