1/ Clickbait. The "wall" is: "Not every area has reached the limit of scaling, but in most places, we're getting to a point where we really need to think in terms of optimization, in terms of cost benefit, and we really need to look at how we get most out of the compute we have."https://twitter.com/GaryMarcus/status/1202366200811884545 …
-
-
example- EfficientNet came out recently and showed just how inefficient previous vision networks were (and there's a lot of attention being paid to these!) We're talking order of magnitude here. And it does work (I use it!)pic.twitter.com/SOJ9iOJtWO
-
In my own work, I've been able to shrink down DeOldify 10x and get better performance with this mindset. There were simply just bad decisions made at the software level previously (mostly stuff I grabbed from elsewhere that was considered pretty much SOTA!).
- Show replies
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.