Many people sharing this essay arguing that "computational scale beats clever new ideas". It takes for granted backprop, better activation functions, better learning methods, conv nets, better regularization techniques, etc etc. In other words, it seems to ignore the clever ideashttps://twitter.com/gdb/status/1106329741785653248 …
-
-
The Banko & Brill paper helped catalyse the 'big data' hype, but few people have shared the many examples where the opposite is true (i.e. where more data doesn't really help at all).
-
Yeah - it'd be nice to have a whole bundle of examples fleshing this out carefully, and collected up in one place.
- 3 more replies
New conversation -
-
-
You need cleverness to plant the flag first. Ten years down the road the cleverness won’t be needed, scale in computation allows more naive solutions to work. With today’s compute you can write a dumber chess agent that outperforms DeepBlue.
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.