Most people I meet overestimate what deep learning can do (it's curve-fitting, don't expect it to do discrete symbol manipulation, it will solve symbolic tasks via embedding + interpolation) and simultaneously underestimate what you can do with curve-fitting given enough data
-
-
This is a bit like watching a bunch of people trying to make steam-powered airplanes and rockets work in the year 1800 (it won't) while largely missing the world-changing potential of applying steam power to trains and large industrial machinery
Show this thread -
"Meh, it's just a factory, boring... but look at my cool model rocket!" No, the boring factory is going to change the face of the world, and meanwhile your GPT model rocket won't scale past the toy stage
Show this thread
End of conversation
New conversation -
-
-
This is interesting. Do you know any papers for this topic?
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
Can someone elaborate on manifold hypothesis part?
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.