One of the saddest things about the field of AI is how ahistorical and siloed it is. Some of the key debates of our day (e.g. innate priors vs "blank slate" minds) have been going on for many decades, across multiple fields, and deep learners have *zero* knowledge of this context
-
-
Yeah now AdamW is our answer and we don’t need to know about anything else
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
This Tweet is unavailable.
-
Studying more than just the deep learning literature.
- Show replies
-
-
-
Tell companies and universities to hire people with something more than gradient descent studies majors, then. Supply and demand is a very simple tool shaping human behavior for millennia: you demand sub-optimally, you’ll be supplied sub-optimally.
-
(demand, not supply, is the driver here because who has the power in this situation are the people hiring and paying... students and employees are forced to cater to whatever the people with power over their careers want)
End of conversation
New conversation -
-
-
Do you have some recommended books or resources that would help alleviate this issue?
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
This reads largely like a selection bias issue. I don't know if I have talked to a single person at my institution that would describe SGD as "the answer."
-
Is this a CS thing?
End of conversation
New conversation -
-
-
I think it is more a matter of a misnamed degree. Perhaps it would be better called a PhD in Gradient Descent.
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
I think the same can be said of most Computer Science undergrad programs more generally.
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.