Many people in engineering believe that to understand something, it is necessary and sufficient to have a low-level mathematical description of that thing. That you need to "know the math behind it". In nearly all cases, it is neither sufficient nor at all necessary - far from it
-
-
The same is true of backprop in deep learning -- knowing how to code up backprop by hand gives you no useful knowledge wrt deep learning, and inversely, developing powerful mental models for deep learning does not in any way require knowing the algorithmic details of backprop
Show this thread -
(coming from someone who had to implement backprop a lot in the past, first in C, then in Matlab, then in Numpy)
Show this thread -
In addition, if you have the right mental model for something, it is generally easy to work out the algorithmic details on your own when you need them, at least down to a level where you can roll out a working implementation (& it becomes trivial if you can just look up details)
Show this thread -
Similar to how, say, you can always reinvent the Pythagorean theorem on the fly if you think about geometry through the lens of vector products, or how you don't need to memorize the quadratic formula if you understand what an equation is and the general process for solving them
Show this thread
End of conversation
New conversation -
-
-
I’m going to assume that your use of the phrase “completely orthogonal” was intentional.
- End of conversation
New conversation -
-
-
This tweet basically sums up my current frustrations with my Graduate Algorithms class. Lots of "here's how to transform from A to B" without a higher-level mental model.
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
Actually, this is one of the first things you learn when you start going deeper into mathematics: that you really ought to care about understanding subjects the "right way" or knowing where characterizations come from ( their motivations, etc.) and I think no one outside realizes
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
In other words, a good story
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
I am reminded of a quote by John Tate on Grothendieck: "He just had an instinct for the right degree of generality ... Not generalization for generalization’s sake but the right generalization."
-
Finding the model or generalization that captures *what matters* and forgets all the details that don't matter ... that is hard, and also is exactly what makes a great mathematician (such a Grothendieck!). Finding that "right" degree of generality should always be our goal.
End of conversation
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.