Easy take: calling linear algebra “quantum physics” and “artificial intelligence” is hype. Deeper: the huge influx of physicists into AI has produced an intellectual monoculture that isn’t capable of addressing key problems in the field.https://twitter.com/WIRED/status/1181437300414275584 …
-
-
Replying to @Meaningness
I will have to disagree. Many of the concepts in physics such as non-linear dynamics, phase transitions and criticality, renormalization, complex systems etc aren't in the vocabulary of deep learning research.
1 reply 1 retweet 8 likes -
Replying to @IntuitMachine @Meaningness
Most papers that are submitted with physics inspired approaches are rejected from conferences. There is indeed a mono culture, but it's not due to a bias in physics. Maybe physics envy.
1 reply 0 retweets 1 like -
Replying to @IntuitMachine
That's interesting... so the monoculture may be specific to deep learning as such; something that developed just within that narrow field. (
@michael_nielsen, maybe this is the point you were making too?)2 replies 0 retweets 2 likes -
Replying to @Meaningness @IntuitMachine
Pretty much. There are useful ideas from physics in deep learning research, but I don't think any (currently) really key/dominant ideas are from physics. Maybe I'm not thinking of one?
3 replies 0 retweets 3 likes -
Replying to @michael_nielsen @IntuitMachine
I mean... the whole thing looks like physics to me? You’re shaking a ball on an energy surface.
2 replies 0 retweets 2 likes -
Replying to @Meaningness @IntuitMachine
Minimizing a cost function using SGD/backprop is like physics in much the same way as eigenvectors are part of quantum mechanics.
1 reply 0 retweets 8 likes -
It occurs to me that I don't know where the theory of mathematical optimization (& notions like objective function, gradient descent) comes from. Certainly, it was buzzing as a subject independent of physics by the 1950s. But its roots may be in part in physics, earlier.
5 replies 0 retweets 7 likes -
Replying to @michael_nielsen @IntuitMachine
One major strand in the history would be cybernetics/control theory, which was applied physics initially—the radar-controlled antiaircraft gun being the paradigm for the field
2 replies 0 retweets 6 likes
The MIT Radiation Lab was the biggest contributor I think
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.