Easy take: calling linear algebra “quantum physics” and “artificial intelligence” is hype. Deeper: the huge influx of physicists into AI has produced an intellectual monoculture that isn’t capable of addressing key problems in the field.https://twitter.com/WIRED/status/1181437300414275584 …
-
-
Replying to @Meaningness
I will have to disagree. Many of the concepts in physics such as non-linear dynamics, phase transitions and criticality, renormalization, complex systems etc aren't in the vocabulary of deep learning research.
1 reply 1 retweet 8 likes -
Replying to @IntuitMachine @Meaningness
Most papers that are submitted with physics inspired approaches are rejected from conferences. There is indeed a mono culture, but it's not due to a bias in physics. Maybe physics envy.
1 reply 0 retweets 1 like -
Replying to @IntuitMachine
That's interesting... so the monoculture may be specific to deep learning as such; something that developed just within that narrow field. (
@michael_nielsen, maybe this is the point you were making too?)2 replies 0 retweets 2 likes -
Replying to @Meaningness @IntuitMachine
Pretty much. There are useful ideas from physics in deep learning research, but I don't think any (currently) really key/dominant ideas are from physics. Maybe I'm not thinking of one?
3 replies 0 retweets 3 likes -
Replying to @michael_nielsen @IntuitMachine
I mean... the whole thing looks like physics to me? You’re shaking a ball on an energy surface.
2 replies 0 retweets 2 likes -
Hmm, I’m wondering if the disconnect here is that I learned backprop in ~1986, and maybe much more use of physical analogies was prevalent then?
2 replies 0 retweets 1 like
Maybe. Hopfield networks were popular then, so I guess lots of interest in physics crossover at the time. But SGD is a notion from mathematical optimization. The closer you look at the energy surface idea, the less it has anything to do with gradient descent.
-
-
There are some papers from mit and but arguing about how deep learning is made possible by the renormalization group
0 replies 0 retweets 1 likeThanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.