Easy take: calling linear algebra “quantum physics” and “artificial intelligence” is hype. Deeper: the huge influx of physicists into AI has produced an intellectual monoculture that isn’t capable of addressing key problems in the field.https://twitter.com/WIRED/status/1181437300414275584 …
-
-
Replying to @Meaningness
Most of the crankiest people I know about the culture of AI are physicists-turned-AI people. I doubt that's a reason for a monoculture; seems quite the reverse, they're usually the ones saying "hey, fiddling with hyperparameters is the wrong thing to be doing..."
1 reply 0 retweets 18 likes -
Replying to @michael_nielsen
Yes, and "let's look at the energy surface" leads to insights that vaguely-motivated tweaking can't. (Such tweaking being an approach CS-educated folks are liable to fall into.) But it doesn't lead to the insights that understanding mechanism-domain interactions can.
2 replies 0 retweets 8 likes -
Replying to @Meaningness
This seems very different from the original assertion, now more like "Are ideas adapted from physics sufficient to solve the main problems of AI?" Seems the answer is "obviously not", though of course exploring ideas from many different domains seems likely a good thing.
3 replies 0 retweets 3 likes -
Replying to @michael_nielsen
Not sure I follow; what is the relevant difference between this formulation and what I said? I was suggesting that physicists mostly only draw on methods and analogies from physics, and (useful as those are) they aren't able to address many of the key problems in AI.
1 reply 0 retweets 2 likes -
Replying to @Meaningness
Oh, that's not how I interpreted your tweet at all. It read (to me) as you asserting that the monoculture in AI is due to physicists. I guess not!
1 reply 0 retweets 2 likes -
Replying to @michael_nielsen
Well, the monoculture is one of using methods from physics (plus numerical analysis for implementation). I'm not blaming physicists as individuals. Rather suggesting that progress in AI can only come from drawing on ideas from many fields:https://meaningness.com/metablog/artificial-intelligence-progress …
1 reply 0 retweets 5 likes
As far as I can see, ideas from physics have had only a small impact on AI. Stochastic gradient descent and backprop and ad hoc regularization are the dominant ideas today. None comes from physics.
-
-
Replying to @michael_nielsen @Meaningness
Maybe the problem is not physics but physics envy?
0 replies 0 retweets 2 likesThanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.