Floored by how excellent this conversation between and is. Definitely worth the time to watch.
These two have beautiful minds and, even more importantly, really great hearts.
youtu.be/13CZPWmke6A
Conversation
Replying to
On deep learning:
“The geometric mean of biology and physics... that’s deep learning”
1
22
On transformers:
Transformers are successful because they are a simultaneous combination of multiple ideas: attention, ability to run quickly on a GPU, non-recurrence (and therefore less deep so easier to optimize)
1
15
On how to build AGI:
Best guess is it will be deep learning plus a few other smaller ideas (self-play among them)
1
1
12
On self play:
“Self-play has a property that it can surprise us in truly novel ways.” (e.g., creative solutions to problems that weren’t anticipated — and are actually useful!)
4
1
33
On the goodness of people:
“I don’t know if most people are good, but I think that when it really counts people can be better than you think.” ♥️
2
7
75
it's amazing how hearing two people chatting can enhance your way of thinking though they aren't talking super technical. my brain cells really enjoy each and every podcast by ❤
1
4
I think that explains why significant contributions usually come from the same places, just setting about great scientists and engineers gives you a big boost
2
Was a good episode and Ilya was a great guest. However, Lex could have challenged Ilya more on the reasoning abilities of deep neural networks, especially after already having Judea Pearl on the show.
1