Conversation

Smerity
@Smerity
Jim Keller basically defined x86-64 whilst at AMD and comments on the complexity of variety of computer chips and technology involved in Tesla tech.
1
1
11
Smerity
@Smerity
@karpathy
notes that he's the software to Jim's hardware, that one of his proudest achievements was in getting CS231n started at Stanford. Majority of audience have read his work or heard his lectures.
1
17
Smerity
@Smerity
@jekbradbury
asks what's missing in current AI tech and whether Tesla use open source existing stacks or custom. Jim notes the efficiencies gained by specializing and removing overheads between components. Elon/
@karpathy
note this can give 10x the power at a tenth the cost.
3
4
15
Smerity
@Smerity
Specifically that bottlenecks between the hardware and software can destroy much of the gains in a pipeline / integration - essentially Amdahl's law but across a pipeline.
2
10
Smerity
@Smerity
Zaremba et al. (as I know him 🤣) asks the timeline for self driving cars.
@elonmusk
makes a bold statement of two years for full self driving, three years for an order of magnitude better than humans. These gains are not binary, they can still be incremental even in driving.
7
13
19