Conversation

Jim Keller basically defined x86-64 whilst at AMD and comments on the complexity of variety of computer chips and technology involved in Tesla tech.

notes that he's the software to Jim's hardware, that one of his proudest achievements was in getting CS231n started at Stanford. Majority of audience have read his work or heard his lectures.

asks what's missing in current AI tech and whether Tesla use open source existing stacks or custom. Jim notes the efficiencies gained by specializing and removing overheads between components. Elon/

@karpathy

note this can give 10x the power at a tenth the cost.

Specifically that bottlenecks between the hardware and software can destroy much of the gains in a pipeline / integration - essentially Amdahl's law but across a pipeline.

Zaremba et al. (as I know him 🤣) asks the timeline for self driving cars.

@elonmusk

makes a bold statement of two years for full self driving, three years for an order of magnitude better than humans. These gains are not binary, they can still be incremental even in driving.