Conversation

Ilya Sutskever

@ilyasut

·

Mar 17, 2020

i like how it suggests that backprop may really be the best algorithm for training neural networks

Quote Tweet

Quoc Le

@quocleix

·

Mar 10, 2020

Fun AutoML-Zero experiments: Evolutionary search discovers fundamental ML algorithms from scratch, e.g., small neural nets with backprop. Can evolution be the “Master Algorithm”? ;) Paper: https://arxiv.org/abs/2003.03384 Code: https://git.io/JvKrZ

Show this thread

GIF

7

40

239

Benjamin Crouzier

@pinouchon

Replying to

@ilyasut

This is confirmation that there is not a simpler yet more efficient way of doing it. There might be "better" training algorithms (harder to find by both humans and search methods)

2:37 PM · Mar 25, 2020·Twitter Web App