If you're spending too much time tuning your learning rate schedules by hand, here's a Keras callback that does it for you: https://github.com/nathanhubens/Learning-Rate …
Show this thread
-
-
Didn't quite get what do you mean by using 3e-4 to tune learning rate. Could you please elaborate it?
-
It's a joke :) He is referring to
@karpathy's tweet about hardcoding the learning rate to 3e-4 - Show replies
New conversation -
-
-
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
@negamuhia what do you think? -
Sweet! Now go for 1cycle: https://arxiv.org/abs/1803.09820
- Show replies
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.