Or you could just use 3e-4
Show this thread
If you're spending too much time tuning your learning rate schedules by hand, here's a Keras callback that does it for you: https://github.com/nathanhubens/Learning-Rate …
-
-
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
What’s special about 3e-4?
-
It is
@karpathy's magic lr for Adam :-)https://twitter.com/karpathy/status/801621764144971776?s=09 … - Show replies
New conversation -
-
-
Or you could set random seed to 1337
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.