I am -loving- this combined Rectifed Adam (RAdam) + LookAhead optimizer. It's freaky stable and powerful, especially for my purposes. Only weird thing to keep in mind- I've had to multiply my learning rates by over 100x to maximally take advantage.https://medium.com/@lessw/new-deep-learning-optimizer-ranger-synergistic-combination-of-radam-lookahead-for-the-best-of-2dc83f79a48d …
-
-
haha thanks good to know, hopefully this is serendipitous timing
, otherwise I might have to just commit to a “ResNets4Lyfe” tattoo 
-
LOL I could honestly do the same....
End of conversation
New conversation -
-
-
We might get to see some nice fine tuning results for EfficientNet after the APTOS 2019 Blindness Detection competition, a lot of people seem to be using them during this challenge.

-
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.