This isn't really anything against W&B- it's very nice and polished. I'm really just advocating critical thinking about your process.https://twitter.com/citnaj/status/1320443311845302272 …
-
What do you cats think about hyperparam tuning like optuna and raytune? Esp in terms of real world problem solving vs kaggle comps.
Like I feel like the lesson I keep seeing repeated lately both in papers I see and in my personal experience is that there's a lot to be gained in focusing on the fundamentals. Like...really...for serious.... data makes a big difference, for example:https://github.com/google-research/big_transfer …
