NN training goes through two distinct phases: (1) reducing classification error through drift (2) optimally compressing mutual information of hidden layers through diffusion https://arxiv.org/abs/1703.00810 pic.twitter.com/He7dNY3NSv
You can add location information to your Tweets, such as your city or precise location, from the web and via third-party applications. You always have the option to delete your Tweet location history. Learn more
I see… (2) would be exciting if true, because you could explicitly drive for max mutual info instead. (Hasn’t this been tried? I don’t know the literature, but seems a likely move)
not that i know of but I am not that familiar with the lit. hopefully one of my DL researcher followers can chime in! (also- goal is for hidden layers to minimize mutual info with input (compression) while maximizing with output (error reduction))
yeah, min, max, whatevs
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.