I see many people incredulous when "my loss is increasing, but accuracy is going up". What matters is the distribution of per-sample losses.
When starting to overfit it's common for mean loss to go up while the per-sample loss distribution is still evolving in a way that helps acc
1:22 PM - 13 Oct 2016
0 replies
7 retweets
24 likes
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.