One of the strangest mysteries in AI is that you can average two models and get a result superior to either model alone. The weights, not the outputs. As gwern said, it’s like putting a beetle and a rabbit in a blender and getting a rabbit that can fly.
-
Show this thread
Replying to @theshawwn
Any sort of boundary creates SOME sort of anti-correlation effect. Since within a boundary you get large changes from butterfly effects. Adding a buffer to dampen volatility of these effects probably is the improvement. (Especially for “brain farts”)
9:00 AM - 2 Mar 2020
0 replies
0 retweets
1 like
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.