Antirectifier --a way to get rid of activation functions altogether. https://github.com/fchollet/keras/blob/master/examples/antirectifier.py …
-
@fchollet although if I read the train/test output correctly, it looks like these models may all be overfitting
@krob It's also not an apples to apples comparison (different number of parameters in the networks)
-
-
@fchollet yep! the idea is that adding 2x params in antirectifier layer improves accuracy more than adding those params to a dense layer?Thanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.