Sigh yeah, devil is in the details...gradient clipping, high initial forget gate bias, orthogonal init is the usual raindance
-
so keras won't do everything for me? I feel so misled.
Keras will do automatically the orth init in LSTM and forget gate bias. Gradient clipping: have to specify it.
-
-
awesome. Ok, now I'm feeling excited to compile a training corpus
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.