@fchollet Is there a proper way to do penalty on weights (orthonormality) using tf.GradientTape ?
You can just compute the norm of the difference between the orthonormed weight and the current weight and add that term to the loss. You could also just project the weight after each gradient update...
-
-
Thank you.
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.