-
How to Implement Synthetic Gradient for RNN in Tensorflow
The theory of synthetic gradient for RNN, it's implications, and how to implement it in tensorflow
-
How to make sense of cross entropy
Understanding the most used loss function in deep learning - cross entropy.
-
L1, L2 regularization demystified.
Breaking down L1, L2 regularization.