transformative

neural network playground in pytorch

Resources

https://arxiv.org/pdf/1706.03762.pdf

http://jalammar.github.io/illustrated-transformer/

https://towardsdatascience.com/how-to-code-the-transformer-in-pytorch-24db27c8f9ec

http://mlexplained.com/2018/01/13/weight-normalization-and-layer-normalization-explained-normalization-in-deep-learning-part-2/