Artificial Intelligence · Deep Learning
Initialisation
A topic within Deep Learning, itself one of 13 topics in that field and part of Artificial Intelligence.
Reading for Deep Learning
2Go deeper
Primary sources and full treatments.
- PaperAttention Is All You NeedVaswani et al., 2017· 15 pages· Free
Replaces recurrence with self-attention, producing the Transformer architecture that underpins essentially all current language models.
- BookDeep LearningGoodfellow, Bengio & Courville, 2016· Free
The reference textbook for the mathematical foundations underneath modern neural network practice.