Attention Is All You Need – Understanding the Mathematics of the Transformer
The mathematics of the Transformer, worked through from the 2017 paper by Vaswani and colleagues. Scaled dot-product attention, why the scaling factor is there, multi-head attention, positional encoding, and the encoder and decoder stacks, each derived rather than asserted, for a reader who wants to understand the architecture rather than only use it.