Attention Is All You Need – Understanding the Mathematics of the Transformer

The mathematics of the Transformer, worked through from the 2017 paper by Vaswani and colleagues. Scaled dot-product attention, why the scaling factor is there, multi-head attention, positional encoding, and the encoder and decoder stacks, each derived rather than asserted, for a reader who wants to understand the architecture rather than only use it.

March 16, 2026 · 7 min · Amey Thakur

Zero-Shot Video Generation

Text2Video-Zero, from Picsart AI Research, turns a text-to-image diffusion model into a zero-shot video generator with no video training data at all. This write-up explains the method, the motion dynamics and cross-frame attention that keep a generated sequence coherent, and reports what the model produced when run, including where the results break down.

November 22, 2023 · 16 min · Amey Thakur

Pizza Ordering Chatbot Using Amazon Lex

Special thanks to Mega Satish for her meaningful contributions, support, and wisdom that helped shape this work. Because of breakthroughs in machine learning and deep learning, which are causing a change in every industry area and managing various types of activities better than people. The majority of monotonous jobs that were formerly performed by humans are now replaced by AI.

March 19, 2022 · 10 min · Amey Thakur

Text Summarizer Using Julia

Special thanks to Mega Satish for her meaningful contributions, support, and wisdom that helped shape this work. The purpose of this paper is to introduce the Julia programming language with a concentration on Text Summarization. An extractive summarization algorithm is used for summarizing. Julia’s evolution and features, as well as comparisons to other programming languages, are briefly discussed.

January 24, 2022 · 12 min · Amey Thakur