Attention Is All You Need — Understanding the Mathematics of the Transformer

A visual cover introducing the mathematical foundations of the Transformer architecture from the paper Attention Is All You Need. The graphic highlights the core scaled dot-product attention equation alongside the key components of the architecture: self-attention, multi-head attention, and positional encoding. ...

March 16, 2026 · 7 min · Amey Thakur

Zero-Shot Video Generation

The intersection of artificial intelligence and multimedia continues to evolve, breaking down barriers between different forms of media. In this project, the research titled “Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generators” conducted by Picsart AI Research Lab represents a significant breakthrough. This study introduces a pioneering method that directly converts textual descriptions into videos, bridging the gap between natural language processing and computer vision. This development not only caters to the growing demand for dynamic visual content but also showcases the machine’s capability to interpret and transform human language into a visual format. By addressing the challenge of text-to-video synthesis, this research sets a new standard for interdisciplinary studies in artificial intelligence. ...

November 22, 2023 · 16 min · Amey Thakur

Text Summarizer Using Julia

Special thanks to Mega Satish for her meaningful contributions, support, and wisdom that helped shape this work. The purpose of this paper is to introduce the Julia programming language with a concentration on Text Summarization. An extractive summarization algorithm is used for summarizing. Julia’s evolution and features, as well as comparisons to other programming languages, are briefly discussed.

January 24, 2022 · 12 min · Amey Thakur