https://amey-thakur.github.io/tags/grokking/Recent content in Grokking on AmeyArcHugo -- 0.152.2en-usWed, 12 Aug 2026 19:59:59 -0400https://amey-thakur.github.io/posts/2026-08-12-can-a-neural-network-learn-exact-arithmetic/Wed, 12 Aug 2026 19:59:59 -0400https://amey-thakur.github.io/posts/2026-08-12-can-a-neural-network-learn-exact-arithmetic/A calculator multiplies two thousand-digit numbers and takes the remainder without thinking about it. Ask a neural network to do the same thing and it becomes an open research question, one that Terence Tao helped set as a competition. The answer has to be exact, because a remainder that is off by one is simply wrong. This is what I submitted to the SAIR Foundation’s Modular Arithmetic Challenge, why the obvious approach cannot work, and the one idea that made the difference.