https://amey-thakur.github.io/tags/evaluation/Recent content in Evaluation on AmeyArcHugo -- 0.152.2en-usMon, 31 Aug 2026 19:59:59 -0400https://amey-thakur.github.io/posts/2026-08-31-when-an-answer-stops-being-enough/Mon, 31 Aug 2026 19:59:59 -0400https://amey-thakur.github.io/posts/2026-08-31-when-an-answer-stops-being-enough/A competition organised by Terence Tao and Damek Davis asked whether mathematical reasoning can be compressed into a page a language model reads before answering. Then its second stage removed the thing that made the first stage easy to fake: an answer was no longer worth anything unless it arrived with a proof a machine would check. This is what I built for both stages, and the moment that convinced me a confident answer and a correct one are completely different products.