In early 2024, Tom Yeh posted a hand-drawn exercise on LinkedIn showing how a transformer works - not with code, not with diagrams borrowed from a research paper, but with actual numbers written in colored pen on graph paper. He expected mild interest. What he got was a movement.
Within weeks, 25,000 people were following along. Within months, the number was 200,000 across LinkedIn and X. The AI by Hand newsletter on Substack crossed 62,000 subscribers - ranking in the top 100 technology publications on the entire platform. None of it was planned. All of it was earned, one calculation at a time.
Yeh is an Associate Professor of Computer Science at the University of Colorado Boulder, where he has been teaching and researching since 2012. He holds a PhD from MIT, where he built some of the early foundations of what we now call computer vision-driven automation. His Sikuli project - which let computers automate GUIs by looking at screenshots the way humans do - was downloaded over 200,000 times and spawned one of the most-cited HCI papers of the 2010s.
But the part of Tom Yeh that matters most to most people right now sits at the intersection of a Feynman quote and a box of colored markers. His guiding philosophy: "What I cannot create, I do not understand." In an era where AI has become a vending machine - put in a prompt, get out a result - Yeh insists on understanding the mechanism. The math. The actual numbers flowing through an attention head, a feed-forward layer, a normalization step.
His AI by Hand series does not treat the reader as a passive consumer. You work through it. You fill in the cells. You multiply the matrices by hand - or in an Excel spreadsheet if you prefer, since Yeh also built an entire GitHub repository of Excel-based deep learning exercises that garnered 1,300+ stars almost immediately. The exercises span everything from basic matrix multiplication and gradient descent to full transformer architectures, diffusion models, and the Mamba state-space model.
What makes this genuinely unusual is that Yeh drew every single one of those exercises himself - by hand, in color, on printed paper. Three hundred individual exercises across twelve workbooks. He did not outsource the aesthetics. He did not generate them. He sat down and created them, the same way he asks his students to engage with the material.