ComingUp ComingUp
Transformer Primitives

Transformer Primitives

Jun 23, 2026 Education & Learning
ai explainer gpt machine learning non-technical transformers

Gallery

Transformer Primitives

About

I have had a few conversations in the past year with non-technical folks (traditional finance types, consultants) who asked for a simple explainer on how GPTs work. These people generally have the horsepower to grasp new concepts quickly but don't necessarily have the math background to dig in super deeply and want a stronger framework than "they predict words".I had generally been pointing them to Karpathy, Illustrated Transformer, and other youtube content but I figured something more hands on without the math requirement might be better at explaining questions like "why matrix multiplication?".I built this as a simple 60-70 minute interactive course with some demos I could send along to them. I've found it effective as the initial foray into understanding jargon and concepts before they graduate to Karpathy et al.It's free, no signup required. I would love feedback on where it might lose a non-technical reader, and where someone who does this for a living thinks I have simplified past the point of being correct.understandgpt.xyz

Comments (6)

Pauline Ullrich Pauline Ullrich 2 weeks ago

which transformer architectures specifically. font weights look inconsistent on mobile

Brook Feest Brook Feest 2 weeks ago

finally a transformer explainer for the finance crowd, they needed this

Dariana Ondricka Dariana Ondricka 2 weeks ago

does this actually explain multi-head attention or just skip to the analogy?

Jermain Kovacek Jermain Kovacek 2 weeks ago

clean spacing makes the technical bits way more readable

Carlo Christiansen Carlo Christiansen 2 weeks ago

how is this different from the dozen other GPT explainers out there

Tod Jacobson Tod Jacobson 2 weeks ago

how deep does this go before it loses non-tech people?