ComingUp ComingUp
LLM Attention Visualization

LLM Attention Visualization

Sep 8, 2026 AI & Machine Learning
attention interpretability llm transformer visualization

Gallery

LLM Attention Visualization

About

This interactive tool visualizes the attention patterns of large language models, showing how tokens relate to one another during processing. It maps attention weights to provide clear insight into the internal mechanics of transformer architectures.

Comments (2)

Edwin Herzog Edwin Herzog 1 day ago

would be wild to see what the model focuses on when it hallucinates

Loren Halvorson Loren Halvorson 1 day ago

doubt it shows individual heads instead of just averaging them