Inside the Machine: An Interactive Guide to How LLMs Actually Think
A long-form interactive essay in which the reader types their own sentence and watches a real language model, running entirely in the browser, tokenize it, embed it, attend over it, and sample the next token. Includes a pure TypeScript implementation of the GPT-Neo forward pass (TinyStories-1M, verified token-exact against the reference implementation), a live attention explorer with automatic feature-head discovery, and a bilingual (EN/中文) narrative aimed at non-engineers.
Resource information
- Format
- zip
- Original repository
- 22089052
- DOI
- 10.5281/zenodo.22089052
- Credit basis
- Creators in Zenodo record metadata
- Access
- Open files available from the original Zenodo deposit
- Last checked
- Nov 5, 2026
- License
- mit-license
- Last record update
- Nov 5, 2026
About this resource
A long-form interactive essay in which the reader types their own sentence and watches a real language model, running entirely in the browser, tokenize it, embed it, attend over it, and sample the next token. Includes a pure TypeScript implementation of the GPT-Neo forward pass (TinyStories-1M, verified token-exact against the reference implementation), a live attention explorer with automatic feature-head discovery, and a bilingual (EN/中文) narrative aimed at non-engineers.