A ~3M-parameter from-scratch transformer, running 100% in your browser (Go + WebAssembly, no server) — with its attention live on screen. Type Bulgarian in Latin letters:
Hover a character above to see which context characters each attention head read when the model emitted it. Click a grid cell to isolate one head. The ⏎ step is the decision to stop.
loading model (~15 MB)…