Build one attention head
Follow four tokens through projection, query–key scoring, softmax, and value mixing. Every number comes from the same tiny 4 × 4 example.
query
key
value
probability
Drag to inspect · scroll to zoom · guided camera resets on every step
WebGL is unavailable. The equations and explanation remain readable in the panel beside this message.
Previous
Play
Next
Reset view