Where attention showed up (2014–2017)

A soft-pointer over a sequence is a general primitive. Click a domain to see what was being attended to and what it replaced.

Attended over

Replaced / improved on

Amber regions show where the attention weight is highest at the current decoder step.