Play
Next
Reset
INPUT
OUTPUT
BI-ENCODER
H
αᵢ
cᵢ
DECODER
α ⊙ H
sᵢ
The encoder processes input to build a **Memory Matrix (H)** of hidden states.
Illustrative weights and word-level labels for readability; in practice both inputs and outputs are tokenized sequences.