edulab

How a chat writes its answer

Left: what you see in a chat app. Right: what happens behind it – the model writes the answer one token at a time.

What you see

The chat window

What happens behind it

    ←→ step, space play