Dictionary AI Technology

Prompt latency

What it means

The wait before the FIRST word of the answer appears (time-to-first-token). Long prompts and big models stretch it; streaming hides it.

An everyday example

In a restaurant, it's the time until the first dish hits your table - bread served early (streaming) makes the wait feel shorter.