← Glossary / 11 of 100
n. / AI agents
Time to first token (TTFT)
Definition
Time to first token is the delay between sending a request to a language model and receiving the first streamed token of its response.
In more detail
TTFT is tracked separately from total call latency because it drives perceived responsiveness in streaming interfaces, even when total generation time is unchanged.
Related terms
