AI product & model operations · Core

Model latency

Also called: AI response time

ELI5

How long the AI takes to answer.

Used in conversation

“Model latency matters in live customer support.”

Definition

Time required for a model or AI workflow to return an output.

Here “Model latency” means: Time required for a model or AI workflow to return an output.

Pitch context

You will see “Model latency” in product strategy decks, roadmaps, experiments and architecture reviews when the discussion reaches ai product & model operations.

Why it matters: In ai product & model operations, the scope can change what data may be used, who may access it and which controls are required.

Sources & evidence · 2

Direct term-level sources and supporting source families.

National Institute of Standards and Technology — Computer Security Resource Center GlossaryDirect source · primary · checked 2026-08-16
Scrum Guides — The Scrum Guide — official current versionSupporting source family · primary · checked 2026-08-16