AI product & model operations · Core

Token

Also called: LLM token

ELI5

A small chunk of text used by a language model.

Used in conversation

“API cost is partly based on input and output tokens.”

Definition

A unit into which text is divided for model processing and billing; it is not always a word.

Here “Token” means: A unit into which text is divided for model processing and billing; it is not always a word.

Pitch context

You will see “Token” in product strategy decks, roadmaps, experiments and architecture reviews when the discussion reaches ai product & model operations.

Why it matters: In ai product & model operations, the scope can change what data may be used, who may access it and which controls are required.

Sources & evidence · 2

Direct term-level sources and supporting source families.