Skip to main content
Version: v1.0.x

Thinking Directive Modes

This reference lists the Thinking directive modes on the Tier map of a PaletteAI Inference Launchpad appliance, the value each mode carries at request time, the console states that override the setting, and how each engine family interprets a token budget. For the concept behind the directive, refer to The Thinking Directive. For the steps to set the directive, refer to Set the Thinking Directive for a Tier.

Modes​

ModeAuthored valueWhat the model does
offoffThe model does not reason. It answers each request directly.
ononThe model reasons at the depth its own defaults choose. No token budget is set.
budgetbudget:<n>The model reasons with a token-budget hint of <n> tokens. The value is a hint, not a hard cap.

Per-Engine Interpretation of Budget​

Engine familyHow the value is treated
Anthropic frontier, version 4.6 and earlierA target the provider aims for, not a limit.
Anthropic frontier, version 5 and laterNo observable effect. Reasoning runs to the full output allowance.
Local modelsNot read. No chat template that ships with the appliance reads the value on any family tested.

Console States That Override the Setting​

StateWhen it appearsEffect
off is disabledThe tier resolves to an OpenAI o-series or GPT-5 family model.The selector does not offer off for that tier.
Grey chip reading ignored — no thinking surfaceThe tier's resolved model runs on an engine that has no reasoning surface.The engine ignores the directive; the request is served normally.