Skip to main content

5 docs tagged with "routing"

View all tags

Configure Semantic Routing

Step-by-step guidance for platform administrators on how to set the Complexity threshold, author category rules, override both for a client, and turn on Decision recording on a PaletteAI Inference Launchpad appliance.

Routing Behavior

An explanation of how PaletteAI Inference Launchpad decides which model answers each request: the Tier map, the semantic router, how the two combine, and the traps operators should know about.

Set the Thinking Directive for a Tier

Step-by-step guidance for platform administrators on how to set the Thinking directive for a tier on the Tier Map of a PaletteAI Inference Launchpad appliance.

The Thinking Directive

How the Thinking directive on the Tier Map controls reasoning depth by effort level, why the off option is disabled for some providers, how each engine interprets the level, and the shared output allowance that reasoning and answer tokens draw from.

Thinking Directive Modes

Reference of the Thinking directive modes on the Tier Map, the effort levels, per-engine interpretation, and the console states that override the setting.