Configure Semantic Routing
Step-by-step guidance for platform administrators on how to set the Complexity threshold, author category rules, override both for a client, and turn on Decision recording on a PaletteAI Inference Launchpad appliance.
Step-by-step guidance for platform administrators on how to set the Complexity threshold, author category rules, override both for a client, and turn on Decision recording on a PaletteAI Inference Launchpad appliance.
An explanation of how PaletteAI Inference Launchpad decides which model answers each request: the Tier map, the semantic router, how the two combine, and the traps operators should know about.
Step-by-step guidance for platform administrators on how to set the Thinking directive for a tier on the Tier Map of a PaletteAI Inference Launchpad appliance.
How the Thinking directive on the Tier Map controls reasoning depth by effort level, why the off option is disabled for some providers, how each engine interprets the level, and the shared output allowance that reasoning and answer tokens draw from.
Reference of the Thinking directive modes on the Tier Map, the effort levels, per-engine interpretation, and the console states that override the setting.