Skip to main content
Version: v1.0.x

PaletteAI Inference Launchpad Explanation

Explanatory and conceptual guides help you understand how and why PaletteAI Inference Launchpad works the way it does. They cover design decisions, component relationships, and trade-offs rather than walking you through tasks.

Contents​

TopicWhat you understand
Architecture OverviewThe component stack, request routing, model provisioning lifecycle, network topology, and data residency model.
Clients and QuotasWhat a client is, why the appliance serves many clients, and how API tokens and quotas govern usage.
Model CertificationWhat certified means, how models are certified, and how to choose models for your use case.
Inference EnginesWhat an inference engine is, automatic engine selection, the supported kinds, and when to override it.
Installation ArchitectureHow the appliance installs across two stages, including the roles of the jumpbox and why the network uses a bond.
The Thinking DirectiveWhat the Thinking directive controls, why off is disabled for some models, and how a budget is interpreted.