PaletteAI Inference Launchpad Explanation
Explanatory and conceptual guides help you understand how and why PaletteAI Inference Launchpad works the way it does. They cover design decisions, component relationships, and trade-offs rather than walking you through tasks.
Contents
| Topic | What you understand |
|---|---|
| Architecture Overview | The component stack, request routing, model provisioning lifecycle, network topology, and data residency model. |
| Clients and Quotas | What a client is, why the appliance serves many clients, and how API tokens and quotas govern usage. |
| Model Certification | What certified means, how models are certified, and how to choose models for your use case. |
| Inference Engines | What an inference engine is, automatic engine selection, the supported kinds, and when to override it. |
| Installation Architecture | How the appliance installs across two stages, including the roles of the jumpbox and why the network uses a bond. |
| The Thinking Directive | What the Thinking directive controls, why off is disabled for some models, and how a budget is interpreted. |