Skip to main content

12 docs tagged with "explanation"

View all tags

Clients and Quotas

An explanation of clients, API tokens, and quotas in PaletteAI Inference Launchpad: what a client is, why the appliance serves many clients such as AI coding assistants, and how it meters usage, reports utilization, and limits consumption.

Frontier Providers

How Anthropic, OpenAI, and Gemini egress works on a PaletteAI Inference Launchpad appliance: the credential patterns, the five levers that keep frontier traffic occasional, the decision flow, and the two misconfigurations that most often defeat the whole design.

Installation Architecture

How the PaletteAI Inference Launchpad appliance installs across two stages, the roles of the jumpbox, slim ISO, and Local UI, and why the network uses a bond rather than a bridge.

Model Certification

What it means for a model to be certified on PaletteAI Inference Launchpad, how models are certified, and how to choose the right models for your use case.

Model Placement

An explanation of how PaletteAI Inference Launchpad places a model on cluster nodes, when to pin a model to a subset of nodes, and how the Cluster view reports that placement.

Routing Behavior

An explanation of how PaletteAI Inference Launchpad decides which model answers each request: the Tier map, the semantic router, how the two combine, and the traps operators should know about.

The Thinking Directive

How the Thinking directive on the Tier Map controls reasoning depth by effort level, why the off option is disabled for some providers, how each engine interprets the level, and the shared output allowance that reasoning and answer tokens draw from.

Vision Preprocessing

An explanation of vision preprocessing in PaletteAI Inference Launchpad: how a text-only model answers questions about images, what clients see, and the limits that apply.

What is PaletteAI Inference Launchpad?

PaletteAI Inference Launchpad is a standalone, turnkey AI appliance that lets enterprises run large language models on their own hardware without cloud dependency, AI consulting, or complex infrastructure setup.