Skip to main content
Version: v1.0.x

PaletteAI Inference Launchpad How-to Guides

How-to guides get a specific job done on a running appliance. They assume you know what you want to accomplish and give you the steps to do it without teaching background concepts.

Contents​

GuideWhat you do
Install the ApplianceFlash the installer ISO, boot the hardware, and bring up the appliance console.
Deploy a ModelDeploy an LLM to the cluster and verify it is serving.
Upload a ModelDownload a model on a jumpbox and upload it to the appliance.
Set the Thinking Directive for a TierChoose off, on, or a budget hint per tier on the Tier map.
Create a ClientCreate a client and issue its first API token.
Generate an API TokenCreate an API token that clients use to authenticate to the appliance.
Set and Manage Client QuotasSet, edit, and remove a client's request, token, and cost limits.
Manage a Client's Model AccessRoute a client to models and allow it to reach external models.
View Token UsageFind token usage by model and by client, and open the metrics dashboards.
View Client UsageView a client's per-token consumption, requests, and cost.
Revoke or Delete a ClientFind expired keys, revoke a token, or delete a client.
Use Claude CodeConnect Claude Code to the appliance so a local model serves each request.
Use CursorConnect Cursor's Ask mode to the appliance through a uniquely named model alias.
Use OpenAI CodexConnect the OpenAI Codex CLI to the appliance with a custom model provider.
Use OpenCodeConnect the OpenCode terminal agent to the appliance through a custom provider.