PaletteAI Inference Launchpad How-to Guides
How-to guides get a specific job done on a running appliance. They assume you know what you want to accomplish and give you the steps to do it without teaching background concepts.
Contents
| Guide | What you do |
|---|---|
| Install the Appliance | Flash the installer ISO, boot the hardware, and bring up the appliance console. |
| Manage Cluster Infrastructure | Index the Local UI tasks for day-two cluster infrastructure operations. |
| Upgrade the Platform | Upload a newer content bundle from Artifact Studio and apply Update in Local UI. |
| Upload a Model | Upload a model recipe, then download the model weights on a jumpbox and upload them to the appliance. |
| Deploy a Model | Deploy an LLM, choose which nodes run it, and verify it is serving. |
| Share a GPU Between Models | Deploy a model that shares a GPU with a group, and change a running model's GPU memory share. |
| Replace a Model | Remove a model from a node, then deploy a newer version or a different model. |
| Bring Your Own Model | Author metadata for a model that is not certified, then upload and deploy it. |
| Configure Semantic Routing | Turn the semantic router and its guard checks on or off, set routing for a policy and a client, and record decisions. |
| Set the Thinking Directive for a Tier | Choose off, on, or an effort level per tier on the Tier Map. |
| Enable Vision Preprocessing | Deploy a vision model and turn on image-to-text preprocessing for a text-only model. |
| Create a Workspace | Give a team its own workspace, and choose who can act in it. |
| Manage Workspace Members | Add, change, and remove the members of a workspace. |
| Manage Users | Add, change, deactivate, and delete users, and set their passwords. |
| Manage Groups | Add, change, and delete groups. |
| Create a Client | Create a client and issue its first API token. |
| Generate an API Token | Create an API token that clients use to authenticate to the appliance. |
| Set and Manage Client Quotas | Set, edit, raise, and remove a client's request, token, and cost limits. |
| Manage a Client's Model Access | Route a client to models and allow it to reach external models. |
| Register an External Inference Endpoint | Register an OpenAI-compatible host under Integrations, authorize a policy, and route to its models. |
| View Token Usage | Find token usage by model and by client, and open the metrics dashboards. |
| View Client Usage | View quota utilization, historical consumption, and per-token usage. |
| Revoke or Delete a Client | Find expired keys, revoke a token, or delete a client. |
| Use Claude Code | Connect Claude Code to the appliance so a local model serves each request. |
| Use Cursor | Connect Cursor's Ask mode to the appliance through a GPT model the appliance serves. |
| Use OpenAI Codex | Connect the OpenAI Codex CLI to the appliance with a custom model provider. |
| Use OpenCode | Connect the OpenCode terminal agent to the appliance through a custom provider. |