23 docs tagged with "how-to"

Step-by-step guidance for platform operators on how to bring a model that is not in the certified catalog onto a PaletteAI Inference Launchpad appliance by authoring its metadata file, then uploading and deploying it.

Step-by-step guidance for platform administrators on how to set the Complexity threshold, author category rules, override both for a client, and turn on Decision recording on a PaletteAI Inference Launchpad appliance.

Step-by-step guidance for platform administrators on how to create a client on a PaletteAI Inference Launchpad appliance by stepping through the Add client wizard and issuing the client's first API token.

Step-by-step guidance for platform operators on how to deploy an LLM model to a running PaletteAI Inference Launchpad appliance, choose which nodes run it, and verify that it is serving.

Step-by-step guidance for platform operators on how to deploy a vision model alongside a text-only model and enable multimodal preprocessing so image requests are answered on the appliance.

Step-by-step guidance on how to generate an API token in the PaletteAI Inference Launchpad console so that coding assistants and other clients can authenticate to the appliance.

Step-by-step guidance for platform operators on how to install the PaletteAI Inference Launchpad appliance from bare hardware to a running, reachable appliance console.

Step-by-step guidance for platform administrators on how to route a client to specific models and allow a client to reach external models on a PaletteAI Inference Launchpad appliance.

Index of the Local UI tasks that platform operators use to run day-two cluster infrastructure operations on a PaletteAI Inference Launchpad appliance.

Step-by-step guides for completing specific operational tasks on a running PaletteAI Inference Launchpad appliance.

Step-by-step guidance for platform operators on how to register an OpenAI-compatible external inference endpoint, authorize a client to use it, and route requests to its models.

Step-by-step guidance for platform operators on how to put a newer version of a model, or a different model, on a node by removing the current model and then deploying the replacement.

Step-by-step guidance for platform administrators on how to find expired keys, revoke an API token, and delete a client on a PaletteAI Inference Launchpad appliance, and what happens to in-flight requests.

Step-by-step guidance for platform administrators on how to set, raise, edit, and remove usage quotas on a client on a PaletteAI Inference Launchpad appliance.

Step-by-step guidance for platform administrators on how to set the Thinking directive for a tier on the Tier Map of a PaletteAI Inference Launchpad appliance.

How to upgrade the PaletteAI Inference Launchpad appliance from Local UI by uploading a newer content bundle and applying the Update action.

Step-by-step guidance for platform operators on how to download a model on a jumpbox and upload it to a PaletteAI Inference Launchpad appliance with the Palette CLI over SSH.

Connect Anthropic's Claude Code coding agent to a PaletteAI Inference Launchpad appliance so that a model on the appliance serves every request.

Connect the Cursor code editor to a PaletteAI Inference Launchpad appliance so that a model on the appliance serves your requests in Cursor's Ask mode.

Connect the OpenAI Codex CLI to a PaletteAI Inference Launchpad appliance so that a model on the appliance serves every request.

Connect the OpenCode terminal coding agent to a PaletteAI Inference Launchpad appliance so that a model on the appliance serves every request.

Step-by-step guidance for platform administrators on how to view quota utilization, historical consumption, and per-token usage on a PaletteAI Inference Launchpad appliance.

Step-by-step guidance for platform administrators on how to view token usage by model and by client, find the top consumers, and open the metrics dashboards on a PaletteAI Inference Launchpad appliance.