Skip to main content

16 docs tagged with "how-to"

View all tags

Create a Client

Step-by-step guidance for platform administrators on how to create a client on a PaletteAI Inference Launchpad appliance by stepping through the Add client wizard and issuing the client's first API token.

Deploy a Model

Step-by-step guidance for platform operators on how to deploy an LLM model to a running PaletteAI Inference Launchpad appliance and verify that it is serving.

Generate an API Token

Step-by-step guidance on how to generate an API token in the PaletteAI Inference Launchpad console so that coding assistants and other clients can authenticate to the appliance.

Manage a Client's Model Access

Step-by-step guidance for platform administrators on how to route a client to specific models and allow a client to reach external models on a PaletteAI Inference Launchpad appliance.

Revoke or Delete a Client

Step-by-step guidance for platform administrators on how to find expired keys, revoke an API token, and delete a client on a PaletteAI Inference Launchpad appliance, and what happens to in-flight requests.

Set and Manage Client Quotas

Step-by-step guidance for platform administrators on how to set, edit, and remove usage quotas on a client on a PaletteAI Inference Launchpad appliance.

Set the Thinking Directive for a Tier

Step-by-step guidance for platform administrators on how to set the Thinking directive for a tier on the Tier map of a PaletteAI Inference Launchpad appliance.

Upload a Model

Step-by-step guidance for platform operators on how to download a model on a jumpbox and upload it to a PaletteAI Inference Launchpad appliance with the Palette CLI over SSH.

View Client Usage

Step-by-step guidance for platform administrators on how to view per-client and per-token consumption on a PaletteAI Inference Launchpad appliance.

View Token Usage and Consumption Metrics

Step-by-step guidance for platform administrators on how to view token usage by model and by client, find the top consumers, and open the metrics dashboards on a PaletteAI Inference Launchpad appliance.