Skip to main content

6 docs tagged with "clients"

View all tags

Clients and Quotas

An explanation of clients, API tokens, and quotas in PaletteAI Inference Launchpad: what a client is, why the appliance serves many clients such as AI coding assistants, and how it meters usage, reports utilization, and limits consumption.

Create a Client

Step-by-step guidance for platform administrators on how to create a client on a PaletteAI Inference Launchpad appliance by stepping through the Add client wizard and issuing the client's first API token.

Manage a Client's Model Access

Step-by-step guidance for platform administrators on how to route a client to specific models and allow a client to reach external models on a PaletteAI Inference Launchpad appliance.

Revoke or Delete a Client

Step-by-step guidance for platform administrators on how to find expired keys, revoke an API token, and delete a client on a PaletteAI Inference Launchpad appliance, and what happens to in-flight requests.

Set and Manage Client Quotas

Step-by-step guidance for platform administrators on how to set, raise, edit, and remove usage quotas on a client on a PaletteAI Inference Launchpad appliance.

View Client Usage

Step-by-step guidance for platform administrators on how to view quota utilization, historical consumption, and per-token usage on a PaletteAI Inference Launchpad appliance.