Skip to main content

7 docs tagged with "models"

View all tags

Certified Models by Hardware

Reference table that maps each supported NVIDIA and AMD GPU configuration to the LLM models certified for PaletteAI Inference Launchpad.

Deploy a Model

Step-by-step guidance for platform operators on how to deploy an LLM model to a running PaletteAI Inference Launchpad appliance and verify that it is serving.

Manage a Client's Model Access

Step-by-step guidance for platform administrators on how to route a client to specific models and allow a client to reach external models on a PaletteAI Inference Launchpad appliance.

Model Certification

What it means for a model to be certified on PaletteAI Inference Launchpad, how models are certified, and how to choose the right models for your use case.

Upload a Model

Step-by-step guidance for platform operators on how to download a model on a jumpbox and upload it to a PaletteAI Inference Launchpad appliance with the Palette CLI over SSH.