Certified Models by Hardware
Reference table that maps each supported NVIDIA and AMD GPU configuration to the LLM models certified for PaletteAI Inference Launchpad.
Reference table that maps each supported NVIDIA and AMD GPU configuration to the LLM models certified for PaletteAI Inference Launchpad.
Step-by-step guidance for platform operators on how to deploy an LLM model to a running PaletteAI Inference Launchpad appliance and verify that it is serving.
Step-by-step guidance for platform administrators on how to route a client to specific models and allow a client to reach external models on a PaletteAI Inference Launchpad appliance.
What it means for a model to be certified on PaletteAI Inference Launchpad, how models are certified, and how to choose the right models for your use case.
An explanation of inference engines in PaletteAI Inference Launchpad, including automatic engine selection, the supported engine kinds, and when to override the automatic choice.
Reference for the Palette CLI model download and upload commands and the model metadata file used to place models on a PaletteAI Inference Launchpad appliance.
Step-by-step guidance for platform operators on how to download a model on a jumpbox and upload it to a PaletteAI Inference Launchpad appliance with the Palette CLI over SSH.