Model Certification
This page explains what model certification means and how a model becomes certified. For the models certified on specific hardware, refer to Certified Models by Hardware.
Certification Overview
A certified model is a large language model (LLM) that Spectro Cloud has validated to run correctly on the listed GPU configuration for PaletteAI Inference Launchpad. This validation is based on Spectro Cloud's own testing rather than public benchmarks, and it can extend across equivalent GPU configurations. When you deploy a certified model on a configuration where it is certified, you can be confident it loads and serves requests without hardware surprises.
Model Use Cases
Spectro Cloud chooses the certified models with coding assistants as the primary use case. If your primary need is a coding assistant, start with the certified models.
Other models may serve other use cases better, so if your primary need is not a coding assistant, contact Spectro Cloud to discuss the right models for your use case.
The certified list is not exclusive. You can load models beyond it as long as they fit within the GPU resources available on your appliance. If the model you want is not certified for your hardware, contact Spectro Cloud to discuss your use case.
For how to add a model to a running appliance, refer to Deploy a Model.
How Certification Differs from Model as a Service
PaletteAI Inference Launchpad is not a Model as a Service. Rather than offering the widest possible catalog of models on demand, Spectro Cloud certifies a focused set of models for on-premises inference on your own hardware. For multi-tenant AI factory use cases, PaletteAI is the better fit. For a full comparison of the two products, refer to What is PaletteAI Inference Launchpad?.