2 docs tagged with "gpu"

An explanation of how PaletteAI Inference Launchpad lets two or more models share a GPU, how the console judges each model's GPU memory share, and why one appliance runs one sharing group.

Step-by-step guidance for platform operators on how to deploy a model that shares a GPU with other models on a PaletteAI Inference Launchpad appliance, and how to change the GPU memory share of a model that already runs.