Unload a model
POST /v1/models/unload
Releases a model from memory without deleting its downloaded files. Active sessions can prevent unloading; finish them and retry.
Guide and examplesModels and serviceAll endpoints
Request body
application/jsonRequired
modelstringRequiredCatalog model ID.Responses
200The model is unloaded.successbooleanmodelstringstatusstring{
"success": true,
"model": "Qwen/Qwen3.5-4B",
"status": "unloaded"
}400Invalid request. Fix the request before retrying; use error.code for program logic and error.param to locate the input.401Invalid or missing API key.403Host or origin is not allowed, or the license was rejected. Inspect error.code to tell them apart.503A required local model is still being prepared (model_downloading) or the service is busy (service_busy). Honor Retry-After when present.