Load a local model
POST /v1/models/load
Loads a downloaded model and allocates memory on the service host. Local language models must be loaded before language generation or Realtime use.
Guide and examplesModels and serviceAll endpoints
Request body
application/jsonRequired
modelstringRequiredCatalog model ID.Responses
200The model is loaded. Host-specific fields may also appear.successbooleanmodelstringstatusstring{
"success": true,
"model": "Qwen/Qwen3.5-4B",
"status": "loaded"
}400Invalid request. Fix the request before retrying; use error.code for program logic and error.param to locate the input.401Invalid or missing API key.403Host or origin is not allowed, or the license was rejected. Inspect error.code to tell them apart.503A required local model is still being prepared (model_downloading) or the service is busy (service_busy). Honor Retry-After when present.