Skip to main content
Get async queue status for the production environment.
curl --request GET \
  --url https://model-{model_id}.api.baseten.co/production/async_queue_status \
  --header 'Authorization: <api-key>'
{
  "model_id": "<string>",
  "deployment_id": "<string>",
  "num_queued_requests": 123,
  "num_in_progress_requests": 123
}

Documentation Index

Fetch the complete documentation index at: https://docs.baseten.co/llms.txt

Use this file to discover all available pages before exploring further.

Authorizations

​
Authorization
string
header
required

API key with the Api-Key prefix, e.g. Authorization: Api-Key abcd1234.abcd1234.

Response

Async queue status for a deployment.

​
model_id
string
required

The ID of the model.

​
deployment_id
string
required

The ID of the deployment.

​
num_queued_requests
integer
required

Number of requests with QUEUED status awaiting processing.

​
num_in_progress_requests
integer
required

Number of requests currently being processed by the model.