Get async queue status for a regional environment.

GET

async_queue_status

curl --request GET \
  --url https://model-{model_id}.api.baseten.co/async_queue_status \
  --header 'Authorization: Bearer <token>'

{
  "model_id": "<string>",
  "deployment_id": "<string>",
  "num_queued_requests": 123,
  "num_in_progress_requests": 123
}

Authorizations

Authorization

string

header

required

Pass your Baseten API key. Clients automatically send Authorization: Bearer <key>. Direct callers can also use Authorization: Api-Key <key>; both schemes are accepted.

Response

Async queue status for a deployment.

model_id

string

required

The ID of the model.

deployment_id

string

required

The ID of the deployment.

num_queued_requests

integer

required

Number of requests with QUEUED status awaiting processing.

num_in_progress_requests

integer

required

Number of requests currently being processed by the model.

OverviewManage models and deployments with the Baseten management API. It supports monitoring, CI/CD, and automation at both the model and workspace levels.

⌘I

Get async queue status for a regional environment.

curl --request GET \
  --url https://model-{model_id}.api.baseten.co/async_queue_status \
  --header 'Authorization: Bearer <token>'

{
  "model_id": "<string>",
  "deployment_id": "<string>",
  "num_queued_requests": 123,
  "num_in_progress_requests": 123
}