Get async queue status for a specific deployment.

GET

deployment

{deployment_id}

async_queue_status

curl --request GET \
  --url https://model-{model_id}.api.baseten.co/deployment/{deployment_id}/async_queue_status \
  --header 'Authorization: Bearer <token>'

{
  "model_id": "<string>",
  "deployment_id": "<string>",
  "num_queued_requests": 123,
  "num_in_progress_requests": 123
}

Authorizations

Authorization

string

header

required

Pass your Baseten API key. Clients automatically send Authorization: Bearer <key>. Direct callers can also use Authorization: Api-Key <key>; both schemes are accepted.

Path Parameters

deployment_id

string

required

The alphanumeric ID of the deployment.

Response

Async queue status for a deployment.

model_id

string

required

The ID of the model.

deployment_id

string

required

The ID of the deployment.

num_queued_requests

integer

required

Number of requests with QUEUED status awaiting processing.

num_in_progress_requests

integer

required

Number of requests currently being processed by the model.

Wake the production environment of a model.Triggers a wake for the deployment promoted to the production environment. Returns immediately with 202 Accepted.

⌘I

Get async queue status for a specific deployment.

curl --request GET \
  --url https://model-{model_id}.api.baseten.co/deployment/{deployment_id}/async_queue_status \
  --header 'Authorization: Bearer <token>'

{
  "model_id": "<string>",
  "deployment_id": "<string>",
  "num_queued_requests": 123,
  "num_in_progress_requests": 123
}