Get async queue status for the production environment.

curl --request GET \
  --url https://model-{model_id}.api.baseten.co/production/async_queue_status \
  --header 'Authorization: <api-key>'

{
  "model_id": "<string>",
  "deployment_id": "<string>",
  "num_queued_requests": 123,
  "num_in_progress_requests": 123
}

Authorization

string

header

required

API key with the Api-Key prefix, e.g. Authorization: Api-Key abcd1234.abcd1234.

Async queue status for a deployment.

model_id

string

required

The ID of the model.

deployment_id

string

required

The ID of the deployment.

num_queued_requests

integer

required

Number of requests with QUEUED status awaiting processing.

num_in_progress_requests

integer

required

Number of requests currently being processed by the model.

⌘I

Get async queue status for the production environment.

curl --request GET \
  --url https://model-{model_id}.api.baseten.co/production/async_queue_status \
  --header 'Authorization: <api-key>'

{
  "model_id": "<string>",
  "deployment_id": "<string>",
  "num_queued_requests": 123,
  "num_in_progress_requests": 123
}