Rate limits

Baseten enforces per-API-key rate limits on the management API. The limits protect shared infrastructure, such as the build queue, from bursty automation.

Limits

Default limits vary by endpoint. Endpoints used for frequent status polling have higher limits than most other management operations. Baseten can adjust these defaults based on usage. Handle 429 responses using retry_after so your automation adapts to the limit that applies to each request. Contact support to confirm the limits for your workload or request an increase. The following endpoints have specific limits:

Endpoint	Limit
`POST /v1/models/{model_id}/deployments/development/activate`	20 requests/minute
`POST /v1/models/{model_id}/deployments/production/activate`	20 requests/minute
`POST /v1/models/{model_id}/deployments/{deployment_id}/activate`	20 requests/minute
`POST /v1/models/{model_id}/deployments/development/deactivate`	20 requests/minute
`POST /v1/models/{model_id}/deployments/production/deactivate`	20 requests/minute
`POST /v1/models/{model_id}/deployments/{deployment_id}/deactivate`	20 requests/minute
`POST /v1/models/{model_id}/deployments/development/retry`	10 requests/minute
`POST /v1/models/{model_id}/deployments/production/retry`	10 requests/minute
`POST /v1/models/{model_id}/deployments/{deployment_id}/retry`	10 requests/minute
`POST /v1/models/{model_id}/deployments/{deployment_id}/logs`	30 requests/second

Baseten tracks usage separately for each API key and endpoint. If your organization has a custom limit for an endpoint, that limit takes precedence over the default.

Rate-limited responses

A request over the limit returns 429 Too Many Requests:

{
  "error": "Rate limit exceeded. Please try again later.",
  "retry_after": 37
}

retry_after is the number of seconds until the current rate-limit window resets. Wait at least that long before retrying.

Retry handling

For CI pipelines or scripts that call the management API in a loop, handle 429 explicitly:

import time
import requests

def post_with_retry(url, headers, max_attempts=5):
    for _ in range(max_attempts):
        response = requests.post(url, headers=headers)
        if response.status_code != 429:
            return response
        retry_after = response.json().get("retry_after", 1)
        time.sleep(retry_after)
    return response

Back off on retry_after instead of retrying immediately. A tight retry loop wastes API calls; the server rejects every request until the window resets.

Request higher limits

If your workload needs sustained throughput above the default limits, contact support to request per-endpoint increases for your organization.

Reference

Inference API

Management API

Loops API

Training API

Frontier Gateway API

CLI reference

SDKs and clients

Configuration

Metrics

Integrations

Limits

Rate-limited responses

Retry handling

Request higher limits

​Limits

​Rate-limited responses

​Retry handling

​Request higher limits

Limits

Rate-limited responses

Retry handling

Request higher limits