Skip to main content
Baseten enforces two rate limits to ensure fair use and system stability:
  • Request rate limits: Maximum API requests per minute.
  • Token rate limits: Maximum tokens processed per minute (input + output combined). Cached input tokens count at full weight: a token served from the KV cache costs less but counts the same toward the token rate limit as an uncached one.
Default limits vary by account status. If your workspace is on the Basic (unverified) tier and you need the higher Basic (verified) limits, contact us to request verification. To move to the Pro or Enterprise tier, contact us through the same form.
If you exceed these limits, the API returns a 429 Too Many Requests error. See Inference errors for how to respond. To request a rate limit increase, contact us.

​
Budgets

You can set a monthly budget to receive email notifications as your workspace’s total spend approaches a configured amount. If you choose to enforce a budget, Model API requests will be rejected once the budget is reached. Budget enforcement doesn’t affect dedicated inference or training.

​
Next steps

Inference errors

Handle 429 Too Many Requests and other status codes

Model APIs overview

Supported models, pricing, and feature support