Baseten provides a metrics endpoint in Prometheus format, allowing integration with observability tools like Prometheus, OpenTelemetry Collector, Datadog Agent, and Vector.

Setting Up Metrics Scraping

1

Scrape endpoint: https://app.baseten.co/metrics

2

Authentication

Use the Authorization header with a Baseten API key:

{"Authorization": "Api-Key YOUR_API_KEY"}
3

Scrape interval

Recommended 1-minute interval (metrics update every 30 seconds).

Supported Integrations

Baseten metrics can be collected via OpenTelemetry Collector and exported to:

For available metrics, see the supported metrics reference.

Rate Limits

  • 6 requests per minute per organization
  • Exceeding this limit results in **HTTP 429 (Too Many Requests) **responses.
  • To stay within limits, use a 1-minute scrape interval.