Metrics export overview

Baseten exposes an endpoint that returns real-time metrics in the Prometheus format. By using this endpoint as a Prometheus / OpenMetrics scrape endpoint, you can integrate Baseten metrics with compatible software like Prometheus, OpenTelemetry Collector / Agent, Datadog Agent, Vector, and more.

To scrape metrics from Baseten:

1. Set the scrape endpoint to app.baseten.co/metrics.
2. Configure the Authorization header for scrape requests. This should be set to your Baseten API key, prefixed with Api-Key (e.g. {"Authorization": "Api-Key abcd1234.abcd1234"}).
   • We recommend using workspace API keys with export metrics permission.
3. Set an appropriate scrape interval. We recommend scraping metrics every minute.

Note that the metrics endpoint is updated every 30 seconds.

​

Supported services

The Baseten metrics endpoint can be integrated with OpenTelemetry Collector by configuring a Prometheus receiver that scrapes the endpoint. Baseten metrics can be pushed to any exporter on the OpenTelemetry registry. We integrate with providers including:

• Prometheus
• Datadog
• Grafana
• New Relic

For a list of supported metrics, see the supported metrics reference.

​

Rate limits

Calls to the Baseten metrics endpoint are limited on a per-organization basis to 6 requests per minute. If this limit is exceeded, subsequent calls will result in 429 responses.

To avoid hitting this limit, we recommend setting your scrape interval to 1 minute.