Metrics export overview
Export metrics from Baseten to your observability stack
Baseten exposes an endpoint that returns real-time metrics in the Prometheus format. By using this endpoint as a Prometheus / OpenMetrics scrape endpoint, you can integrate Baseten metrics with compatible software like Prometheus, OpenTelemetry Collector / Agent, Datadog Agent, Vector, and more.
To scrape metrics from Baseten:
- Set the scrape endpoint to
app.baseten.co/metrics
. - Configure the
Authorization
header for scrape requests. This should be set to your Baseten API key, prefixed withΒApi-Key
Β (e.g.Β{"Authorization": "Api-Key abcd1234.abcd1234"}
).- We recommend using workspace API keys with export metrics permission.
- Set an appropriate scrape interval. We recommend scraping metrics every minute.
Supported services
The Baseten metrics endpoint can be integrated with OpenTelemetry Collector by configuring a Prometheus receiver that scrapes the endpoint. Baseten metrics can be pushed to any exporter on the OpenTelemetry registry. We integrate with providers including:
For a list of supported metrics, see the supported metrics reference.
Rate limits
Calls to the Baseten metrics endpoint are limited on a per-organization basis to 6 requests per minute. If this limit is exceeded, subsequent calls will result in 429 responses.
To avoid hitting this limit, we recommend setting your scrape interval to 1 minute.