Export to Prometheus

Create a metrics-only API key. Store the key in a file that the Prometheus process can read, such as /etc/prometheus/secrets/baseten-api-key. Add a scrape job to your Prometheus configuration:

prometheus.yml

scrape_configs:
  - job_name: baseten
    scrape_interval: 60s
    metrics_path: /metrics
    scheme: https
    authorization:
      type: Bearer
      credentials_file: /etc/prometheus/secrets/baseten-api-key
    static_configs:
      - targets: [app.baseten.co]

Reload Prometheus, then check that the baseten target is healthy. Query up{job="baseten"} to check scrape success, then query a metric from the exported metrics reference. Each Prometheus instance counts toward the organization-wide rate limit. For other scrape settings, see the Prometheus configuration reference.

Get started

Model APIs

Inference

Training

Development

Deployment

Engines

Model Labs

Organization

Hosting options

Observability

Troubleshooting

Export to Prometheus