Skip to main content
The Baseten + Grafana Cloud integration enables you to get real-time inference metrics within your existing Grafana setup.

​
Video tutorial

See below for step-by-step details from the video.

​
Set up the integration

Before you start, generate a metrics-only workspace API key in your Baseten account. To set up the integration:
  1. Sign in to your Grafana Cloud account and go to Home > Connections > Add new connection.
  2. In the search bar, type Metrics Endpoint and select it.
  3. Give your scrape job a name like baseten_metrics_scrape.
  4. Set the scrape job URL to https://app.baseten.co/metrics.
  5. Leave the scrape interval set to Every minute.
  6. Select Bearer for authentication credentials.
  7. Enter the Bearer Token as Api-Key abcd.1234567890, replacing the latter value with your API key.
  8. Choose Test Connection to confirm everything is entered correctly.
  9. Choose Save Scrape Job.
  10. Choose Install.
  11. In your integrations list, select your new export and go through the Enable flow shown in the video.
Navigate to the Dashboards tab to see your data. Data can take a couple of minutes to arrive, and only new data is scraped, not historical metrics.

​
Build a Grafana dashboard

Importing the data is the first step, but you need a dashboard to visualize the incoming information. We’ve prepared a basic dashboard to get you started. To import it:
  1. Download baseten_grafana_dashboard.json from this GitHub Gist.
  2. Select New > Import from the dropdown in the top-right corner of the Dashboard page.
  3. Drop in the provided JSON file.
For a visual reference, see the video above.