Skip to main content
Baseten’s Truss server includes built-in OpenTelemetry (OTEL) instrumentation, with support for custom tracing. Tracing helps diagnose performance bottlenecks but introduces minor overhead, so it is disabled by default.

Export builtin trace data to Honeycomb

To export built-in trace data to Honeycomb:
  1. Create a Honeycomb API key and add it to Baseten secrets.
  2. Update config.yaml for the target model:
    config.yaml
  3. Send requests with traceparent headers for distributed tracing. If omitted, Baseten generates random trace IDs.

Add custom OTEL instrumentation

To define custom spans and events, integrate OTEL directly:
model.py
Baseten’s built-in tracing does not interfere with user-defined OTEL implementations.