Observability
Tracing
Investigate the prediction flow in detail
Baseten’s Truss server includes built-in OpenTelemetry (OTEL) instrumentation, with support for custom tracing.
Tracing helps diagnose performance bottlenecks but introduces minor overhead, so it is disabled by default.
Exporting builtin trace data to Honeycomb
- Create a Honeycomb API key and add it to Baseten secrets.
- Update
config.yaml
for the target model:
config.yaml
- Send requests with tracing
- Provide traceparent headers for distributed tracing.
- If omitted, Baseten generates random trace IDs.
Adding custom OTEL instrumentation
To define custom spans and events, integrate OTEL directly:
model.py
Baseten’s built-in tracing does not interfere with user-defined OTEL implementations.
Was this page helpful?