llama-stack-mirror/llama_stack/providers/inline/telemetry/otel

Open Telemetry Native Instrumentation

This instrumentation package is simple, and follows expected open telemetry standards. It injects middleware for distributed tracing into all ingress and egress points into the application, and can be tuned and configured with OTEL environment variables.

Set Up

First, bootstrap and install all necessary libraries for open telemtry:

uv run opentelemetry-bootstrap -a requirements | uv pip install --requirement -

Make sure you export required environment variables for open telemetry:

export OTEL_EXPORTER_OTLP_PROTOCOL=http/protobuf
export OTEL_EXPORTER_OTLP_ENDPOINT="http://localhost:4318"

If you want certian endpoints to be ignored from the fast API telemetry, set the following environment variable:

export OTEL_PYTHON_FASTAPI_EXCLUDED_URLS="client/.*/info,healthcheck"

Finaly, run Llama Stack with automatic code injection:

uv run opentelemetry-instrument llama stack run --config myconfig.yaml

Open Telemetry Configuration Environment Variables

Environment Variables: https://opentelemetry.io/docs/specs/otel/configuration/sdk-environment-variables/