ai-lc4j-demos/demo-09

Demo 09 - Observability

The 3 main pillars of observability are logging, tracing, and metrics.

Logging

To ensure that our LLM interactions are monitored and logged, we need to implement logging in our application.

Metrics

It’s also important to gain insight into the performance and behavior of our application. Using these metrics, we can create meaningful graphs, dashboards and alerts.

Tracing

Tracing is another important aspect of observability. It involves tracking the flow of requests and responses through your application, and identifying any anomalies or inconsistencies that may indicate a problem. It also allows you to identify bottlenecks and areas for improvement in your application.