From e6faaba56e83585995dd0b6ce8ac89c29d1f12c7 Mon Sep 17 00:00:00 2001 From: Ishaan Jaff Date: Sat, 31 Aug 2024 14:46:41 -0700 Subject: [PATCH] docs add litellm_error_code_metric_total --- docs/my-website/docs/proxy/prometheus.md | 14 ++++++++++++++ 1 file changed, 14 insertions(+) diff --git a/docs/my-website/docs/proxy/prometheus.md b/docs/my-website/docs/proxy/prometheus.md index 10e6456c2..6ccf0e44e 100644 --- a/docs/my-website/docs/proxy/prometheus.md +++ b/docs/my-website/docs/proxy/prometheus.md @@ -58,6 +58,15 @@ http://localhost:4000/metrics ## 📈 Metrics Tracked +### Error Metrics + +| Metric Name | Description | +|----------------------|--------------------------------------| +| `litellm_error_code_metric_total` | Total number of errors by error code and model | + +This metric provides a count of errors encountered, categorized by error code and model. For example: + + ### Proxy Requests / Spend Metrics @@ -66,7 +75,12 @@ http://localhost:4000/metrics | `litellm_requests_metric` | Number of requests made, per `"user", "key", "model", "team", "end-user"` | | `litellm_spend_metric` | Total Spend, per `"user", "key", "model", "team", "end-user"` | | `litellm_total_tokens` | input + output tokens per `"user", "key", "model", "team", "end-user"` | + +### Error Monitoring Metrics + +| Metric Name | Description | | `litellm_llm_api_failed_requests_metric` | Number of failed LLM API requests per `"user", "key", "model", "team", "end-user"` | +| `litellm_error_code_metric_total` | Total number of errors by error code and model | ### Request Latency Metrics