phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

docs add litellm_error_code_metric_total

Browse source
This commit is contained in:
Ishaan Jaff 2024-08-31 14:46:41 -07:00
parent 6ab601432b
commit e6faaba56e
1 changed files with 14 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

14
docs/my-website/docs/proxy/prometheus.md
View file

@ -58,6 +58,15 @@ http://localhost:4000/metrics
## 📈 Metrics Tracked ## 📈 Metrics Tracked
### Error Metrics
| Metric Name | Description |
|----------------------|--------------------------------------|
| `litellm_error_code_metric_total` | Total number of errors by error code and model |
This metric provides a count of errors encountered, categorized by error code and model. For example:
### Proxy Requests / Spend Metrics ### Proxy Requests / Spend Metrics
@ -66,7 +75,12 @@ http://localhost:4000/metrics
| `litellm_requests_metric` | Number of requests made, per `"user", "key", "model", "team", "end-user"` | | `litellm_requests_metric` | Number of requests made, per `"user", "key", "model", "team", "end-user"` |
| `litellm_spend_metric` | Total Spend, per `"user", "key", "model", "team", "end-user"` | | `litellm_spend_metric` | Total Spend, per `"user", "key", "model", "team", "end-user"` |
| `litellm_total_tokens` | input + output tokens per `"user", "key", "model", "team", "end-user"` | | `litellm_total_tokens` | input + output tokens per `"user", "key", "model", "team", "end-user"` |
### Error Monitoring Metrics
| Metric Name | Description |
| `litellm_llm_api_failed_requests_metric` | Number of failed LLM API requests per `"user", "key", "model", "team", "end-user"` | | `litellm_llm_api_failed_requests_metric` | Number of failed LLM API requests per `"user", "key", "model", "team", "end-user"` |
| `litellm_error_code_metric_total` | Total number of errors by error code and model |
### Request Latency Metrics ### Request Latency Metrics