phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

docs(prometheus.md): add litellm service metrics to prometheus docs

Browse source
This commit is contained in:
Krrish Dholakia 2024-04-18 16:06:12 -07:00
parent 0f95a824c4
commit 48d3b563d8
1 changed files with 2 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

2
docs/my-website/docs/proxy/prometheus.md
View file

@ -14,6 +14,7 @@ model_list:
model: gpt-3.5-turbo model: gpt-3.5-turbo
litellm_settings: litellm_settings:
success_callback: ["prometheus"] success_callback: ["prometheus"]
failure_callback: ["prometheus"]
``` ```
Start the proxy Start the proxy
@ -70,3 +71,4 @@ litellm_settings:
|----------------------|--------------------------------------| |----------------------|--------------------------------------|
| `litellm_redis_latency` | histogram latency for redis calls | | `litellm_redis_latency` | histogram latency for redis calls |
| `litellm_redis_fails` | Number of failed redis calls | | `litellm_redis_fails` | Number of failed redis calls |
| `litellm_self_latency` | Histogram latency for successful litellm api call |