(feat proxy) add v2 maintained LiteLLM grafana dashboard (#6098)

* add new grafana dashboard litellm

* add v2 grafana dashboard
This commit is contained in:
Ishaan Jaff 2024-10-07 18:11:20 +05:30 committed by GitHub
parent 2c8bba293f
commit 1bafbf8382
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
5 changed files with 820 additions and 2 deletions

View file

@ -1,5 +1,6 @@
import Tabs from '@theme/Tabs';
import TabItem from '@theme/TabItem';
import Image from '@theme/IdealImage';
# 📈 Prometheus metrics
@ -169,12 +170,22 @@ litellm_settings:
| `litellm_redis_fails` | Number of failed redis calls |
| `litellm_self_latency` | Histogram latency for successful litellm api call |
## 🔥 Community Maintained Grafana Dashboards
## **🔥 LiteLLM Maintained Grafana Dashboards **
Link to Grafana Dashboards made by LiteLLM community
Link to Grafana Dashboards maintained by LiteLLM
https://github.com/BerriAI/litellm/tree/main/cookbook/litellm_proxy_server/grafana_dashboard
Here is a screenshot of the metrics you can monitor with the LiteLLM Grafana Dashboard
<Image img={require('../../img/grafana_1.png')} />
<Image img={require('../../img/grafana_2.png')} />
<Image img={require('../../img/grafana_3.png')} />
## Deprecated Metrics
| Metric Name | Description |

Binary file not shown.

After

Width:  |  Height:  |  Size: 211 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 130 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 133 KiB