phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

(docs) grafana / prometheus

Browse source
This commit is contained in:
Ishaan Jaff 2024-03-29 14:25:45 -07:00
parent c2283235a1
commit 24570bc075
3 changed files with 10 additions and 6 deletions
Download patch file Download diff file Expand all files Collapse all files

6
docs/my-website/docs/proxy/grafana_metrics.md
View file

@ -34,6 +34,12 @@ curl --location 'http://0.0.0.0:4000/chat/completions' \
}' }'
``` ```
View Metrics on `/metrics`, Visit `http://localhost:4000/metrics`
```shell
http://localhost:4000/metrics
# <proxy_base_url>/metrics
```
## Metrics Tracked ## Metrics Tracked

7
litellm/proxy/proxy_config.yaml
View file

@ -43,8 +43,5 @@ model_list:
model: openai/fake model: openai/fake
api_key: fake-key api_key: fake-key
api_base: https://exampleopenaiendpoint-production.up.railway.app/ api_base: https://exampleopenaiendpoint-production.up.railway.app/
general_settings: litellm_settings:
master_key: sk-1234 success_callback: ["prometheus"]
disable_spend_logs: true
disable_reset_budget: true
num_retries: 2

1
litellm/utils.py
View file

@ -6235,6 +6235,7 @@ def set_callbacks(callback_list, function_id=None):
elif callback == "datadog": elif callback == "datadog":
dataDogLogger = DataDogLogger() dataDogLogger = DataDogLogger()
elif callback == "prometheus": elif callback == "prometheus":
if prometheusLogger is None:
prometheusLogger = PrometheusLogger() prometheusLogger = PrometheusLogger()
elif callback == "dynamodb": elif callback == "dynamodb":
dynamoLogger = DyanmoDBLogger() dynamoLogger = DyanmoDBLogger()