(docs) grafana / prometheus

This commit is contained in:
Ishaan Jaff 2024-03-29 14:25:45 -07:00
parent c2283235a1
commit 24570bc075
3 changed files with 10 additions and 6 deletions

View file

@ -34,6 +34,12 @@ curl --location 'http://0.0.0.0:4000/chat/completions' \
}'
```
View Metrics on `/metrics`, Visit `http://localhost:4000/metrics`
```shell
http://localhost:4000/metrics
# <proxy_base_url>/metrics
```
## Metrics Tracked

View file

@ -43,8 +43,5 @@ model_list:
model: openai/fake
api_key: fake-key
api_base: https://exampleopenaiendpoint-production.up.railway.app/
general_settings:
master_key: sk-1234
disable_spend_logs: true
disable_reset_budget: true
num_retries: 2
litellm_settings:
success_callback: ["prometheus"]

View file

@ -6235,7 +6235,8 @@ def set_callbacks(callback_list, function_id=None):
elif callback == "datadog":
dataDogLogger = DataDogLogger()
elif callback == "prometheus":
prometheusLogger = PrometheusLogger()
if prometheusLogger is None:
prometheusLogger = PrometheusLogger()
elif callback == "dynamodb":
dynamoLogger = DyanmoDBLogger()
elif callback == "s3":