forked from phoenix/litellm-mirror
(docs) grafana / prometheus
This commit is contained in:
parent
c2283235a1
commit
24570bc075
3 changed files with 10 additions and 6 deletions
|
@ -34,6 +34,12 @@ curl --location 'http://0.0.0.0:4000/chat/completions' \
|
|||
}'
|
||||
```
|
||||
|
||||
View Metrics on `/metrics`, Visit `http://localhost:4000/metrics`
|
||||
```shell
|
||||
http://localhost:4000/metrics
|
||||
|
||||
# <proxy_base_url>/metrics
|
||||
```
|
||||
|
||||
## Metrics Tracked
|
||||
|
||||
|
|
|
@ -43,8 +43,5 @@ model_list:
|
|||
model: openai/fake
|
||||
api_key: fake-key
|
||||
api_base: https://exampleopenaiendpoint-production.up.railway.app/
|
||||
general_settings:
|
||||
master_key: sk-1234
|
||||
disable_spend_logs: true
|
||||
disable_reset_budget: true
|
||||
num_retries: 2
|
||||
litellm_settings:
|
||||
success_callback: ["prometheus"]
|
|
@ -6235,7 +6235,8 @@ def set_callbacks(callback_list, function_id=None):
|
|||
elif callback == "datadog":
|
||||
dataDogLogger = DataDogLogger()
|
||||
elif callback == "prometheus":
|
||||
prometheusLogger = PrometheusLogger()
|
||||
if prometheusLogger is None:
|
||||
prometheusLogger = PrometheusLogger()
|
||||
elif callback == "dynamodb":
|
||||
dynamoLogger = DyanmoDBLogger()
|
||||
elif callback == "s3":
|
||||
|
|
Loading…
Add table
Add a link
Reference in a new issue