(docs) cleanup
|
@ -76,7 +76,6 @@ Click on your personal dashboard link. Here's how you can find it 👇
|
||||||
|
|
||||||
Oh! Looks like our request was made successfully. Let's click on it and see exactly what got sent to the LLM provider.
|
Oh! Looks like our request was made successfully. Let's click on it and see exactly what got sent to the LLM provider.
|
||||||
|
|
||||||
<Image img={require('../../img/dashboard_log_row.png')} alt="Dashboard Log Row" />
|
|
||||||
|
|
||||||
|
|
||||||
|
|
||||||
|
|
|
@ -1,61 +0,0 @@
|
||||||
import Image from '@theme/IdealImage';
|
|
||||||
|
|
||||||
# 🚨 Budget Alerting
|
|
||||||
|
|
||||||
**Alerts when a project will exceed it’s planned limit**
|
|
||||||
|
|
||||||
<Image img={require('../../img/budget_alerts.png')} />
|
|
||||||
|
|
||||||
## Quick Start
|
|
||||||
|
|
||||||
### 1. Setup Slack Alerting on your Proxy Config.yaml
|
|
||||||
|
|
||||||
**Add Slack Webhook to your env**
|
|
||||||
Get a slack webhook url from https://api.slack.com/messaging/webhooks
|
|
||||||
|
|
||||||
|
|
||||||
Set `SLACK_WEBHOOK_URL` in your proxy env
|
|
||||||
|
|
||||||
```shell
|
|
||||||
export SLACK_WEBHOOK_URL="https://hooks.slack.com/services/<>/<>/<>"
|
|
||||||
```
|
|
||||||
|
|
||||||
**Update proxy config.yaml with slack alerting**
|
|
||||||
|
|
||||||
Add `general_settings:alerting`
|
|
||||||
```yaml
|
|
||||||
model_list:
|
|
||||||
model_name: "azure-model"
|
|
||||||
litellm_params:
|
|
||||||
model: "azure/gpt-35-turbo"
|
|
||||||
|
|
||||||
general_settings:
|
|
||||||
alerting: ["slack"]
|
|
||||||
```
|
|
||||||
|
|
||||||
|
|
||||||
|
|
||||||
Start proxy
|
|
||||||
```bash
|
|
||||||
$ litellm --config /path/to/config.yaml
|
|
||||||
```
|
|
||||||
|
|
||||||
|
|
||||||
### 2. Create API Key on Proxy Admin UI
|
|
||||||
The Admin UI is found on `your-litellm-proxy-endpoint/ui`, example `http://localhost:4000/ui/`
|
|
||||||
|
|
||||||
- Set a key name
|
|
||||||
- Set a Soft Budget on when to get alerted
|
|
||||||
|
|
||||||
<Image img={require('../../img/create_key.png')} />
|
|
||||||
|
|
||||||
|
|
||||||
### 3. Test Slack Alerting on Admin UI
|
|
||||||
After creating a key on the Admin UI, click on "Test Slack Alert" to send a test alert to your Slack channel
|
|
||||||
<Image img={require('../../img/test_alert.png')} />
|
|
||||||
|
|
||||||
### 4. Check Slack
|
|
||||||
|
|
||||||
When the test alert works, you should expect to see this on your alerts slack channel
|
|
||||||
|
|
||||||
<Image img={require('../../img/budget_alerts.png')} />
|
|
|
@ -95,5 +95,4 @@ completion_with_split_tests(
|
||||||
)
|
)
|
||||||
```
|
```
|
||||||
|
|
||||||
### A/B Testing Dashboard after running code - https://admin.litellm.ai/
|
|
||||||
<Image img={require('../../img/ab_test_logs.png')} />
|
|
||||||
|
|
Before Width: | Height: | Size: 263 KiB |
Before Width: | Height: | Size: 449 KiB |
Before Width: | Height: | Size: 66 KiB |
Before Width: | Height: | Size: 73 KiB |
Before Width: | Height: | Size: 89 KiB |
Before Width: | Height: | Size: 140 KiB |
Before Width: | Height: | Size: 386 KiB |
Before Width: | Height: | Size: 20 KiB |
Before Width: | Height: | Size: 429 KiB |
Before Width: | Height: | Size: 505 KiB |
Before Width: | Height: | Size: 468 KiB |
Before Width: | Height: | Size: 123 KiB |
Before Width: | Height: | Size: 203 KiB |
Before Width: | Height: | Size: 81 KiB |
Before Width: | Height: | Size: 82 KiB |
|
@ -43,7 +43,6 @@ const sidebars = {
|
||||||
"proxy/users",
|
"proxy/users",
|
||||||
"proxy/team_based_routing",
|
"proxy/team_based_routing",
|
||||||
"proxy/ui",
|
"proxy/ui",
|
||||||
"proxy/budget_alerts",
|
|
||||||
"proxy/cost_tracking",
|
"proxy/cost_tracking",
|
||||||
"proxy/token_auth",
|
"proxy/token_auth",
|
||||||
{
|
{
|
||||||
|
|