docs(index.md): new release notes

This commit is contained in:
Krrish Dholakia 2024-12-26 22:01:29 -08:00
parent 00560ab8df
commit 0774fc71ce
2 changed files with 76 additions and 1 deletions

View file

@ -1,6 +1,8 @@
# ✨ Budget / Rate Limit Tiers # ✨ Budget / Rate Limit Tiers
Create tiers with different budgets and rate limits. Making it easy to manage different users and their usage. Define tiers with rate limits. Assign them to keys.
Use this to control access and budgets across a lot of keys.
:::info :::info

View file

@ -0,0 +1,73 @@
import Image from '@theme/IdealImage';
# v1.56.1
`key management`, `budgets/rate limits`, `logging`, `guardrails`
:::info
Get a 7 day free trial for LiteLLM Enterprise [here](https://litellm.ai/#trial).
**no call needed**
:::
## ✨ Budget / Rate Limit Tiers
Define tiers with rate limits. Assign them to keys.
Use this to control access and budgets across a lot of keys.
**[Start here](https://docs.litellm.ai/docs/proxy/rate_limit_tiers)**
```bash
curl -L -X POST 'http://0.0.0.0:4000/budget/new' \
-H 'Authorization: Bearer sk-1234' \
-H 'Content-Type: application/json' \
-d '{
"budget_id": "high-usage-tier",
"model_max_budget": {
"gpt-4o": {"rpm_limit": 1000000}
}
}'
```
## OTEL Bug Fix
LiteLLM was double logging litellm_request span. This is now fixed.
[Relevant PR](https://github.com/BerriAI/litellm/pull/7435)
## Logging for Finetuning Endpoints
Logs for finetuning requests are now available on all logging providers (e.g. Datadog).
What's logged per request:
- file_id
- finetuning_job_id
- any key/team metadata
**Start Here:**
- [Setup Finetuning](https://docs.litellm.ai/docs/fine_tuning)
- [Setup Logging](https://docs.litellm.ai/docs/proxy/logging#datadog)
## Dynamic Params for Guardrails
You can now set custom parameters (like success threshold) for your guardrails in each request.
[See guardrails spec for more details](https://docs.litellm.ai/docs/proxy/guardrails/custom_guardrail#-pass-additional-parameters-to-guardrail)