mirror of
https://github.com/BerriAI/litellm.git
synced 2025-04-27 03:34:10 +00:00
docs(index.md): new release notes
This commit is contained in:
parent
00560ab8df
commit
0774fc71ce
2 changed files with 76 additions and 1 deletions
|
@ -1,6 +1,8 @@
|
|||
# ✨ Budget / Rate Limit Tiers
|
||||
|
||||
Create tiers with different budgets and rate limits. Making it easy to manage different users and their usage.
|
||||
Define tiers with rate limits. Assign them to keys.
|
||||
|
||||
Use this to control access and budgets across a lot of keys.
|
||||
|
||||
:::info
|
||||
|
||||
|
|
73
docs/my-website/release_notes/v1.56.1/index.md
Normal file
73
docs/my-website/release_notes/v1.56.1/index.md
Normal file
|
@ -0,0 +1,73 @@
|
|||
import Image from '@theme/IdealImage';
|
||||
|
||||
# v1.56.1
|
||||
|
||||
`key management`, `budgets/rate limits`, `logging`, `guardrails`
|
||||
|
||||
:::info
|
||||
|
||||
Get a 7 day free trial for LiteLLM Enterprise [here](https://litellm.ai/#trial).
|
||||
|
||||
**no call needed**
|
||||
|
||||
:::
|
||||
|
||||
## ✨ Budget / Rate Limit Tiers
|
||||
|
||||
Define tiers with rate limits. Assign them to keys.
|
||||
|
||||
Use this to control access and budgets across a lot of keys.
|
||||
|
||||
**[Start here](https://docs.litellm.ai/docs/proxy/rate_limit_tiers)**
|
||||
|
||||
```bash
|
||||
curl -L -X POST 'http://0.0.0.0:4000/budget/new' \
|
||||
-H 'Authorization: Bearer sk-1234' \
|
||||
-H 'Content-Type: application/json' \
|
||||
-d '{
|
||||
"budget_id": "high-usage-tier",
|
||||
"model_max_budget": {
|
||||
"gpt-4o": {"rpm_limit": 1000000}
|
||||
}
|
||||
}'
|
||||
```
|
||||
|
||||
|
||||
## OTEL Bug Fix
|
||||
|
||||
LiteLLM was double logging litellm_request span. This is now fixed.
|
||||
|
||||
[Relevant PR](https://github.com/BerriAI/litellm/pull/7435)
|
||||
|
||||
## Logging for Finetuning Endpoints
|
||||
|
||||
Logs for finetuning requests are now available on all logging providers (e.g. Datadog).
|
||||
|
||||
What's logged per request:
|
||||
|
||||
- file_id
|
||||
- finetuning_job_id
|
||||
- any key/team metadata
|
||||
|
||||
|
||||
**Start Here:**
|
||||
- [Setup Finetuning](https://docs.litellm.ai/docs/fine_tuning)
|
||||
- [Setup Logging](https://docs.litellm.ai/docs/proxy/logging#datadog)
|
||||
|
||||
## Dynamic Params for Guardrails
|
||||
|
||||
You can now set custom parameters (like success threshold) for your guardrails in each request.
|
||||
|
||||
[See guardrails spec for more details](https://docs.litellm.ai/docs/proxy/guardrails/custom_guardrail#-pass-additional-parameters-to-guardrail)
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
|
Loading…
Add table
Add a link
Reference in a new issue