mirror of
https://github.com/BerriAI/litellm.git
synced 2025-04-25 02:34:29 +00:00
792ee079c2
* docs: update docs * docs: additional cleanup * docs(index.md): add initial links * docs: more doc updates * docs(index.md): add more links * docs(files.md): add gemini files API to docs * docs(index.md): add more docs * docs: more docs * docs: update docs
2.3 KiB
2.3 KiB
| title | slug | date | authors | tags | hide_table_of_contents | ||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| v1.56.1 | v1.56.1 | 2024-12-27T10:00:00 |
|
|
false |
import Image from '@theme/IdealImage';
v1.56.1
key management, budgets/rate limits, logging, guardrails
:::info
Get a 7 day free trial for LiteLLM Enterprise here.
no call needed
:::
✨ Budget / Rate Limit Tiers
Define tiers with rate limits. Assign them to keys.
Use this to control access and budgets across a lot of keys.
curl -L -X POST 'http://0.0.0.0:4000/budget/new' \
-H 'Authorization: Bearer sk-1234' \
-H 'Content-Type: application/json' \
-d '{
"budget_id": "high-usage-tier",
"model_max_budget": {
"gpt-4o": {"rpm_limit": 1000000}
}
}'
OTEL Bug Fix
LiteLLM was double logging litellm_request span. This is now fixed.
Logging for Finetuning Endpoints
Logs for finetuning requests are now available on all logging providers (e.g. Datadog).
What's logged per request:
- file_id
- finetuning_job_id
- any key/team metadata
Start Here:
Dynamic Params for Guardrails
You can now set custom parameters (like success threshold) for your guardrails in each request.