Commit graph

20 commits

Author SHA1 Message Date
Krish Dholakia
7f47c48b35 LiteLLM Minor Fixes and Improvements (09/10/2024) (#5618)
* fix(cost_calculator.py): move to debug for noisy warning message on cost calculation error

Fixes https://github.com/BerriAI/litellm/issues/5610

* fix(databricks/cost_calculator.py): Handles model name issues for databricks models

* fix(main.py): fix stream chunk builder for multiple tool calls

Fixes https://github.com/BerriAI/litellm/issues/5591

* fix: correctly set user_alias when passed in

Fixes https://github.com/BerriAI/litellm/issues/5612

* fix(types/utils.py): allow passing role for message object

https://github.com/BerriAI/litellm/issues/5621

* fix(litellm_logging.py): Fix langfuse logging across multiple projects

Fixes issue where langfuse logger was re-using the old logging object

* feat(proxy/_types.py): support adding key-based tags for tag-based routing

Enable tag based routing at key-level

* fix(proxy/_types.py): fix inheritance

* test(test_key_generate_prisma.py): fix test

* test: fix test

* fix(litellm_logging.py): return used callback object
2024-09-11 11:30:29 -07:00
Ishaan Jaff
a4ccffefd7 fix regen keys when no duration is passed 2024-09-10 08:04:18 -07:00
Ishaan Jaff
0e0decd6b9 add /key/list endpoint 2024-09-07 16:52:28 -07:00
Ishaan Jaff
16a3223474 fix linting 2024-09-06 16:54:43 -07:00
Ishaan Jaff
b3629ebdc5 allow passing expiry time to /key/regenerate 2024-09-06 08:36:34 -07:00
Krrish Dholakia
ea3fe34105 fix(key_management_endpoints.py): expose 'key' param, for setting your own key value 2024-08-28 12:27:32 -07:00
Ishaan Jaff
3ae7132cce enforce regenerating keys in enterprise tier 2024-08-26 18:54:50 -07:00
Ishaan Jaff
dd0d8658e1 update key name when regenerating a key 2024-08-26 18:40:51 -07:00
Ishaan Jaff
7e3f6ebf50 allow using hashed api keys on regen key 2024-08-26 18:15:52 -07:00
Ishaan Jaff
e69de5b426 add regenerate_key_fn 2024-08-26 17:59:44 -07:00
Krrish Dholakia
e32a68c94b refactor(team_endpoints.py): refactor auth checks for team member endpoints to ui team admin to manage it 2024-08-20 16:57:18 -07:00
Ishaan Jaff
50e9d05921 feat control guardrails per API Key 2024-08-20 08:16:28 -07:00
Ishaan Jaff
a2178c026b update tpm / rpm limit per model 2024-08-17 15:26:12 -07:00
Ishaan Jaff
2c5f5996f3 add tpm limits per api key per model 2024-08-17 13:20:55 -07:00
Ishaan Jaff
dbd98acb25 use management_endpoint_wrapper for key endpoints 2024-08-12 11:02:21 -07:00
Krrish Dholakia
254b6dc630 fix(key_management_endpoints.py): if budget duration set, set budget_reset_at 2024-07-24 15:02:22 -07:00
Ishaan Jaff
4202be8e1f raise budget_exceeded in user_api_key_auth 2024-07-08 12:45:39 -07:00
Krrish Dholakia
622a99ad5d feat(internal_user_endpoints.py): expose /user/delete endpoint 2024-06-24 13:29:26 -07:00
Krrish Dholakia
9032fd0cce fix(key_management_endpoints.py): use common _duration_in_seconds function 2024-06-20 17:02:31 -07:00
Ishaan Jaff
abb544190a fix - refactor key endpoints 2024-06-15 14:13:32 -07:00