Commit graph

3536 commits

Author SHA1 Message Date
Ishaan Jaff
9f9d43df44 enable_tag_filtering 2024-08-29 14:14:46 -07:00
Ishaan Jaff
8a677bffa4 add test_chat_completion_with_no_tags 2024-08-29 13:54:11 -07:00
Ishaan Jaff
6d57b5f803 define tags on model list 2024-08-29 13:06:39 -07:00
Ishaan Jaff
bc06920f04 add_team_based_tags_to_metadata 2024-08-29 13:06:03 -07:00
Ishaan Jaff
3bed17fc95 add set / update tags for a team 2024-08-29 13:05:00 -07:00
Ishaan Jaff
080ecb9f4a allow settings tags per team 2024-08-29 13:03:49 -07:00
Krish Dholakia
9327326100 Merge pull request #5414 from BerriAI/litellm_main_staging
fixes: minor litellm fixes
2024-08-28 22:01:01 -07:00
Krrish Dholakia
fd26e7b335 fix(team_endpoints.py): update to include the budget in the response 2024-08-28 21:58:41 -07:00
Krrish Dholakia
a8ea301bbe feat(team_endpoints.py): return team member budgets in /team/info call
Fixes https://github.com/BerriAI/litellm/issues/5390
2024-08-28 19:14:01 -07:00
Krish Dholakia
0e0db9a5af Merge branch 'main' into litellm_main_staging 2024-08-28 18:05:27 -07:00
Krrish Dholakia
6e4f0a95da fix(router.py): fix cooldown check 2024-08-28 16:38:42 -07:00
Ishaan Jaff
a27cf9960b Merge pull request #5420 from BerriAI/litellm_add_oauth2_mapping
[Feat-Proxy] Add hook for oauth2 proxy headers
2024-08-28 16:34:26 -07:00
Ishaan Jaff
51b6bbbdd3 Merge branch 'main' into litellm_add_request_body_safety_checks 2024-08-28 16:14:46 -07:00
Ishaan Jaff
f2c0e4d31e add hook for oauth2 proxy 2024-08-28 15:51:20 -07:00
Ishaan Jaff
f0ba94000d Merge pull request #5409 from BerriAI/litellm_ui_budgets
[UI] Allow editing budget duration
2024-08-28 14:43:57 -07:00
Ishaan Jaff
b8c092d430 new ui build 2024-08-28 14:43:33 -07:00
Ishaan Jaff
86d4504c7b fix checking request body 2024-08-28 14:10:09 -07:00
Ishaan Jaff
51d20628cd add checks for safe request body 2024-08-28 14:07:53 -07:00
Ishaan Jaff
5ff7e33dd8 add check for is_request_body_safe 2024-08-28 13:40:14 -07:00
Krrish Dholakia
ea3fe34105 fix(key_management_endpoints.py): expose 'key' param, for setting your own key value 2024-08-28 12:27:32 -07:00
Krrish Dholakia
276609f297 fix(rds_iam_token.py): support common aws env var's - AWS_ROLE_ARN, AWS_WEB_IDENTITY_TOKEN_FILE 2024-08-28 12:18:45 -07:00
Krrish Dholakia
cc2e1e1c43 fix(rds_iam_token.py): fix boto3 client init for rds 2024-08-28 12:15:57 -07:00
Krrish Dholakia
74081d31f6 fix(proxy/utils.py): fix model dump to exclude none values 2024-08-28 12:02:44 -07:00
Krrish Dholakia
b4c726d3e3 build(model_prices_and_context_window.json): add bedrock mistral small 2024-08-28 10:12:16 -07:00
Ishaan Jaff
d4db993130 add /rerank test 2024-08-27 17:50:37 -07:00
Ishaan Jaff
df4f1458e6 feat - add rerank on proxy 2024-08-27 17:36:40 -07:00
Ishaan Jaff
001882c14e Merge pull request #5392 from BerriAI/litellm_add_native_cohere_rerank
[Feat] Add cohere rerank and together ai rerank
2024-08-27 17:29:37 -07:00
Ishaan Jaff
359a003ac8 v0 add rerank on litellm proxy 2024-08-27 17:28:39 -07:00
Krrish Dholakia
d3105d8576 test(test_proxy_exception_mapping): loosen assert 2024-08-27 16:14:30 -07:00
Krrish Dholakia
722ccba323 fix(bedrock_httpx.py): support 'Auth' header as extra_header
Fixes https://github.com/BerriAI/litellm/issues/5389#issuecomment-2313677977
2024-08-27 16:08:54 -07:00
Krrish Dholakia
07dd3c640b perf(sagemaker.py): asyncify hf prompt template check
leads to 189% improvement in RPS @ 100 users
2024-08-27 07:37:06 -07:00
Ishaan Jaff
d682d5ed95 fix created_at and updated_at not existing error 2024-08-26 21:04:39 -07:00
Ishaan Jaff
ffb752d878 fix entrypoint 2024-08-26 20:32:23 -07:00
Ishaan Jaff
8059b6a7c3 ui new build 2024-08-26 19:01:35 -07:00
Ishaan Jaff
3ae7132cce enforce regenerating keys in enterprise tier 2024-08-26 18:54:50 -07:00
Ishaan Jaff
dd0d8658e1 update key name when regenerating a key 2024-08-26 18:40:51 -07:00
Ishaan Jaff
7e3f6ebf50 allow using hashed api keys on regen key 2024-08-26 18:15:52 -07:00
Ishaan Jaff
e69de5b426 add regenerate_key_fn 2024-08-26 17:59:44 -07:00
Ishaan Jaff
a6b5ba69ca fix schema 2024-08-26 17:27:06 -07:00
Ishaan Jaff
1f06f845a8 add key_state created at to token 2024-08-26 16:52:33 -07:00
Ishaan Jaff
ac39aefabe update schema 2024-08-26 16:52:19 -07:00
Krrish Dholakia
a3d403ec63 fix: fix tests 2024-08-24 19:32:22 -07:00
Krrish Dholakia
22bdc30f97 fix(utils.py): fix linting errors 2024-08-24 17:51:59 -07:00
Ishaan Jaff
7be10f1714 ui new build 2024-08-24 16:45:53 -07:00
Ishaan Jaff
99ea908257 fix linting errors when adding a new team member 2024-08-24 16:38:43 -07:00
Ishaan Jaff
d41f901346 Merge pull request #5352 from BerriAI/litellm_allow_setting_caching_mode
[Feat-Caching] allow setting caching mode to default off
2024-08-24 16:27:45 -07:00
Ishaan Jaff
8a72d1b9c1 fix set Caching Default Off 2024-08-24 09:43:39 -07:00
Krrish Dholakia
17a795a0f2 feat(team_endpoints.py): expose 2 new fields - updated_users and updated_team_memberships, on /team/member_add
Fixes https://github.com/BerriAI/litellm/issues/5345#issuecomment-2307863265

Helps user see the stored budget per team member
2024-08-24 09:22:16 -07:00
Krrish Dholakia
e7d914e96b fix(proxy_server.py): fix post /v1/batches endpoint
Fixes https://github.com/BerriAI/litellm/issues/5279#issuecomment-2307919820
2024-08-23 20:38:00 -07:00
Ishaan Jaff
b0db17bd5c Merge pull request #5346 from BerriAI/litellm_Add_vertex_text_to_speech
[Feat-LiteLLM] Add Vertex AI - Text to speech support
2024-08-23 18:29:53 -07:00