Commit graph

10957 commits

Author SHA1 Message Date
Ishaan Jaff
ef47b2bc87 mark test_cost_tracking_with_caching as flaky 2024-08-29 17:44:21 -07:00
Ishaan Jaff
e329c4509a
Merge branch 'main' into litellm_add_tag_control_team 2024-08-29 17:34:40 -07:00
Ishaan Jaff
010f526226
Merge branch 'main' into litellm_fwd_vtx_sdk_headers 2024-08-29 17:24:31 -07:00
Ishaan Jaff
a4b88c16dc fix indentation 2024-08-29 17:01:23 -07:00
Ishaan Jaff
748cc80783 fix auth checks for provider routes 2024-08-29 16:40:46 -07:00
Ishaan Jaff
41a5daf20c add test for vertex sdk foward headers 2024-08-29 15:50:54 -07:00
Ishaan Jaff
9fb188a3b6 vertex add vertex endpoints 2024-08-29 15:49:25 -07:00
Krrish Dholakia
601945d114 docs(docker_quick_start.md): add new quick start doc for litellm proxy 2024-08-29 15:35:39 -07:00
Ishaan Jaff
4b7ceade64 mark test_key_info_spend_values_streaming as flaky 2024-08-29 14:39:53 -07:00
Ishaan Jaff
da2cefc45a fix team based tag routing 2024-08-29 14:37:44 -07:00
Ishaan Jaff
208fe6cb90
Merge pull request #5430 from Manouchehri/bedrock-cross-inference-1
(bedrock): Add new cross-region inference support for Bedrock.
2024-08-29 14:30:11 -07:00
Ishaan Jaff
5851a8f901
Merge pull request #5431 from BerriAI/litellm_Add_fireworks_ai_health_check
[Fix-Proxy] /health check for provider wildcard models (fireworks/*)
2024-08-29 14:25:05 -07:00
Ishaan Jaff
242f66054d enable_tag_filtering 2024-08-29 14:14:46 -07:00
Ishaan Jaff
f592aeaa38 add test_chat_completion_with_no_tags 2024-08-29 13:54:11 -07:00
Ishaan Jaff
84bda9cc80 fix get_deployments_for_tag 2024-08-29 13:51:36 -07:00
Ishaan Jaff
2cb4882e70 define tags on model list 2024-08-29 13:06:39 -07:00
Ishaan Jaff
ff42962750 add_team_based_tags_to_metadata 2024-08-29 13:06:03 -07:00
Ishaan Jaff
ffeb5ce22a add set / update tags for a team 2024-08-29 13:05:00 -07:00
Ishaan Jaff
5e590e7326 allow settings tags per team 2024-08-29 13:03:49 -07:00
Ishaan Jaff
d2ddc5aba9 add test_team_tags to set / update tags 2024-08-29 13:02:57 -07:00
Ishaan Jaff
284b8b3418 add test for health check 2024-08-29 11:16:20 -07:00
David Manouchehri
19db80ffeb
(bedrock): Add new cross-region inference support for Bedrock. 2024-08-29 17:49:16 +00:00
Ishaan Jaff
b576233e66 add support for fireworks ai health check 2024-08-29 09:29:16 -07:00
Ishaan Jaff
45774010f7 add util to pick_cheapest_model_from_llm_provider 2024-08-29 09:27:20 -07:00
Ishaan Jaff
4b6a2fa4f3 add fireworks_ai_models 2024-08-29 09:23:11 -07:00
Krish Dholakia
559a6ad826
fix(google_ai_studio): working context caching (#5421)
* fix(google_ai_studio): working context caching

* feat(vertex_ai_context_caching.py): support async cache check calls

* fix(vertex_and_google_ai_studio_gemini.py): fix setting headers

* fix(vertex_ai_parter_models): fix import

* fix(vertex_and_google_ai_studio_gemini.py): fix input

* test(test_amazing_vertex_completion.py): fix test
2024-08-29 07:00:30 -07:00
Krish Dholakia
8ce1e49fbe
fix(utils.py): correctly log streaming cache hits (#5417) (#5426)
Fixes https://github.com/BerriAI/litellm/issues/5401
2024-08-28 22:50:33 -07:00
Krish Dholakia
8ae0fc693f
Merge pull request #5414 from BerriAI/litellm_main_staging
fixes: minor litellm fixes
2024-08-28 22:01:01 -07:00
Krrish Dholakia
2119030738 fix(team_endpoints.py): update to include the budget in the response 2024-08-28 21:58:41 -07:00
Krrish Dholakia
fd1cca207f test(test_amazing_vertex_completion.py): fix test 2024-08-28 21:12:39 -07:00
Krrish Dholakia
18689c25e9 feat(team_endpoints.py): return team member budgets in /team/info call
Fixes https://github.com/BerriAI/litellm/issues/5390
2024-08-28 19:14:01 -07:00
Krrish Dholakia
dd9c5d10bd fix(vertex_ai_partner_models.py): fix vertex import 2024-08-28 18:08:33 -07:00
Krish Dholakia
a857f4a8ee
Merge branch 'main' into litellm_main_staging 2024-08-28 18:05:27 -07:00
Krrish Dholakia
f0fb8bdf45 fix(router.py): fix cooldown check 2024-08-28 16:38:42 -07:00
Ishaan Jaff
f5a8f71080
Merge pull request #5422 from BerriAI/fix_promt
[minor fix Proxy] - prometheus - safe update start / end time
2024-08-28 16:35:06 -07:00
Ishaan Jaff
a982cb7ae5
Merge pull request #5420 from BerriAI/litellm_add_oauth2_mapping
[Feat-Proxy] Add hook for oauth2 proxy headers
2024-08-28 16:34:26 -07:00
Ishaan Jaff
8948583ddc
Merge branch 'main' into litellm_add_request_body_safety_checks 2024-08-28 16:14:46 -07:00
Ishaan Jaff
443e1b3bba prometheus - safe update start / end time 2024-08-28 16:13:56 -07:00
Ishaan Jaff
946e3b63e1 add hook for oauth2 proxy 2024-08-28 15:51:20 -07:00
Ishaan Jaff
2f3d400148 fix vertex ai test 2024-08-28 15:30:39 -07:00
Ishaan Jaff
a007f865d3 fix batch creation azure 2024-08-28 14:57:36 -07:00
Ishaan Jaff
068114859a fix failing vertex test 2024-08-28 14:46:57 -07:00
Ishaan Jaff
5f7718db5c
Merge pull request #5415 from BerriAI/litellm_add_ssml_vertex_Ai
Feat - Add Google Text-to-Speech support ssml
2024-08-28 14:44:27 -07:00
Ishaan Jaff
6c49083573
Merge pull request #5409 from BerriAI/litellm_ui_budgets
[UI] Allow editing budget duration
2024-08-28 14:43:57 -07:00
Ishaan Jaff
5ad6d4cf77 new ui build 2024-08-28 14:43:33 -07:00
Krrish Dholakia
7ef38020db test(test_amazing_vertex_completion.py): ignore experimental gemini models in test 2024-08-28 14:29:40 -07:00
Krrish Dholakia
4ce59f1a96 test(test_amazing_vertex_completion.py): update test to not pick experimental gemini models 2024-08-28 14:28:06 -07:00
Ishaan Jaff
277e15e36d add test_user_api_key_auth_fails_with_prohibited_params 2024-08-28 14:11:56 -07:00
Ishaan Jaff
9c2d974f5e fix checking request body 2024-08-28 14:10:09 -07:00
Ishaan Jaff
d3a5162103 add checks for safe request body 2024-08-28 14:07:53 -07:00