Commit graph

18313 commits

Author SHA1 Message Date
Ishaan Jaff
9444b34711
Merge pull request #5432 from BerriAI/litellm_add_tag_control_team
[Feat-Proxy] Set tags per team - (use tag based routing for team)
2024-08-29 17:34:58 -07:00
Ishaan Jaff
e329c4509a
Merge branch 'main' into litellm_add_tag_control_team 2024-08-29 17:34:40 -07:00
Ishaan Jaff
ef16738720
Merge pull request #5435 from BerriAI/litellm_fwd_vtx_sdk_headers
[Feat-Proxy] Pass through Vertex Endpoint - allow forwarding vertex credentials
2024-08-29 17:24:35 -07:00
Ishaan Jaff
010f526226
Merge branch 'main' into litellm_fwd_vtx_sdk_headers 2024-08-29 17:24:31 -07:00
Ishaan Jaff
a4b88c16dc fix indentation 2024-08-29 17:01:23 -07:00
Ishaan Jaff
748cc80783 fix auth checks for provider routes 2024-08-29 16:40:46 -07:00
Ishaan Jaff
e449bf062d add docs on pass thtough 2024-08-29 16:12:14 -07:00
Ishaan Jaff
41a5daf20c add test for vertex sdk foward headers 2024-08-29 15:50:54 -07:00
Ishaan Jaff
9fb188a3b6 vertex add vertex endpoints 2024-08-29 15:49:25 -07:00
Krrish Dholakia
601945d114 docs(docker_quick_start.md): add new quick start doc for litellm proxy 2024-08-29 15:35:39 -07:00
Ishaan Jaff
4b7ceade64 mark test_key_info_spend_values_streaming as flaky 2024-08-29 14:39:53 -07:00
Ishaan Jaff
da2cefc45a fix team based tag routing 2024-08-29 14:37:44 -07:00
Ishaan Jaff
208fe6cb90
Merge pull request #5430 from Manouchehri/bedrock-cross-inference-1
(bedrock): Add new cross-region inference support for Bedrock.
2024-08-29 14:30:11 -07:00
Ishaan Jaff
5851a8f901
Merge pull request #5431 from BerriAI/litellm_Add_fireworks_ai_health_check
[Fix-Proxy] /health check for provider wildcard models (fireworks/*)
2024-08-29 14:25:05 -07:00
Ishaan Jaff
308377fbe2 docs tag based routing per team 2024-08-29 14:23:55 -07:00
Ishaan Jaff
242f66054d enable_tag_filtering 2024-08-29 14:14:46 -07:00
Ishaan Jaff
d9433d9f94 doc Tag Based Routing 2024-08-29 14:14:37 -07:00
Ishaan Jaff
944c7ac3fa fix missing link on docs 2024-08-29 14:00:16 -07:00
Ishaan Jaff
f592aeaa38 add test_chat_completion_with_no_tags 2024-08-29 13:54:11 -07:00
Ishaan Jaff
84bda9cc80 fix get_deployments_for_tag 2024-08-29 13:51:36 -07:00
Ishaan Jaff
34f1d32799 add test for tag based routing 2024-08-29 13:45:24 -07:00
Ishaan Jaff
2cb4882e70 define tags on model list 2024-08-29 13:06:39 -07:00
Ishaan Jaff
ff42962750 add_team_based_tags_to_metadata 2024-08-29 13:06:03 -07:00
Ishaan Jaff
ffeb5ce22a add set / update tags for a team 2024-08-29 13:05:00 -07:00
Ishaan Jaff
5e590e7326 allow settings tags per team 2024-08-29 13:03:49 -07:00
Ishaan Jaff
d2ddc5aba9 add test_team_tags to set / update tags 2024-08-29 13:02:57 -07:00
Ishaan Jaff
284b8b3418 add test for health check 2024-08-29 11:16:20 -07:00
David Manouchehri
19db80ffeb
(bedrock): Add new cross-region inference support for Bedrock. 2024-08-29 17:49:16 +00:00
Ishaan Jaff
b576233e66 add support for fireworks ai health check 2024-08-29 09:29:16 -07:00
Ishaan Jaff
45774010f7 add util to pick_cheapest_model_from_llm_provider 2024-08-29 09:27:20 -07:00
Ishaan Jaff
4b6a2fa4f3 add fireworks_ai_models 2024-08-29 09:23:11 -07:00
Krish Dholakia
559a6ad826
fix(google_ai_studio): working context caching (#5421)
* fix(google_ai_studio): working context caching

* feat(vertex_ai_context_caching.py): support async cache check calls

* fix(vertex_and_google_ai_studio_gemini.py): fix setting headers

* fix(vertex_ai_parter_models): fix import

* fix(vertex_and_google_ai_studio_gemini.py): fix input

* test(test_amazing_vertex_completion.py): fix test
2024-08-29 07:00:30 -07:00
Victor Mustar
7cb916c7a0 re-add TGI 2024-08-29 10:59:29 +02:00
Krish Dholakia
8ce1e49fbe
fix(utils.py): correctly log streaming cache hits (#5417) (#5426)
Fixes https://github.com/BerriAI/litellm/issues/5401
2024-08-28 22:50:33 -07:00
Krrish Dholakia
e9957f1265 bump: version 1.44.9 → 1.44.10 2024-08-28 22:21:38 -07:00
Krish Dholakia
8ae0fc693f
Merge pull request #5414 from BerriAI/litellm_main_staging
fixes: minor litellm fixes
2024-08-28 22:01:01 -07:00
Krish Dholakia
5b5538b039
Merge pull request #5425 from BerriAI/litellm_team_member_info_additional_fix
fix(team_endpoints.py): update to include the budget in the response
2024-08-28 22:00:32 -07:00
Krrish Dholakia
2119030738 fix(team_endpoints.py): update to include the budget in the response 2024-08-28 21:58:41 -07:00
Krish Dholakia
68112e6dec
Merge pull request #5423 from BerriAI/litellm_team_member_info
feat(team_endpoints.py): return team member budgets in /team/info call
2024-08-28 21:52:46 -07:00
Krrish Dholakia
fd1cca207f test(test_amazing_vertex_completion.py): fix test 2024-08-28 21:12:39 -07:00
Krrish Dholakia
18689c25e9 feat(team_endpoints.py): return team member budgets in /team/info call
Fixes https://github.com/BerriAI/litellm/issues/5390
2024-08-28 19:14:01 -07:00
Krrish Dholakia
dd9c5d10bd fix(vertex_ai_partner_models.py): fix vertex import 2024-08-28 18:08:33 -07:00
Krish Dholakia
a857f4a8ee
Merge branch 'main' into litellm_main_staging 2024-08-28 18:05:27 -07:00
Krrish Dholakia
f0fb8bdf45 fix(router.py): fix cooldown check 2024-08-28 16:38:42 -07:00
Ishaan Jaff
25d8cb69a7 bump: version 1.44.8 → 1.44.9 2024-08-28 16:35:35 -07:00
Ishaan Jaff
f5a8f71080
Merge pull request #5422 from BerriAI/fix_promt
[minor fix Proxy] - prometheus - safe update start / end time
2024-08-28 16:35:06 -07:00
Ishaan Jaff
a982cb7ae5
Merge pull request #5420 from BerriAI/litellm_add_oauth2_mapping
[Feat-Proxy] Add hook for oauth2 proxy headers
2024-08-28 16:34:26 -07:00
Ishaan Jaff
020d0ab5b4
Merge pull request #5418 from BerriAI/litellm_add_request_body_safety_checks
[Fix - Proxy] Security fix, don't allow client side to set api_base, base_url
2024-08-28 16:14:57 -07:00
Ishaan Jaff
8948583ddc
Merge branch 'main' into litellm_add_request_body_safety_checks 2024-08-28 16:14:46 -07:00
Ishaan Jaff
443e1b3bba prometheus - safe update start / end time 2024-08-28 16:13:56 -07:00