Commit graph

10935 commits

Author SHA1 Message Date
Ishaan Jaff
ffeb5ce22a add set / update tags for a team 2024-08-29 13:05:00 -07:00
Ishaan Jaff
5e590e7326 allow settings tags per team 2024-08-29 13:03:49 -07:00
Ishaan Jaff
d2ddc5aba9 add test_team_tags to set / update tags 2024-08-29 13:02:57 -07:00
Krish Dholakia
559a6ad826
fix(google_ai_studio): working context caching (#5421)
* fix(google_ai_studio): working context caching

* feat(vertex_ai_context_caching.py): support async cache check calls

* fix(vertex_and_google_ai_studio_gemini.py): fix setting headers

* fix(vertex_ai_parter_models): fix import

* fix(vertex_and_google_ai_studio_gemini.py): fix input

* test(test_amazing_vertex_completion.py): fix test
2024-08-29 07:00:30 -07:00
Krish Dholakia
8ce1e49fbe
fix(utils.py): correctly log streaming cache hits (#5417) (#5426)
Fixes https://github.com/BerriAI/litellm/issues/5401
2024-08-28 22:50:33 -07:00
Krish Dholakia
8ae0fc693f
Merge pull request #5414 from BerriAI/litellm_main_staging
fixes: minor litellm fixes
2024-08-28 22:01:01 -07:00
Krrish Dholakia
2119030738 fix(team_endpoints.py): update to include the budget in the response 2024-08-28 21:58:41 -07:00
Krrish Dholakia
fd1cca207f test(test_amazing_vertex_completion.py): fix test 2024-08-28 21:12:39 -07:00
Krrish Dholakia
18689c25e9 feat(team_endpoints.py): return team member budgets in /team/info call
Fixes https://github.com/BerriAI/litellm/issues/5390
2024-08-28 19:14:01 -07:00
Krrish Dholakia
dd9c5d10bd fix(vertex_ai_partner_models.py): fix vertex import 2024-08-28 18:08:33 -07:00
Krish Dholakia
a857f4a8ee
Merge branch 'main' into litellm_main_staging 2024-08-28 18:05:27 -07:00
Krrish Dholakia
f0fb8bdf45 fix(router.py): fix cooldown check 2024-08-28 16:38:42 -07:00
Ishaan Jaff
f5a8f71080
Merge pull request #5422 from BerriAI/fix_promt
[minor fix Proxy] - prometheus - safe update start / end time
2024-08-28 16:35:06 -07:00
Ishaan Jaff
a982cb7ae5
Merge pull request #5420 from BerriAI/litellm_add_oauth2_mapping
[Feat-Proxy] Add hook for oauth2 proxy headers
2024-08-28 16:34:26 -07:00
Ishaan Jaff
8948583ddc
Merge branch 'main' into litellm_add_request_body_safety_checks 2024-08-28 16:14:46 -07:00
Ishaan Jaff
443e1b3bba prometheus - safe update start / end time 2024-08-28 16:13:56 -07:00
Ishaan Jaff
946e3b63e1 add hook for oauth2 proxy 2024-08-28 15:51:20 -07:00
Ishaan Jaff
2f3d400148 fix vertex ai test 2024-08-28 15:30:39 -07:00
Ishaan Jaff
a007f865d3 fix batch creation azure 2024-08-28 14:57:36 -07:00
Ishaan Jaff
068114859a fix failing vertex test 2024-08-28 14:46:57 -07:00
Ishaan Jaff
5f7718db5c
Merge pull request #5415 from BerriAI/litellm_add_ssml_vertex_Ai
Feat - Add Google Text-to-Speech support ssml
2024-08-28 14:44:27 -07:00
Ishaan Jaff
6c49083573
Merge pull request #5409 from BerriAI/litellm_ui_budgets
[UI] Allow editing budget duration
2024-08-28 14:43:57 -07:00
Ishaan Jaff
5ad6d4cf77 new ui build 2024-08-28 14:43:33 -07:00
Krrish Dholakia
7ef38020db test(test_amazing_vertex_completion.py): ignore experimental gemini models in test 2024-08-28 14:29:40 -07:00
Krrish Dholakia
4ce59f1a96 test(test_amazing_vertex_completion.py): update test to not pick experimental gemini models 2024-08-28 14:28:06 -07:00
Ishaan Jaff
277e15e36d add test_user_api_key_auth_fails_with_prohibited_params 2024-08-28 14:11:56 -07:00
Ishaan Jaff
9c2d974f5e fix checking request body 2024-08-28 14:10:09 -07:00
Ishaan Jaff
d3a5162103 add checks for safe request body 2024-08-28 14:07:53 -07:00
Krish Dholakia
d928220ed2
Merge pull request #5393 from BerriAI/litellm_gemini_embedding_support
feat(vertex_ai_and_google_ai_studio): Support Google AI Studio Embedding Endpoint
2024-08-28 13:46:28 -07:00
Krish Dholakia
7de9f8b6ea
Merge pull request #5413 from lilleswing/gemini-experimental
Support for gemini experimental models
2024-08-28 13:41:55 -07:00
Ishaan Jaff
ba1912afd1 add check for is_request_body_safe 2024-08-28 13:40:14 -07:00
Ishaan Jaff
0b9782a377 retry flaky tests 3 times 2024-08-28 13:10:47 -07:00
Krrish Dholakia
17646b50ec build(model_prices_and_context_window.json): bedrock/llama3 models - region-based pricing 2024-08-28 13:07:56 -07:00
Krrish Dholakia
023d0f7664 build(model_prices_and_context_window.json): fix bedrock/llama3-1 pricing 2024-08-28 12:54:24 -07:00
Ishaan Jaff
5ea27bdea9 simpify ssml usage 2024-08-28 12:54:23 -07:00
Ishaan Jaff
58506dbade update validate_vertex_input 2024-08-28 12:52:26 -07:00
Krrish Dholakia
325538f8a4 fix(key_management_endpoints.py): expose 'key' param, for setting your own key value 2024-08-28 12:27:32 -07:00
Krrish Dholakia
0861180bfe fix(rds_iam_token.py): support common aws env var's - AWS_ROLE_ARN, AWS_WEB_IDENTITY_TOKEN_FILE 2024-08-28 12:18:45 -07:00
Ishaan Jaff
52f098ef43 add vertex ssml test 2024-08-28 12:18:34 -07:00
Ishaan Jaff
6d11b392f8 add ssml input on vertex tts 2024-08-28 12:17:53 -07:00
Krrish Dholakia
83c5b48842 fix(rds_iam_token.py): fix boto3 client init for rds 2024-08-28 12:15:57 -07:00
Krrish Dholakia
60381ffcdd test: fix assert string on test 2024-08-28 12:07:05 -07:00
Krrish Dholakia
65097d595c fix(proxy/utils.py): fix model dump to exclude none values 2024-08-28 12:02:44 -07:00
Karl Leswing
ec57490585 Also have pricing details 2024-08-28 14:43:35 -04:00
Karl Leswing
b5ce54c202 Support for gemini experimental models 2024-08-28 14:33:18 -04:00
Krrish Dholakia
f9034ffcee test: rename test to run earlier 2024-08-28 10:52:12 -07:00
Krrish Dholakia
84137afdd8 test: fix test 2024-08-28 10:50:53 -07:00
Krrish Dholakia
76c38c6d4b build(model_prices_and_context_window.json): add bedrock mistral small 2024-08-28 10:12:16 -07:00
Ishaan Jaff
1f3dd43c27 fix pass through rerank requests tests 2024-08-28 10:08:09 -07:00
Ishaan Jaff
1a106a4f06 mark vertex tests as flaky 2024-08-28 08:32:33 -07:00