Commit graph

3392 commits

Author SHA1 Message Date
Ishaan Jaff
3e73166485 docs cachedContent endpoint 2024-08-08 19:21:07 -07:00
Ishaan Jaff
83e8f99ecf add example using litellm proxy with gemini context caching 2024-08-08 19:20:18 -07:00
Krrish Dholakia
c91382a310 fix(anthropic.py): fix translation from /v1/messages format to openai format 2024-08-08 19:19:58 -07:00
Krrish Dholakia
8a0cb413ff fix(internal_user_endpoints.py): expose new 'internal_user_budget_duration' flag
Relevant to - https://github.com/BerriAI/litellm/issues/5106
2024-08-08 19:19:52 -07:00
Krrish Dholakia
766f712555 fix(user_api_key_auth.py): Fixes https://github.com/BerriAI/litellm/issues/5111 2024-08-08 19:19:11 -07:00
Krrish Dholakia
a70e9661fd fix(management_helpers/utils.py): use user_default max_budget, budget duration on new user upsert during team member add
Fixes https://github.com/BerriAI/litellm/issues/5106
2024-08-08 19:14:43 -07:00
Ishaan Jaff
a06546620e ui new build 2024-08-08 18:53:22 -07:00
Ishaan Jaff
0e374158af ui new build 2024-08-08 18:25:41 -07:00
Krrish Dholakia
856ede4a05 test(test_proxy_server.py): unit testing to make sure internal user params don't impact admin 2024-08-08 17:59:30 -07:00
Krrish Dholakia
c919c15c4a fix(proxy_server.py): ensure internal_user params only apply to internal_user role 2024-08-08 17:50:29 -07:00
Krrish Dholakia
488a78e5f4 fix(proxy_server.py): respect internal_user_budget_duration for sso user 2024-08-08 17:28:28 -07:00
Ishaan Jaff
a37b6f5edf add default_vertex_config 2024-08-08 17:19:12 -07:00
Ishaan Jaff
ad79f6447f docs cachedContent endpoint 2024-08-08 17:19:12 -07:00
Ishaan Jaff
7aacc4cf56 add native cachedContents endpoint 2024-08-08 17:19:12 -07:00
Ishaan Jaff
d58713e47b add example using litellm proxy with gemini context caching 2024-08-08 17:19:12 -07:00
Krrish Dholakia
384f8f4f54 fix(anthropic.py): fix translation from /v1/messages format to openai format 2024-08-08 17:19:12 -07:00
Krrish Dholakia
6266937c75 fix(internal_user_endpoints.py): expose new 'internal_user_budget_duration' flag
Relevant to - https://github.com/BerriAI/litellm/issues/5106
2024-08-08 17:19:05 -07:00
Krrish Dholakia
43b1bf692d fix(user_api_key_auth.py): Fixes https://github.com/BerriAI/litellm/issues/5111 2024-08-08 17:18:59 -07:00
Krish Dholakia
ced4582ecb Merge branch 'main' into litellm_auth_fix 2024-08-08 17:14:16 -07:00
Ishaan Jaff
e24e892af1 Merge pull request #5119 from BerriAI/litellm_add_gemini_context_caching_litellm
[Feat-Proxy] Add Support for VertexAI context caching
2024-08-08 16:08:58 -07:00
Ishaan Jaff
f7dc06ac29 add default_vertex_config 2024-08-08 16:07:26 -07:00
Ishaan Jaff
d148a7f115 docs cachedContent endpoint 2024-08-08 16:06:23 -07:00
Krrish Dholakia
1636f61169 fix(anthropic.py): fix translation from /v1/messages format to openai format 2024-08-08 15:55:01 -07:00
Ishaan Jaff
b9e1d60357 add native cachedContents endpoint 2024-08-08 15:32:07 -07:00
Krrish Dholakia
36c37bcc8b fix(internal_user_endpoints.py): expose new 'internal_user_budget_duration' flag
Relevant to - https://github.com/BerriAI/litellm/issues/5106
2024-08-08 13:05:03 -07:00
Krrish Dholakia
eb292e0b31 feat: set max_internal_budget for user w/ sso 2024-08-08 12:44:07 -07:00
Ishaan Jaff
afa27d8041 add example using litellm proxy with gemini context caching 2024-08-08 11:35:41 -07:00
Krrish Dholakia
3d4672ba53 fix(user_api_key_auth.py): Fixes https://github.com/BerriAI/litellm/issues/5111 2024-08-08 10:30:15 -07:00
Krrish Dholakia
dc35ddd88e build: ui - update to include max budget per team 2024-08-08 09:09:23 -07:00
Krish Dholakia
7d28b6ebc3 Merge branch 'main' into litellm_personal_user_budgets 2024-08-07 19:59:50 -07:00
Krrish Dholakia
182d63853b fix: use more descriptive flag 2024-08-07 18:59:46 -07:00
Krrish Dholakia
e60b2d9258 fix(internal_user_endpoints.py): respect 'max_user_budget' for new internal user's 2024-08-07 18:50:40 -07:00
Krrish Dholakia
86a3dba1bf refactor(user_api_key_auth.py): refactor to replace user_id_information list with pydantic user_obj
Allows using the 'get_user_object' function in user_api_key_auth, keeping it consistent across jwt-auth and key-auth
2024-08-07 15:33:55 -07:00
Krrish Dholakia
228da08b81 fix: fix tests 2024-08-07 15:02:04 -07:00
Ishaan Jaff
322258a1fa Merge pull request #5098 from BerriAI/litellm_provider_wildcard_routing
[Feat-Router + Proxy] Add provider wildcard routing
2024-08-07 14:51:42 -07:00
Ishaan Jaff
31e4fca748 fix use provider specific routing 2024-08-07 14:37:20 -07:00
Krrish Dholakia
57a730095c fix(user_api_key_auth.py): respect team budgets over user budget, if key belongs to team
Closes https://github.com/BerriAI/litellm/issues/5097
2024-08-07 14:32:27 -07:00
Ishaan Jaff
25e6733da3 support provider wildcard routing 2024-08-07 14:20:22 -07:00
Krish Dholakia
77a33baabb Merge branch 'main' into litellm_add_pydantic_model_support 2024-08-07 13:07:46 -07:00
Krrish Dholakia
0de640700d fix(router.py): add reason for fallback failure to client-side exception string
make it easier to debug why a fallback failed to occur
2024-08-07 13:02:47 -07:00
Ishaan Jaff
426dcc9275 emit deployment_partial_outage on prometheus 2024-08-07 09:56:01 -07:00
Krish Dholakia
0044fd0041 Merge branch 'main' into litellm_support_lakera_config_thresholds 2024-08-06 22:47:13 -07:00
Ishaan Jaff
5eabef4318 fix pass through endpoint tests 2024-08-06 21:16:07 -07:00
Ishaan Jaff
7bcb088ac0 clean up unused func 2024-08-06 20:58:51 -07:00
Krrish Dholakia
8b028d41aa feat(utils.py): support validating json schema client-side if user opts in 2024-08-06 19:35:33 -07:00
Ishaan Jaff
22ca6d6d30 fix forward ui requests when base url set 2024-08-06 18:10:34 -07:00
Ishaan Jaff
e207ac577e add redirect_ui_middleware 2024-08-06 18:01:23 -07:00
Ishaan Jaff
53451834bd Merge pull request #5077 from BerriAI/litellm_fix_ui_emails
[Fix] Fix testing emails through Admin UI
2024-08-06 16:41:01 -07:00
Krrish Dholakia
ca87ad5378 fix(lakera_ai.py): fix hardcoded prompt_injection string in lakera integration 2024-08-06 16:12:54 -07:00
Ishaan Jaff
7fbd0855b6 update alerting settings on ui 2024-08-06 16:05:33 -07:00