Commit graph

3482 commits

Author SHA1 Message Date
Krrish Dholakia
97d57b8449 fix(proxy_server.py): respect internal_user_budget_duration for sso user 2024-08-08 17:28:28 -07:00
Ishaan Jaff
a1a11b2e08 add default_vertex_config 2024-08-08 17:19:12 -07:00
Ishaan Jaff
c7a3472641 docs cachedContent endpoint 2024-08-08 17:19:12 -07:00
Ishaan Jaff
cf054def4a add native cachedContents endpoint 2024-08-08 17:19:12 -07:00
Ishaan Jaff
e2e5e46979 add example using litellm proxy with gemini context caching 2024-08-08 17:19:12 -07:00
Krrish Dholakia
4ac0afef2c fix(anthropic.py): fix translation from /v1/messages format to openai format 2024-08-08 17:19:12 -07:00
Krrish Dholakia
2776d9cb0d fix(internal_user_endpoints.py): expose new 'internal_user_budget_duration' flag
Relevant to - https://github.com/BerriAI/litellm/issues/5106
2024-08-08 17:19:05 -07:00
Krrish Dholakia
f75a31cd11 fix(user_api_key_auth.py): Fixes https://github.com/BerriAI/litellm/issues/5111 2024-08-08 17:18:59 -07:00
Krish Dholakia
4ef7743d71
Merge branch 'main' into litellm_auth_fix 2024-08-08 17:14:16 -07:00
Ishaan Jaff
e671ae58e3
Merge pull request #5119 from BerriAI/litellm_add_gemini_context_caching_litellm
[Feat-Proxy] Add Support for VertexAI context caching
2024-08-08 16:08:58 -07:00
Ishaan Jaff
1924f11b4c add default_vertex_config 2024-08-08 16:07:26 -07:00
Ishaan Jaff
a3dd3a19fa docs cachedContent endpoint 2024-08-08 16:06:23 -07:00
Krrish Dholakia
1bf8af5cb1 fix(anthropic.py): fix translation from /v1/messages format to openai format 2024-08-08 15:55:01 -07:00
Ishaan Jaff
0d662368ac add native cachedContents endpoint 2024-08-08 15:32:07 -07:00
Krrish Dholakia
5da4c27e8d fix(internal_user_endpoints.py): expose new 'internal_user_budget_duration' flag
Relevant to - https://github.com/BerriAI/litellm/issues/5106
2024-08-08 13:05:03 -07:00
Krrish Dholakia
ac601a69fc feat: set max_internal_budget for user w/ sso 2024-08-08 12:44:07 -07:00
Ishaan Jaff
909977ace6 add example using litellm proxy with gemini context caching 2024-08-08 11:35:41 -07:00
Krrish Dholakia
5703da9b42 fix(user_api_key_auth.py): Fixes https://github.com/BerriAI/litellm/issues/5111 2024-08-08 10:30:15 -07:00
Krrish Dholakia
ee8d2f25b9 build: ui - update to include max budget per team 2024-08-08 09:09:23 -07:00
Krish Dholakia
baf01b47d8
Merge branch 'main' into litellm_personal_user_budgets 2024-08-07 19:59:50 -07:00
Krrish Dholakia
ec0b511119 fix: use more descriptive flag 2024-08-07 18:59:46 -07:00
Krrish Dholakia
b7e31638fd fix(internal_user_endpoints.py): respect 'max_user_budget' for new internal user's 2024-08-07 18:50:40 -07:00
Krrish Dholakia
f76261af35 refactor(user_api_key_auth.py): refactor to replace user_id_information list with pydantic user_obj
Allows using the 'get_user_object' function in user_api_key_auth, keeping it consistent across jwt-auth and key-auth
2024-08-07 15:33:55 -07:00
Krrish Dholakia
ff373663a3 fix: fix tests 2024-08-07 15:02:04 -07:00
Ishaan Jaff
04b201efed
Merge pull request #5098 from BerriAI/litellm_provider_wildcard_routing
[Feat-Router + Proxy] Add provider wildcard routing
2024-08-07 14:51:42 -07:00
Ishaan Jaff
f1ffa82062 fix use provider specific routing 2024-08-07 14:37:20 -07:00
Krrish Dholakia
d832327ccf fix(user_api_key_auth.py): respect team budgets over user budget, if key belongs to team
Closes https://github.com/BerriAI/litellm/issues/5097
2024-08-07 14:32:27 -07:00
Ishaan Jaff
218ba0f470 support provider wildcard routing 2024-08-07 14:20:22 -07:00
Krish Dholakia
3605e873a1
Merge branch 'main' into litellm_add_pydantic_model_support 2024-08-07 13:07:46 -07:00
Krrish Dholakia
f0f900d69e fix(router.py): add reason for fallback failure to client-side exception string
make it easier to debug why a fallback failed to occur
2024-08-07 13:02:47 -07:00
Ishaan Jaff
9a8fa9f047 emit deployment_partial_outage on prometheus 2024-08-07 09:56:01 -07:00
Krish Dholakia
c82fc0cac2
Merge branch 'main' into litellm_support_lakera_config_thresholds 2024-08-06 22:47:13 -07:00
Ishaan Jaff
ab920ab461 fix pass through endpoint tests 2024-08-06 21:16:07 -07:00
Ishaan Jaff
7173cef822 clean up unused func 2024-08-06 20:58:51 -07:00
Krrish Dholakia
2dd27a4e12 feat(utils.py): support validating json schema client-side if user opts in 2024-08-06 19:35:33 -07:00
Ishaan Jaff
a1c1ad60d2 fix forward ui requests when base url set 2024-08-06 18:10:34 -07:00
Ishaan Jaff
d08f59ae09 add redirect_ui_middleware 2024-08-06 18:01:23 -07:00
Ishaan Jaff
237c3a0244
Merge pull request #5077 from BerriAI/litellm_fix_ui_emails
[Fix] Fix testing emails through Admin UI
2024-08-06 16:41:01 -07:00
Krrish Dholakia
907d83e5d9 fix(lakera_ai.py): fix hardcoded prompt_injection string in lakera integration 2024-08-06 16:12:54 -07:00
Ishaan Jaff
e5e5628fc8 update alerting settings on ui 2024-08-06 16:05:33 -07:00
Ishaan Jaff
206acaae9e fix email health checks 2024-08-06 15:59:26 -07:00
Ishaan Jaff
7024fcacec add debug statements on docker 2024-08-06 15:29:49 -07:00
Krrish Dholakia
0e222cf76b feat(lakera_ai.py): support lakera custom thresholds + custom api base
Allows user to configure thresholds to trigger prompt injection rejections
2024-08-06 15:21:45 -07:00
Krish Dholakia
a17593dafb
Merge pull request #5071 from BerriAI/litellm_auth_restricted_domains
feat(proxy_server.py): allow restricting allowed email domains for UI
2024-08-06 14:18:57 -07:00
Krrish Dholakia
2abd4d5363 feat(proxy_server.py): allow restricting allowed email domains for the UI 2024-08-06 12:53:03 -07:00
Ishaan Jaff
645d3ae09d
Merge pull request #5062 from BerriAI/litellm_forward_headers
[Fix-Proxy] allow forwarding headers from request
2024-08-06 12:34:25 -07:00
Krrish Dholakia
834b437eb4 fix(utils.py): fix types 2024-08-06 12:23:22 -07:00
Ishaan Jaff
c277a71c1e init pass through endpoints 2024-08-06 12:04:04 -07:00
Krrish Dholakia
4d0c22f258 fix(encrypt_decrypt_utils.py): add helper line, explaining why there might be a key decryption error 2024-08-06 11:35:40 -07:00
Ishaan Jaff
bd1f323297 use helper to forward headers from request 2024-08-06 11:34:10 -07:00