Commit graph

317 commits

Author SHA1 Message Date
Ishaan Jaff
aa7174c270 use get_request_route 2024-08-05 10:13:47 -07:00
Ishaan Jaff
13f01ed57f add get_request_route 2024-08-05 10:12:34 -07:00
Krrish Dholakia
f610fba58f fix(user_api_key_auth.py): handle older user_role's
Fixes issue where older user_role's (e.g. app_user) weren't being recognized. + Adds testing for it
2024-08-05 08:57:06 -07:00
Krrish Dholakia
186e5f55e8 fix(user_api_key_auth.py): fix linting errors 2024-08-02 16:34:32 -07:00
Krrish Dholakia
1080c7014e build(ui): allow admin_viewer to view teams tab
Allows admin viewe role to see available teams on proxy ui
2024-08-02 16:19:40 -07:00
Krrish Dholakia
b77edc59ed fix(user_api_key_cache): fix check to not raise error if team object is missing 2024-07-30 18:25:04 -07:00
Krrish Dholakia
142f4fefd0 fix(auth_checks.py): fix redis usage for team cached objects 2024-07-30 17:30:00 -07:00
Ishaan Jaff
1a34756159
Merge pull request #4916 from BerriAI/litellm_fix_ui_login
Feat UI - allow using custom header for litellm api key
2024-07-29 17:08:53 -07:00
Ishaan Jaff
f25ed92ee2 better debugging for custom headers 2024-07-29 16:59:15 -07:00
Krrish Dholakia
92b539b42a fix(auth_checks.py): handle writing team object to redis caching correctly 2024-07-29 07:51:44 -07:00
Ishaan Jaff
41ca6fd52a feat - check max response size 2024-07-27 16:53:00 -07:00
Ishaan Jaff
4ab8d2229d security - check max request size 2024-07-27 16:08:41 -07:00
Krrish Dholakia
2719860c46 build(model_prices_and_context_window.json): add mistral-large on vertex ai pricing 2024-07-27 10:37:18 -07:00
Ishaan Jaff
6f428a16fa fix update public key 2024-07-27 09:45:58 -07:00
Krrish Dholakia
2c71f6dd04 feat(auth_check.py): support using redis cache for team objects
Allows team update / check logic to work across instances instantly
2024-07-25 19:35:29 -07:00
Krrish Dholakia
6ab2527fdc feat(auth_check.py): support using redis cache for team objects
Allows team update / check logic to work across instances instantly
2024-07-24 18:14:49 -07:00
Krish Dholakia
c4db6aa15e
Merge pull request #4810 from BerriAI/litellm_team_modify_guardrails
feat(auth_checks.py): Allow admin to disable team from turning on/off guardrails
2024-07-22 22:32:24 -07:00
Ishaan Jaff
b64755d2a1 check is_llm_api_route 2024-07-22 14:43:30 -07:00
Krrish Dholakia
8b3c8102a7 feat(auth_checks.py): Allow admin to disable team from turning on/off guardrails. 2024-07-20 18:39:05 -07:00
Krrish Dholakia
99aa311083 fix(user_api_key_auth.py): update team values in token cache if refreshed more recently 2024-07-19 17:35:59 -07:00
Krrish Dholakia
35e640076b fix(user_api_key_auth.py): update valid token cache with updated team object cache 2024-07-19 17:06:49 -07:00
Ishaan Jaff
3a57fef448
Merge pull request #4739 from BerriAI/litellm_custom_header_master_key
feat - use custom api key header name when using litellm virtual keys
2024-07-16 21:17:17 -07:00
Krrish Dholakia
ccbc7cfb9f fix(team_endpoints.py): check if key belongs to team before returning /team/info 2024-07-16 21:17:05 -07:00
Ishaan Jaff
ceed3f655d fix check if user passed custom header 2024-07-16 16:36:18 -07:00
Ishaan Jaff
561b5a4be6 feat - use custom api key name 2024-07-16 15:20:35 -07:00
Krrish Dholakia
55e153556a test(test_pass_through_endpoints.py): add test for rpm limit support 2024-07-13 13:49:20 -07:00
Krish Dholakia
66cedccd6b
Merge pull request #4686 from BerriAI/litellm_custom_chat_endpoints
docs(pass_through.md): Creating custom chat endpoints on proxy
2024-07-13 09:45:17 -07:00
Krrish Dholakia
667fd2b376 docs(pass_through.md): add doc on creating custom chat endpoints on proxy
Allows developers to call proxy with anthropic sdk/boto3/etc.
2024-07-12 18:48:40 -07:00
Ishaan Jaff
57ced1d25e raise roxyErrorTypes.expired_key on expired key 2024-07-12 18:41:39 -07:00
Krish Dholakia
dacce3d78b
Merge pull request #4635 from BerriAI/litellm_anthropic_adapter
Anthropic `/v1/messages` endpoint support
2024-07-10 22:41:53 -07:00
Krrish Dholakia
2f8dbbeb97 feat(proxy_server.py): working /v1/messages endpoint
Works with claude engineer
2024-07-10 18:15:38 -07:00
Krrish Dholakia
aace0b22a3 fix(proxy_server.py): fix proxy_server.py premium user check for encrypted license key 2024-07-10 12:25:31 -07:00
Krrish Dholakia
d077148135 style(litellm_license.py): add debug statement for litellm license 2024-07-09 22:43:33 -07:00
Ishaan Jaff
6bce7e73a3
Merge pull request #4627 from BerriAI/litellm_fix_thread_auth
[Fix] Authentication on /thread endpoints on Proxy
2024-07-09 12:19:19 -07:00
Ishaan Jaff
b30fa64e2a fix - use helper to check if a route is openai route 2024-07-09 12:00:07 -07:00
Ishaan Jaff
e380954de1 add helper to check is_openai_route 2024-07-09 11:50:12 -07:00
Krrish Dholakia
f3cc57bc6f feat(user_api_key_auth.py): allow restricting calls by IP address
Allows admin to restrict which IP addresses can make calls to the proxy
2024-07-08 15:58:15 -07:00
Ishaan Jaff
25ddbbb41d raise budget_exceeded in user_api_key_auth 2024-07-08 12:45:39 -07:00
Krrish Dholakia
3ece295bf7 fix(litellm_license.py): add better error logs 2024-07-04 21:07:10 -07:00
Ishaan Jaff
50443d3d48 fix checks on litellm license 2024-07-03 14:02:07 -07:00
Ishaan Jaff
4abb83b12d fix only use crypto imports when needed 2024-06-25 16:28:47 -07:00
Ishaan Jaff
4c99010eee fix - verify license without api request 2024-06-25 13:55:54 -07:00
Ishaan Jaff
2aa0ce50b5 fix importing litellm 2024-06-24 19:58:53 -07:00
Ishaan Jaff
5e1403cd0a add helper to check route_in_additonal_public_routes 2024-06-24 19:50:35 -07:00
Ishaan Jaff
2f90759db5 feat - allow user to define public routes 2024-06-24 17:45:13 -07:00
Krrish Dholakia
5729eb5168 fix(user_api_key_auth.py): ensure user has access to fallback models
for client side fallbacks, checks if user has access to fallback models
2024-06-20 16:02:19 -07:00
Krrish Dholakia
6558abf845 fix(proxy_server.py): track team spend for cached team object
fixes issue where team budgets for jwt tokens weren't asserted
2024-06-18 17:10:12 -07:00
Krrish Dholakia
469fdc0fc6 fix(proxy/_types.py): allow internal user to access sso routes 2024-06-17 18:34:37 -07:00
Ishaan Jaff
dc72545396 doc - add comment explaining user_api_key_auth file 2024-06-15 16:08:17 -07:00
Ishaan Jaff
35710be7c3 test - fixes 2024-06-15 10:40:02 -07:00