Commit graph

109 commits

Author SHA1 Message Date
Ishaan Jaff
93f3143dc5 Merge pull request #4916 from BerriAI/litellm_fix_ui_login
Feat UI - allow using custom header for litellm api key
2024-07-29 17:08:53 -07:00
Ishaan Jaff
59b91c35d7 better debugging for custom headers 2024-07-29 16:59:15 -07:00
Krrish Dholakia
80c3759719 fix(auth_checks.py): handle writing team object to redis caching correctly 2024-07-29 07:51:44 -07:00
Ishaan Jaff
5f07afa268 feat - check max response size 2024-07-27 16:53:00 -07:00
Ishaan Jaff
a18f5bd5c8 security - check max request size 2024-07-27 16:08:41 -07:00
Krrish Dholakia
2c76524a19 build(model_prices_and_context_window.json): add mistral-large on vertex ai pricing 2024-07-27 10:37:18 -07:00
Ishaan Jaff
a9561a1451 fix update public key 2024-07-27 09:45:58 -07:00
Krrish Dholakia
487035c970 feat(auth_check.py): support using redis cache for team objects
Allows team update / check logic to work across instances instantly
2024-07-24 18:14:49 -07:00
Krish Dholakia
0cb872cbea Merge pull request #4810 from BerriAI/litellm_team_modify_guardrails
feat(auth_checks.py): Allow admin to disable team from turning on/off guardrails
2024-07-22 22:32:24 -07:00
Ishaan Jaff
5f238f2857 check is_llm_api_route 2024-07-22 14:43:30 -07:00
Krrish Dholakia
a351b7cc3e feat(auth_checks.py): Allow admin to disable team from turning on/off guardrails. 2024-07-20 18:39:05 -07:00
Krrish Dholakia
b92af48854 fix(user_api_key_auth.py): update team values in token cache if refreshed more recently 2024-07-19 17:35:59 -07:00
Krrish Dholakia
548b2fcf4b fix(user_api_key_auth.py): update valid token cache with updated team object cache 2024-07-19 17:06:49 -07:00
Ishaan Jaff
3822b0c259 Merge pull request #4739 from BerriAI/litellm_custom_header_master_key
feat - use custom api key header name when using litellm virtual keys
2024-07-16 21:17:17 -07:00
Krrish Dholakia
f6c287640e fix(team_endpoints.py): check if key belongs to team before returning /team/info 2024-07-16 21:17:05 -07:00
Ishaan Jaff
3c4008b407 fix check if user passed custom header 2024-07-16 16:36:18 -07:00
Ishaan Jaff
3b914c15fc feat - use custom api key name 2024-07-16 15:20:35 -07:00
Krrish Dholakia
e82616342b test(test_pass_through_endpoints.py): add test for rpm limit support 2024-07-13 13:49:20 -07:00
Krish Dholakia
e628171d82 Merge pull request #4686 from BerriAI/litellm_custom_chat_endpoints
docs(pass_through.md): Creating custom chat endpoints on proxy
2024-07-13 09:45:17 -07:00
Krrish Dholakia
c8a2782df8 docs(pass_through.md): add doc on creating custom chat endpoints on proxy
Allows developers to call proxy with anthropic sdk/boto3/etc.
2024-07-12 18:48:40 -07:00
Ishaan Jaff
d76a09681f raise roxyErrorTypes.expired_key on expired key 2024-07-12 18:41:39 -07:00
Krish Dholakia
f4d140efec Merge pull request #4635 from BerriAI/litellm_anthropic_adapter
Anthropic `/v1/messages` endpoint support
2024-07-10 22:41:53 -07:00
Krrish Dholakia
4ba30abb63 feat(proxy_server.py): working /v1/messages endpoint
Works with claude engineer
2024-07-10 18:15:38 -07:00
Krrish Dholakia
3f4f5ae994 fix(proxy_server.py): fix proxy_server.py premium user check for encrypted license key 2024-07-10 12:25:31 -07:00
Krrish Dholakia
d66a48b3d1 style(litellm_license.py): add debug statement for litellm license 2024-07-09 22:43:33 -07:00
Ishaan Jaff
6000687601 Merge pull request #4627 from BerriAI/litellm_fix_thread_auth
[Fix] Authentication on /thread endpoints on Proxy
2024-07-09 12:19:19 -07:00
Ishaan Jaff
6891b29444 fix - use helper to check if a route is openai route 2024-07-09 12:00:07 -07:00
Ishaan Jaff
c8a15ab83e add helper to check is_openai_route 2024-07-09 11:50:12 -07:00
Krrish Dholakia
f982e93d24 feat(user_api_key_auth.py): allow restricting calls by IP address
Allows admin to restrict which IP addresses can make calls to the proxy
2024-07-08 15:58:15 -07:00
Ishaan Jaff
4202be8e1f raise budget_exceeded in user_api_key_auth 2024-07-08 12:45:39 -07:00
Krrish Dholakia
4fea3c0b59 fix(litellm_license.py): add better error logs 2024-07-04 21:07:10 -07:00
Ishaan Jaff
746a9d6e25 fix checks on litellm license 2024-07-03 14:02:07 -07:00
Ishaan Jaff
9311879681 fix only use crypto imports when needed 2024-06-25 16:28:47 -07:00
Ishaan Jaff
99fd393353 fix - verify license without api request 2024-06-25 13:55:54 -07:00
Ishaan Jaff
90ad55416b fix importing litellm 2024-06-24 19:58:53 -07:00
Ishaan Jaff
7ea4c7b328 add helper to check route_in_additonal_public_routes 2024-06-24 19:50:35 -07:00
Ishaan Jaff
7ffd9ffd0e feat - allow user to define public routes 2024-06-24 17:45:13 -07:00
Krrish Dholakia
66948d083f fix(user_api_key_auth.py): ensure user has access to fallback models
for client side fallbacks, checks if user has access to fallback models
2024-06-20 16:02:19 -07:00
Krrish Dholakia
6fcad5f199 fix(proxy_server.py): track team spend for cached team object
fixes issue where team budgets for jwt tokens weren't asserted
2024-06-18 17:10:12 -07:00
Krrish Dholakia
ec56ae7c9a fix(proxy/_types.py): allow internal user to access sso routes 2024-06-17 18:34:37 -07:00
Ishaan Jaff
d78595fe1e doc - add comment explaining user_api_key_auth file 2024-06-15 16:08:17 -07:00
Ishaan Jaff
ed273ef4f0 test - fixes 2024-06-15 10:40:02 -07:00
Ishaan Jaff
4bc2bfb176 fix - proxy refactor user_api_key_auth 2024-06-15 10:33:58 -07:00
Krrish Dholakia
2a5a30fa7a fix(proxy_server.py): use consistent 400-status code error code for exceeded budget errors
standardizes error code for budget exceeded errors to status code 400
2024-06-11 16:10:58 -07:00
Ishaan Jaff
860c9b52b6 Merge branch 'main' into litellm_svc_logger 2024-06-07 14:01:54 -07:00
Ishaan Jaff
4828e2426f fix importing Span 2024-06-07 09:55:59 -07:00
Ishaan Jaff
193e71642c fix - log_to_opentelemetry 2024-06-06 22:28:01 -07:00
Ishaan Jaff
cd125e6309 fix auth checks 2024-06-06 22:13:13 -07:00
Ishaan Jaff
92a3c062a7 fix log_to_opentelemetry 2024-06-06 21:29:40 -07:00
Ishaan Jaff
cb5ebba6fa feat -v0 parent_otel_span in basic db reads 2024-06-06 19:49:18 -07:00