Krrish Dholakia
|
6ab2527fdc
|
feat(auth_check.py): support using redis cache for team objects
Allows team update / check logic to work across instances instantly
|
2024-07-24 18:14:49 -07:00 |
|
Krish Dholakia
|
c4db6aa15e
|
Merge pull request #4810 from BerriAI/litellm_team_modify_guardrails
feat(auth_checks.py): Allow admin to disable team from turning on/off guardrails
|
2024-07-22 22:32:24 -07:00 |
|
Ishaan Jaff
|
b64755d2a1
|
check is_llm_api_route
|
2024-07-22 14:43:30 -07:00 |
|
Krrish Dholakia
|
8b3c8102a7
|
feat(auth_checks.py): Allow admin to disable team from turning on/off guardrails.
|
2024-07-20 18:39:05 -07:00 |
|
Krrish Dholakia
|
99aa311083
|
fix(user_api_key_auth.py): update team values in token cache if refreshed more recently
|
2024-07-19 17:35:59 -07:00 |
|
Krrish Dholakia
|
35e640076b
|
fix(user_api_key_auth.py): update valid token cache with updated team object cache
|
2024-07-19 17:06:49 -07:00 |
|
Ishaan Jaff
|
3a57fef448
|
Merge pull request #4739 from BerriAI/litellm_custom_header_master_key
feat - use custom api key header name when using litellm virtual keys
|
2024-07-16 21:17:17 -07:00 |
|
Krrish Dholakia
|
ccbc7cfb9f
|
fix(team_endpoints.py): check if key belongs to team before returning /team/info
|
2024-07-16 21:17:05 -07:00 |
|
Ishaan Jaff
|
ceed3f655d
|
fix check if user passed custom header
|
2024-07-16 16:36:18 -07:00 |
|
Ishaan Jaff
|
561b5a4be6
|
feat - use custom api key name
|
2024-07-16 15:20:35 -07:00 |
|
Krrish Dholakia
|
55e153556a
|
test(test_pass_through_endpoints.py): add test for rpm limit support
|
2024-07-13 13:49:20 -07:00 |
|
Krish Dholakia
|
66cedccd6b
|
Merge pull request #4686 from BerriAI/litellm_custom_chat_endpoints
docs(pass_through.md): Creating custom chat endpoints on proxy
|
2024-07-13 09:45:17 -07:00 |
|
Krrish Dholakia
|
667fd2b376
|
docs(pass_through.md): add doc on creating custom chat endpoints on proxy
Allows developers to call proxy with anthropic sdk/boto3/etc.
|
2024-07-12 18:48:40 -07:00 |
|
Ishaan Jaff
|
57ced1d25e
|
raise roxyErrorTypes.expired_key on expired key
|
2024-07-12 18:41:39 -07:00 |
|
Krish Dholakia
|
dacce3d78b
|
Merge pull request #4635 from BerriAI/litellm_anthropic_adapter
Anthropic `/v1/messages` endpoint support
|
2024-07-10 22:41:53 -07:00 |
|
Krrish Dholakia
|
2f8dbbeb97
|
feat(proxy_server.py): working /v1/messages endpoint
Works with claude engineer
|
2024-07-10 18:15:38 -07:00 |
|
Krrish Dholakia
|
aace0b22a3
|
fix(proxy_server.py): fix proxy_server.py premium user check for encrypted license key
|
2024-07-10 12:25:31 -07:00 |
|
Krrish Dholakia
|
d077148135
|
style(litellm_license.py): add debug statement for litellm license
|
2024-07-09 22:43:33 -07:00 |
|
Ishaan Jaff
|
6bce7e73a3
|
Merge pull request #4627 from BerriAI/litellm_fix_thread_auth
[Fix] Authentication on /thread endpoints on Proxy
|
2024-07-09 12:19:19 -07:00 |
|
Ishaan Jaff
|
b30fa64e2a
|
fix - use helper to check if a route is openai route
|
2024-07-09 12:00:07 -07:00 |
|
Ishaan Jaff
|
e380954de1
|
add helper to check is_openai_route
|
2024-07-09 11:50:12 -07:00 |
|
Krrish Dholakia
|
f3cc57bc6f
|
feat(user_api_key_auth.py): allow restricting calls by IP address
Allows admin to restrict which IP addresses can make calls to the proxy
|
2024-07-08 15:58:15 -07:00 |
|
Ishaan Jaff
|
25ddbbb41d
|
raise budget_exceeded in user_api_key_auth
|
2024-07-08 12:45:39 -07:00 |
|
Krrish Dholakia
|
3ece295bf7
|
fix(litellm_license.py): add better error logs
|
2024-07-04 21:07:10 -07:00 |
|
Ishaan Jaff
|
50443d3d48
|
fix checks on litellm license
|
2024-07-03 14:02:07 -07:00 |
|
Ishaan Jaff
|
4abb83b12d
|
fix only use crypto imports when needed
|
2024-06-25 16:28:47 -07:00 |
|
Ishaan Jaff
|
4c99010eee
|
fix - verify license without api request
|
2024-06-25 13:55:54 -07:00 |
|
Ishaan Jaff
|
2aa0ce50b5
|
fix importing litellm
|
2024-06-24 19:58:53 -07:00 |
|
Ishaan Jaff
|
5e1403cd0a
|
add helper to check route_in_additonal_public_routes
|
2024-06-24 19:50:35 -07:00 |
|
Ishaan Jaff
|
2f90759db5
|
feat - allow user to define public routes
|
2024-06-24 17:45:13 -07:00 |
|
Krrish Dholakia
|
5729eb5168
|
fix(user_api_key_auth.py): ensure user has access to fallback models
for client side fallbacks, checks if user has access to fallback models
|
2024-06-20 16:02:19 -07:00 |
|
Krrish Dholakia
|
6558abf845
|
fix(proxy_server.py): track team spend for cached team object
fixes issue where team budgets for jwt tokens weren't asserted
|
2024-06-18 17:10:12 -07:00 |
|
Krrish Dholakia
|
469fdc0fc6
|
fix(proxy/_types.py): allow internal user to access sso routes
|
2024-06-17 18:34:37 -07:00 |
|
Ishaan Jaff
|
dc72545396
|
doc - add comment explaining user_api_key_auth file
|
2024-06-15 16:08:17 -07:00 |
|
Ishaan Jaff
|
35710be7c3
|
test - fixes
|
2024-06-15 10:40:02 -07:00 |
|
Ishaan Jaff
|
da3ae00bd6
|
fix - proxy refactor user_api_key_auth
|
2024-06-15 10:33:58 -07:00 |
|
Krrish Dholakia
|
c27ae34a39
|
fix(proxy_server.py): use consistent 400-status code error code for exceeded budget errors
standardizes error code for budget exceeded errors to status code 400
|
2024-06-11 16:10:58 -07:00 |
|
Ishaan Jaff
|
2cf3133669
|
Merge branch 'main' into litellm_svc_logger
|
2024-06-07 14:01:54 -07:00 |
|
Ishaan Jaff
|
87533bacf7
|
fix importing Span
|
2024-06-07 09:55:59 -07:00 |
|
Ishaan Jaff
|
37e7a7b2d5
|
fix - log_to_opentelemetry
|
2024-06-06 22:28:01 -07:00 |
|
Ishaan Jaff
|
32655b9ef2
|
fix auth checks
|
2024-06-06 22:13:13 -07:00 |
|
Ishaan Jaff
|
fcb1427a8c
|
fix log_to_opentelemetry
|
2024-06-06 21:29:40 -07:00 |
|
Ishaan Jaff
|
b551462518
|
feat -v0 parent_otel_span in basic db reads
|
2024-06-06 19:49:18 -07:00 |
|
Ishaan Jaff
|
aaf35c7966
|
feat - enforce enforced_params as a premium feature
|
2024-06-06 09:03:31 -07:00 |
|
Ishaan Jaff
|
883ee08225
|
feat - enforce params in requests
|
2024-06-06 08:54:59 -07:00 |
|
Ishaan Jaff
|
a4b6a959d8
|
fix literal usage
|
2024-05-30 14:28:53 -07:00 |
|
Krrish Dholakia
|
cfcf5969c8
|
fix(proxy_server.py): fix end user object check when master key used
check if end user max budget exceeded for master key
|
2024-05-29 17:20:59 -07:00 |
|
Krrish Dholakia
|
22b6b99b34
|
feat(proxy_server.py): expose new /model_group/info endpoint
returns model-group level info on supported params, max tokens, pricing, etc.
|
2024-05-26 14:07:35 -07:00 |
|
Krrish Dholakia
|
25a2f00db6
|
fix(proxy_server.py): fix model check for /v1/models endpoint when team has restricted access
|
2024-05-25 13:02:03 -07:00 |
|
Krrish Dholakia
|
a33b9221da
|
fix(proxy_server.py): fix admin allowed routes
|
2024-05-22 20:55:21 -07:00 |
|