Commit graph

57 commits

Author SHA1 Message Date
Ishaan Jaff
0b63625673 add check for admin only routes 2024-09-03 15:03:32 -07:00
Ishaan Jaff
253ef5f995 allow setting allowed routes on proxy 2024-09-03 13:59:31 -07:00
Ishaan Jaff
9c2d974f5e fix checking request body 2024-08-28 14:10:09 -07:00
Ishaan Jaff
ba1912afd1 add check for is_request_body_safe 2024-08-28 13:40:14 -07:00
Krrish Dholakia
d7b525f391 feat(auth_checks.py): allow team to call all models, when explicitly set via /* 2024-08-22 16:38:56 -07:00
Ishaan Jaff
08db691dec use model access groups for teams 2024-08-17 16:45:53 -07:00
Krrish Dholakia
5703da9b42 fix(user_api_key_auth.py): Fixes https://github.com/BerriAI/litellm/issues/5111 2024-08-08 10:30:15 -07:00
Krish Dholakia
baf01b47d8
Merge branch 'main' into litellm_personal_user_budgets 2024-08-07 19:59:50 -07:00
Krrish Dholakia
ff373663a3 fix: fix tests 2024-08-07 15:02:04 -07:00
Krrish Dholakia
d832327ccf fix(user_api_key_auth.py): respect team budgets over user budget, if key belongs to team
Closes https://github.com/BerriAI/litellm/issues/5097
2024-08-07 14:32:27 -07:00
Krish Dholakia
c82fc0cac2
Merge branch 'main' into litellm_support_lakera_config_thresholds 2024-08-06 22:47:13 -07:00
Krrish Dholakia
b77edc59ed fix(user_api_key_cache): fix check to not raise error if team object is missing 2024-07-30 18:25:04 -07:00
Krrish Dholakia
142f4fefd0 fix(auth_checks.py): fix redis usage for team cached objects 2024-07-30 17:30:00 -07:00
Krrish Dholakia
92b539b42a fix(auth_checks.py): handle writing team object to redis caching correctly 2024-07-29 07:51:44 -07:00
Krrish Dholakia
2c71f6dd04 feat(auth_check.py): support using redis cache for team objects
Allows team update / check logic to work across instances instantly
2024-07-25 19:35:29 -07:00
Krrish Dholakia
6ab2527fdc feat(auth_check.py): support using redis cache for team objects
Allows team update / check logic to work across instances instantly
2024-07-24 18:14:49 -07:00
Krish Dholakia
c4db6aa15e
Merge pull request #4810 from BerriAI/litellm_team_modify_guardrails
feat(auth_checks.py): Allow admin to disable team from turning on/off guardrails
2024-07-22 22:32:24 -07:00
Ishaan Jaff
b64755d2a1 check is_llm_api_route 2024-07-22 14:43:30 -07:00
Krrish Dholakia
8b3c8102a7 feat(auth_checks.py): Allow admin to disable team from turning on/off guardrails. 2024-07-20 18:39:05 -07:00
Krrish Dholakia
35e640076b fix(user_api_key_auth.py): update valid token cache with updated team object cache 2024-07-19 17:06:49 -07:00
Ishaan Jaff
b30fa64e2a fix - use helper to check if a route is openai route 2024-07-09 12:00:07 -07:00
Krrish Dholakia
5729eb5168 fix(user_api_key_auth.py): ensure user has access to fallback models
for client side fallbacks, checks if user has access to fallback models
2024-06-20 16:02:19 -07:00
Krrish Dholakia
6558abf845 fix(proxy_server.py): track team spend for cached team object
fixes issue where team budgets for jwt tokens weren't asserted
2024-06-18 17:10:12 -07:00
Krrish Dholakia
c27ae34a39 fix(proxy_server.py): use consistent 400-status code error code for exceeded budget errors
standardizes error code for budget exceeded errors to status code 400
2024-06-11 16:10:58 -07:00
Ishaan Jaff
2cf3133669
Merge branch 'main' into litellm_svc_logger 2024-06-07 14:01:54 -07:00
Ishaan Jaff
87533bacf7 fix importing Span 2024-06-07 09:55:59 -07:00
Ishaan Jaff
37e7a7b2d5 fix - log_to_opentelemetry 2024-06-06 22:28:01 -07:00
Ishaan Jaff
32655b9ef2 fix auth checks 2024-06-06 22:13:13 -07:00
Ishaan Jaff
fcb1427a8c fix log_to_opentelemetry 2024-06-06 21:29:40 -07:00
Ishaan Jaff
b551462518 feat -v0 parent_otel_span in basic db reads 2024-06-06 19:49:18 -07:00
Ishaan Jaff
aaf35c7966 feat - enforce enforced_params as a premium feature 2024-06-06 09:03:31 -07:00
Ishaan Jaff
883ee08225 feat - enforce params in requests 2024-06-06 08:54:59 -07:00
Ishaan Jaff
a4b6a959d8 fix literal usage 2024-05-30 14:28:53 -07:00
Krrish Dholakia
cfcf5969c8 fix(proxy_server.py): fix end user object check when master key used
check if end user max budget exceeded for master key
2024-05-29 17:20:59 -07:00
Krrish Dholakia
a33b9221da fix(proxy_server.py): fix admin allowed routes 2024-05-22 20:55:21 -07:00
Ishaan Jaff
eac7e70dca feat - include litellm_budget table when getting end_user 2024-05-22 13:30:08 -07:00
Krrish Dholakia
600b6f7e1d feat(proxy_server.py): support 'user_id_upsert' flag for jwt_auth 2024-05-15 22:19:59 -07:00
Krrish Dholakia
f48cd87cf3 feat(proxy_server.py): make team_id optional for jwt token auth (only enforced, if set)
Allows users to use jwt auth for internal chat apps
2024-05-15 21:05:14 -07:00
Krrish Dholakia
e3f25a4a1f fix(auth_checks.py): fix 'get_end_user_object'
await cache get
2024-05-09 13:05:56 -07:00
Krrish Dholakia
3d18897d69 feat(router.py): enable filtering model group by 'allowed_model_region' 2024-05-08 22:10:17 -07:00
Ishaan Jaff
e49fe47d2e fix - only run global_proxy_spend on chat completion calls 2024-04-27 14:11:00 -07:00
Krrish Dholakia
ffd3a96fcf fix(proxy_server.py): prevent non-admins from creating new keys 2024-04-16 11:22:02 -07:00
Krrish Dholakia
f4c7f4f901 fix(proxy_server.py): support tracking org spend
currently works when org set for jwt auth
2024-04-11 23:01:21 -07:00
Krrish Dholakia
67b5634417 fix(auth_checks.py): raise error if user doesn't exist in db 2024-04-11 19:55:04 -07:00
Krrish Dholakia
36ff593c02 feat(proxy_server.py): support cost tracking on user id via JWT-Auth
allows admin to track cost for LiteLLM_UserTable via JWT
2024-04-11 18:47:46 -07:00
Ishaan Jaff
3245d8cdce support all-proxy-models for teams 2024-04-02 16:04:09 -07:00
Krrish Dholakia
3810b050c1 fix(proxy_server.py): increment cached global proxy spend object 2024-03-29 20:02:31 -07:00
Krrish Dholakia
5280fc809f fix(proxy_server.py): enforce end user budgets with 'litellm.max_end_user_budget' param 2024-03-29 17:14:40 -07:00
Krrish Dholakia
786116783f fix(proxy_server.py): fix max budget check to also fire slack alert 2024-03-29 16:24:40 -07:00
Krrish Dholakia
d8c15a5677 fix(auth_checks.py): make global spend checks more accurate 2024-03-29 14:57:44 -07:00