Commit graph

1077 commits

Author SHA1 Message Date
Krrish Dholakia
786116783f fix(proxy_server.py): fix max budget check to also fire slack alert 2024-03-29 16:24:40 -07:00
Krrish Dholakia
be6481bb36 fix(proxy_server.py): fix checks 2024-03-29 15:34:13 -07:00
Krrish Dholakia
d8c15a5677 fix(auth_checks.py): make global spend checks more accurate 2024-03-29 14:57:44 -07:00
Ishaan Jaff
7df2d7cb33 (fix) show correct spend on ui 2024-03-29 09:41:00 -07:00
Krrish Dholakia
618cb2441a fix(proxy_server.py): handle pydantic json versioning issue 2024-03-28 23:23:50 -07:00
Krrish Dholakia
5e55df1eaf fix(proxy_server.py): fix pydantic versioning issue 2024-03-28 22:42:26 -07:00
Krrish Dholakia
5a117490ec fix(proxy_server.py): fix tpm/rpm limiting for jwt auth
fixes tpm/rpm limiting for jwt auth and implements unit tests for jwt auth
2024-03-28 21:19:34 -07:00
Krrish Dholakia
c15ba368e7 fix(proxy_server.py): enable spend tracking for team-based jwt auth 2024-03-28 20:16:22 -07:00
Krrish Dholakia
19e43c8d29 fix(proxy_server.py): return deleted team id's to confirm /team/delete worked 2024-03-28 16:09:33 -07:00
Krrish Dholakia
f80b500917 docs(proxy_server.py): add update team TPM/RPM limit to swagger docs 2024-03-28 16:02:51 -07:00
Krrish Dholakia
58bdbecbc6 fix(proxy_server.py): allow updating tpm/rpm limits via /team/update 2024-03-28 15:59:35 -07:00
Krrish Dholakia
569e660a67 docs(proxy_server.py): improve swagger docs for /team/new 2024-03-28 15:50:38 -07:00
Krrish Dholakia
a1d0e3f4ad docs(proxy_server.py): improve swagger doc for /team/new 2024-03-28 15:39:48 -07:00
Krrish Dholakia
8c9623a6bc fix(proxy_server.py): fix user_id_information none check 2024-03-28 15:18:52 -07:00
Ishaan Jaff
ddba16756d
Merge pull request #2735 from BerriAI/admin_ui_clearly_show_models
Admin UI clearly show models
2024-03-28 15:14:38 -07:00
Ishaan Jaff
fc79e8255c (fix) actually view the spend report on the UI 2024-03-28 15:08:21 -07:00
Krish Dholakia
7d3244c012
Merge branch 'main' into litellm_auto_create_user_fix 2024-03-28 14:57:39 -07:00
Krish Dholakia
934a9ac2b4
Merge pull request #2722 from BerriAI/litellm_db_perf_improvement
feat(proxy/utils.py): enable updating db in a separate server
2024-03-28 14:56:14 -07:00
Ishaan Jaff
beb72f94e0 (feat) return team alias in keys 2024-03-28 10:16:07 -07:00
Ishaan Jaff
7f793246c2 (feat) return team alias when hitting user/info 2024-03-28 09:41:15 -07:00
Krrish Dholakia
082f1e4085 fix(proxy_server.py): allow user to pass in spend logs collector url 2024-03-28 09:14:30 -07:00
Ishaan Jaff
4a5ce43bd5 (fix) raise exception when master key not set + trying to use ui 2024-03-27 22:25:53 -07:00
Ishaan Jaff
37f189935a (fix) show user their role when rejecting /team/new requests 2024-03-27 20:54:07 -07:00
Ishaan Jaff
4777921a31
Merge pull request #2723 from BerriAI/litellm_proxy_perf_imp
[FEAT] Improve Proxy Perf - access router model names in constant time
2024-03-27 20:48:31 -07:00
Krrish Dholakia
34790c7e12 fix(proxy_server.py): fix linting error 2024-03-27 19:54:25 -07:00
Krrish Dholakia
ad43138f28 fix(proxy_server.py): fix budget add logic to accurately log who created it 2024-03-27 19:43:15 -07:00
Krish Dholakia
75f2b9dd73
Merge pull request #2725 from BerriAI/litellm_calculate_spend
feat(proxy_server.py): new `/spend/calculate` endpoint
2024-03-27 19:39:07 -07:00
Krish Dholakia
ef51544741
Merge pull request #2726 from BerriAI/litellm_enforce_user_param
feat(auth_checks.py): enable admin to enforce 'user' param for all openai endpoints
2024-03-27 19:38:52 -07:00
Krrish Dholakia
4eb93832e4 feat(auth_checks.py): enable admin to enforce 'user' param for all openai endpoints 2024-03-27 17:36:27 -07:00
Krrish Dholakia
9d0ce1aefd feat(proxy_server.py): new /spend/calculate endpoint
Allows user to calculate spend before making the call
2024-03-27 17:08:55 -07:00
Krrish Dholakia
a408c46a67 fix(proxy_server.py): don't auto-create user when creating key 2024-03-27 16:48:57 -07:00
Ishaan Jaff
e4e4dd01cd (fix) access router model names in constant time 2024-03-27 16:18:08 -07:00
Krrish Dholakia
1e856443e1 feat(proxy/utils.py): enable updating db in a separate server 2024-03-27 16:02:36 -07:00
Ishaan Jaff
c97724df7d (fix) remove background tasks 2024-03-27 15:51:00 -07:00
Krish Dholakia
c1f8d346b8
Merge pull request #2706 from BerriAI/litellm_key_llm_guardrails
feat(llm_guard.py): enable key-specific llm guard check
2024-03-26 19:02:11 -07:00
Krish Dholakia
e266142d2b
Merge pull request #2705 from BerriAI/litellm_permissions_table
enable new `/team/disable` endpoint
2024-03-26 18:47:34 -07:00
Krrish Dholakia
e10eb8f6fe feat(llm_guard.py): enable key-specific llm guard check 2024-03-26 17:21:51 -07:00
Krrish Dholakia
77472b80eb fix(proxy_server.py): use consistent naming schema - move to /team/block 2024-03-26 16:59:36 -07:00
Krish Dholakia
0ab708e6f1
Merge pull request #2704 from BerriAI/litellm_jwt_auth_improvements_3
fix(handle_jwt.py): enable team-based jwt-auth access
2024-03-26 16:06:56 -07:00
Krrish Dholakia
4f7ba902d8 feat(proxy_server.py): enable new /team/disable endpoint
reject all requests from this team id, without deleting it.
2024-03-26 15:40:50 -07:00
Krrish Dholakia
7b37f4c05f fix(proxy_server.py): rename proxy roles param to litellm_jwtauth 2024-03-26 15:04:30 -07:00
Krrish Dholakia
752516df1b fix(handle_jwt.py): support public key caching ttl param 2024-03-26 14:32:55 -07:00
Krrish Dholakia
d90f44fe8e fix(proxy_server.py): check if team scope in jwt 2024-03-26 14:01:02 -07:00
Krrish Dholakia
7d38c62717 fix(handle_jwt.py): enable team-based jwt-auth access
Move auth to check on ‘client_id’ not ‘sub
2024-03-26 12:25:38 -07:00
Ishaan Jaff
da503eab18
Merge branch 'main' into litellm_remove_litellm_telemetry 2024-03-26 11:35:02 -07:00
Ishaan Jaff
6b4b05b58f (fix) remove litellm.telemetry 2024-03-26 11:21:09 -07:00
Ishaan Jaff
7409dcd222 (fix) doc string 2024-03-26 09:25:44 -07:00
Ishaan Jaff
b8af946fb9 (feat) /cache/flushall 2024-03-26 09:18:58 -07:00
Ishaan Jaff
151b717ae2 (feat) support cache flush on redis 2024-03-26 09:12:30 -07:00
Krish Dholakia
f15ba10170
Merge pull request #2687 from BerriAI/litellm_jwt_auth_fixes_2
Litellm jwt auth fixes
2024-03-25 13:27:19 -07:00