Commit graph

1079 commits

Author SHA1 Message Date
Krrish Dholakia
9fc8b8a215 fix(proxy_server.py): increment cached global proxy spend object 2024-03-29 20:02:31 -07:00
Krrish Dholakia
49e2624240 fix(proxy_server.py): enforce end user budgets with 'litellm.max_end_user_budget' param 2024-03-29 17:14:40 -07:00
Krrish Dholakia
f7004a94df fix(proxy_server.py): fix max budget check to also fire slack alert 2024-03-29 16:24:40 -07:00
Krrish Dholakia
fbe4d6d332 fix(proxy_server.py): fix checks 2024-03-29 15:34:13 -07:00
Krrish Dholakia
2d5201aa4e fix(auth_checks.py): make global spend checks more accurate 2024-03-29 14:57:44 -07:00
Ishaan Jaff
f6cb76c110 (fix) show correct spend on ui 2024-03-29 09:41:00 -07:00
Krrish Dholakia
48df7003a0 fix(proxy_server.py): handle pydantic json versioning issue 2024-03-28 23:23:50 -07:00
Krrish Dholakia
dc9dc3b1f6 fix(proxy_server.py): fix pydantic versioning issue 2024-03-28 22:42:26 -07:00
Krrish Dholakia
737bb3e444 fix(proxy_server.py): fix tpm/rpm limiting for jwt auth
fixes tpm/rpm limiting for jwt auth and implements unit tests for jwt auth
2024-03-28 21:19:34 -07:00
Krrish Dholakia
6848e3b1d2 fix(proxy_server.py): enable spend tracking for team-based jwt auth 2024-03-28 20:16:22 -07:00
Krrish Dholakia
5634a8c7e6 fix(proxy_server.py): return deleted team id's to confirm /team/delete worked 2024-03-28 16:09:33 -07:00
Krrish Dholakia
9717aa1dad docs(proxy_server.py): add update team TPM/RPM limit to swagger docs 2024-03-28 16:02:51 -07:00
Krrish Dholakia
ec49ebb72b fix(proxy_server.py): allow updating tpm/rpm limits via /team/update 2024-03-28 15:59:35 -07:00
Krrish Dholakia
501d0a16f5 docs(proxy_server.py): improve swagger docs for /team/new 2024-03-28 15:50:38 -07:00
Krrish Dholakia
0e76e6161a docs(proxy_server.py): improve swagger doc for /team/new 2024-03-28 15:39:48 -07:00
Krrish Dholakia
be8dd499c3 fix(proxy_server.py): fix user_id_information none check 2024-03-28 15:18:52 -07:00
Ishaan Jaff
cab28e874a Merge pull request #2735 from BerriAI/admin_ui_clearly_show_models
Admin UI clearly show models
2024-03-28 15:14:38 -07:00
Ishaan Jaff
124fb924ca (fix) actually view the spend report on the UI 2024-03-28 15:08:21 -07:00
Krish Dholakia
ddac479ae7 Merge branch 'main' into litellm_auto_create_user_fix 2024-03-28 14:57:39 -07:00
Krish Dholakia
b828290c81 Merge pull request #2722 from BerriAI/litellm_db_perf_improvement
feat(proxy/utils.py): enable updating db in a separate server
2024-03-28 14:56:14 -07:00
Ishaan Jaff
0a38044f0c (feat) return team alias in keys 2024-03-28 10:16:07 -07:00
Ishaan Jaff
61f897b446 (feat) return team alias when hitting user/info 2024-03-28 09:41:15 -07:00
Krrish Dholakia
e87c5f5d6f fix(proxy_server.py): allow user to pass in spend logs collector url 2024-03-28 09:14:30 -07:00
Ishaan Jaff
3044f3693d (fix) raise exception when master key not set + trying to use ui 2024-03-27 22:25:53 -07:00
Ishaan Jaff
f3cf29264f (fix) show user their role when rejecting /team/new requests 2024-03-27 20:54:07 -07:00
Ishaan Jaff
a4655e32f6 Merge pull request #2723 from BerriAI/litellm_proxy_perf_imp
[FEAT] Improve Proxy Perf - access router model names in constant time
2024-03-27 20:48:31 -07:00
Krrish Dholakia
27d03f3ed9 fix(proxy_server.py): fix linting error 2024-03-27 19:54:25 -07:00
Krrish Dholakia
14bd7a8c37 fix(proxy_server.py): fix budget add logic to accurately log who created it 2024-03-27 19:43:15 -07:00
Krish Dholakia
265d32679e Merge pull request #2725 from BerriAI/litellm_calculate_spend
feat(proxy_server.py): new `/spend/calculate` endpoint
2024-03-27 19:39:07 -07:00
Krish Dholakia
bc2df42e52 Merge pull request #2726 from BerriAI/litellm_enforce_user_param
feat(auth_checks.py): enable admin to enforce 'user' param for all openai endpoints
2024-03-27 19:38:52 -07:00
Krrish Dholakia
0417ce6cbe feat(auth_checks.py): enable admin to enforce 'user' param for all openai endpoints 2024-03-27 17:36:27 -07:00
Krrish Dholakia
4da70d223e feat(proxy_server.py): new /spend/calculate endpoint
Allows user to calculate spend before making the call
2024-03-27 17:08:55 -07:00
Krrish Dholakia
3df60e856c fix(proxy_server.py): don't auto-create user when creating key 2024-03-27 16:48:57 -07:00
Ishaan Jaff
fd1e255509 (fix) access router model names in constant time 2024-03-27 16:18:08 -07:00
Krrish Dholakia
46937935d1 feat(proxy/utils.py): enable updating db in a separate server 2024-03-27 16:02:36 -07:00
Ishaan Jaff
c81518dd66 (fix) remove background tasks 2024-03-27 15:51:00 -07:00
Krish Dholakia
b73e1307ab Merge pull request #2706 from BerriAI/litellm_key_llm_guardrails
feat(llm_guard.py): enable key-specific llm guard check
2024-03-26 19:02:11 -07:00
Krish Dholakia
11a241d056 Merge pull request #2705 from BerriAI/litellm_permissions_table
enable new `/team/disable` endpoint
2024-03-26 18:47:34 -07:00
Krrish Dholakia
7bc76ddbc3 feat(llm_guard.py): enable key-specific llm guard check 2024-03-26 17:21:51 -07:00
Krrish Dholakia
94c5d9f82f fix(proxy_server.py): use consistent naming schema - move to /team/block 2024-03-26 16:59:36 -07:00
Krish Dholakia
d51f12ca44 Merge pull request #2704 from BerriAI/litellm_jwt_auth_improvements_3
fix(handle_jwt.py): enable team-based jwt-auth access
2024-03-26 16:06:56 -07:00
Krrish Dholakia
ce44645000 feat(proxy_server.py): enable new /team/disable endpoint
reject all requests from this team id, without deleting it.
2024-03-26 15:40:50 -07:00
Krrish Dholakia
5ab34345e9 fix(proxy_server.py): rename proxy roles param to litellm_jwtauth 2024-03-26 15:04:30 -07:00
Krrish Dholakia
a0f55b92e6 fix(handle_jwt.py): support public key caching ttl param 2024-03-26 14:32:55 -07:00
Krrish Dholakia
d69ae350b4 fix(proxy_server.py): check if team scope in jwt 2024-03-26 14:01:02 -07:00
Krrish Dholakia
b9180a8c72 fix(handle_jwt.py): enable team-based jwt-auth access
Move auth to check on ‘client_id’ not ‘sub
2024-03-26 12:25:38 -07:00
Ishaan Jaff
f5f7e344c7 Merge branch 'main' into litellm_remove_litellm_telemetry 2024-03-26 11:35:02 -07:00
Ishaan Jaff
62c83d36a5 (fix) remove litellm.telemetry 2024-03-26 11:21:09 -07:00
Ishaan Jaff
1a2ec398a8 (fix) doc string 2024-03-26 09:25:44 -07:00
Ishaan Jaff
f1ebbd32b8 (feat) /cache/flushall 2024-03-26 09:18:58 -07:00