phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity
9852 commits 1603 branches 645 tags 320 MiB
Commit graph

1108 commits

Author SHA1 Message Date
Ishaan Jaff
7f793246c2 (feat) return team alias when hitting user/info 2024-03-28 09:41:15 -07:00
Krrish Dholakia
082f1e4085 fix(proxy_server.py): allow user to pass in spend logs collector url 2024-03-28 09:14:30 -07:00
Ishaan Jaff
4a5ce43bd5 (fix) raise exception when master key not set + trying to use ui 2024-03-27 22:25:53 -07:00
Ishaan Jaff
37f189935a (fix) show user their role when rejecting /team/new requests 2024-03-27 20:54:07 -07:00
Ishaan Jaff
4777921a31
Merge pull request #2723 from BerriAI/litellm_proxy_perf_imp 
[FEAT] Improve Proxy Perf - access router model names in constant time
 2024-03-27 20:48:31 -07:00
Krrish Dholakia
34790c7e12 fix(proxy_server.py): fix linting error 2024-03-27 19:54:25 -07:00
Krrish Dholakia
ad43138f28 fix(proxy_server.py): fix budget add logic to accurately log who created it 2024-03-27 19:43:15 -07:00
Krish Dholakia
75f2b9dd73
Merge pull request #2725 from BerriAI/litellm_calculate_spend 
feat(proxy_server.py): new `/spend/calculate` endpoint
 2024-03-27 19:39:07 -07:00
Krish Dholakia
ef51544741
Merge pull request #2726 from BerriAI/litellm_enforce_user_param 
feat(auth_checks.py): enable admin to enforce 'user' param for all openai endpoints
 2024-03-27 19:38:52 -07:00
Krrish Dholakia
4eb93832e4 feat(auth_checks.py): enable admin to enforce 'user' param for all openai endpoints 2024-03-27 17:36:27 -07:00
Krrish Dholakia
9d0ce1aefd feat(proxy_server.py): new /spend/calculate endpoint 
Allows user to calculate spend before making the call
 2024-03-27 17:08:55 -07:00
Krrish Dholakia
a408c46a67 fix(proxy_server.py): don't auto-create user when creating key 2024-03-27 16:48:57 -07:00
Ishaan Jaff
e4e4dd01cd (fix) access router model names in constant time 2024-03-27 16:18:08 -07:00
Krrish Dholakia
1e856443e1 feat(proxy/utils.py): enable updating db in a separate server 2024-03-27 16:02:36 -07:00
Ishaan Jaff
c97724df7d (fix) remove background tasks 2024-03-27 15:51:00 -07:00
Krish Dholakia
c1f8d346b8
Merge pull request #2706 from BerriAI/litellm_key_llm_guardrails 
feat(llm_guard.py): enable key-specific llm guard check
 2024-03-26 19:02:11 -07:00
Krish Dholakia
e266142d2b
Merge pull request #2705 from BerriAI/litellm_permissions_table 
enable new `/team/disable` endpoint
 2024-03-26 18:47:34 -07:00
Krrish Dholakia
e10eb8f6fe feat(llm_guard.py): enable key-specific llm guard check 2024-03-26 17:21:51 -07:00
Krrish Dholakia
77472b80eb fix(proxy_server.py): use consistent naming schema - move to /team/block 2024-03-26 16:59:36 -07:00
Krish Dholakia
0ab708e6f1
Merge pull request #2704 from BerriAI/litellm_jwt_auth_improvements_3 
fix(handle_jwt.py): enable team-based jwt-auth access
 2024-03-26 16:06:56 -07:00
Krrish Dholakia
4f7ba902d8 feat(proxy_server.py): enable new /team/disable endpoint 
reject all requests from this team id, without deleting it.
 2024-03-26 15:40:50 -07:00
Krrish Dholakia
7b37f4c05f fix(proxy_server.py): rename proxy roles param to litellm_jwtauth 2024-03-26 15:04:30 -07:00
Krrish Dholakia
752516df1b fix(handle_jwt.py): support public key caching ttl param 2024-03-26 14:32:55 -07:00
Krrish Dholakia
d90f44fe8e fix(proxy_server.py): check if team scope in jwt 2024-03-26 14:01:02 -07:00
Krrish Dholakia
7d38c62717 fix(handle_jwt.py): enable team-based jwt-auth access 
Move auth to check on ‘client_id’ not ‘sub
 2024-03-26 12:25:38 -07:00
Ishaan Jaff
da503eab18
Merge branch 'main' into litellm_remove_litellm_telemetry 2024-03-26 11:35:02 -07:00
Ishaan Jaff
6b4b05b58f (fix) remove litellm.telemetry 2024-03-26 11:21:09 -07:00
Ishaan Jaff
7409dcd222 (fix) doc string 2024-03-26 09:25:44 -07:00
Ishaan Jaff
b8af946fb9 (feat) /cache/flushall 2024-03-26 09:18:58 -07:00
Ishaan Jaff
151b717ae2 (feat) support cache flush on redis 2024-03-26 09:12:30 -07:00
Krish Dholakia
f15ba10170
Merge pull request #2687 from BerriAI/litellm_jwt_auth_fixes_2 
Litellm jwt auth fixes
 2024-03-25 13:27:19 -07:00
Krrish Dholakia
93959ab5aa fix(handle_jwt.py): allow setting proxy admin role string for jwt auth 2024-03-25 12:20:14 -07:00
Ishaan Jaff
734a51c049 (fix) stop using f strings in verbose logger 2024-03-25 10:55:30 -07:00
Ishaan Jaff
5d121a9f3c (fix) stop using f strings with logger 2024-03-25 10:47:18 -07:00
Ishaan Jaff
dad4bd58bc (feat) stop eagerly evaluating fstring 2024-03-25 09:01:42 -07:00
Krrish Dholakia
c81c9c2583 fix(proxy_server.py): fix model info check 2024-03-23 15:59:17 -07:00
Krrish Dholakia
d06b9a5a47 fix(proxy_server.py): enable jwt-auth for users 
allow a user to auth into the proxy via jwt's and call allowed routes
 2024-03-22 17:08:10 -07:00
Krrish Dholakia
33964233a5 fix(proxy_server.py): allow user to disable swagger ui docs via env 
user can disable swagger ui docs by setting 'NO_DOCS="True"' in their env
 2024-03-21 17:15:18 -07:00
Krish Dholakia
33a433eb0a
Merge branch 'main' into litellm_llm_api_prompt_injection_check 2024-03-21 09:57:10 -07:00
Ishaan Jaff
bcd62034ed
Merge pull request #2563 from eltociear/patch-2 
Update proxy_server.py
 2024-03-21 07:29:33 -07:00
Krrish Dholakia
d91f9a9f50 feat(proxy_server.py): enable llm api based prompt injection checks 
run user calls through an llm api to check for prompt injection attacks. This happens in parallel to th
e actual llm call using `async_moderation_hook`
 2024-03-20 22:43:42 -07:00
Krish Dholakia
007d439017
Merge pull request #2606 from BerriAI/litellm_jwt_auth_updates 
fix(handle_jwt.py): track spend for user using jwt auth
 2024-03-20 19:40:17 -07:00
Krrish Dholakia
f24d3ffdb6 fix(proxy_server.py): fix import 2024-03-20 19:15:06 -07:00
Krrish Dholakia
8bb00c4ae8 fix(caching.py): enable async setting of cache for dual cache 2024-03-20 18:42:34 -07:00
Krrish Dholakia
90e17b5422 fix(handle_jwt.py): track spend for user using jwt auth 2024-03-20 10:55:52 -07:00
Ishaan Jaff
4ed551dc52 (feat) better debugging for /cache/ping 2024-03-20 08:30:11 -07:00
Ishaan Jaff
2256ece5a9 (feat) litellm cache ping 2024-03-20 08:24:13 -07:00
Ishaan Jaff
8f750b71eb (fix) caching - don't require cache password 2024-03-19 20:50:16 -07:00
Krrish Dholakia
f25b03326b fix(proxy_server.py): allow user to disable scheduled reset budget task 2024-03-19 20:36:22 -07:00
Krrish Dholakia
2dfdc8dd69 Revert "Merge pull request #2593 from BerriAI/litellm_reset_budget_fix" 
This reverts commit afd363129f, reversing
changes made to c94bc94ad5.
 2024-03-19 20:25:41 -07:00