phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-27 11:43:54 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
9155 commits 2497 branches 897 tags 550 MiB
Commit graph

1524 commits

Author SHA1 Message Date
Ishaan Jaff
4777921a31
Merge pull request #2723 from BerriAI/litellm_proxy_perf_imp 
[FEAT] Improve Proxy Perf - access router model names in constant time
 2024-03-27 20:48:31 -07:00
Krrish Dholakia
2926d5a8eb fix(proxy/utils.py): check cache before alerting user 2024-03-27 20:09:15 -07:00
Krish Dholakia
75f2b9dd73
Merge pull request #2725 from BerriAI/litellm_calculate_spend 
feat(proxy_server.py): new `/spend/calculate` endpoint
 2024-03-27 19:39:07 -07:00
Krish Dholakia
ef51544741
Merge pull request #2726 from BerriAI/litellm_enforce_user_param 
feat(auth_checks.py): enable admin to enforce 'user' param for all openai endpoints
 2024-03-27 19:38:52 -07:00
Krrish Dholakia
4eb93832e4 feat(auth_checks.py): enable admin to enforce 'user' param for all openai endpoints 2024-03-27 17:36:27 -07:00
Krrish Dholakia
9d0ce1aefd feat(proxy_server.py): new /spend/calculate endpoint 
Allows user to calculate spend before making the call
 2024-03-27 17:08:55 -07:00
Ishaan Jaff
e4e4dd01cd (fix) access router model names in constant time 2024-03-27 16:18:08 -07:00
Ishaan Jaff
c97724df7d (fix) remove background tasks 2024-03-27 15:51:00 -07:00
Tim
d939755a73
Remove duplicated "blocked" field on LiteLLM_TeamTable 2024-03-27 17:02:18 +01:00
Krrish Dholakia
ca84e7a8e8 docs(token_auth.md): update jwt auth docs with new info 2024-03-26 21:33:03 -07:00
Krrish Dholakia
b204f0c01c fix(proxy_cli.py): fix circular import issue 2024-03-26 21:16:41 -07:00
Krish Dholakia
c1f8d346b8
Merge pull request #2706 from BerriAI/litellm_key_llm_guardrails 
feat(llm_guard.py): enable key-specific llm guard check
 2024-03-26 19:02:11 -07:00
Krish Dholakia
e266142d2b
Merge pull request #2705 from BerriAI/litellm_permissions_table 
enable new `/team/disable` endpoint
 2024-03-26 18:47:34 -07:00
Krrish Dholakia
6d418a2920 fix(llm_guard.py): working llm-guard 'key-specific' mode 2024-03-26 17:47:20 -07:00
Krrish Dholakia
e10eb8f6fe feat(llm_guard.py): enable key-specific llm guard check 2024-03-26 17:21:51 -07:00
Krrish Dholakia
bec093675c build(schema.prisma): update schema to enable team blocking 2024-03-26 17:03:32 -07:00
Krrish Dholakia
77472b80eb fix(proxy_server.py): use consistent naming schema - move to /team/block 2024-03-26 16:59:36 -07:00
Krish Dholakia
9d7aceb06e
Merge pull request #2697 from antoniomdk/fix-database-credentials-leakage 
(fix) Remove print statements from append_query_params
 2024-03-26 16:07:33 -07:00
Krish Dholakia
0ab708e6f1
Merge pull request #2704 from BerriAI/litellm_jwt_auth_improvements_3 
fix(handle_jwt.py): enable team-based jwt-auth access
 2024-03-26 16:06:56 -07:00
Krrish Dholakia
4f7ba902d8 feat(proxy_server.py): enable new /team/disable endpoint 
reject all requests from this team id, without deleting it.
 2024-03-26 15:40:50 -07:00
Krrish Dholakia
7b37f4c05f fix(proxy_server.py): rename proxy roles param to litellm_jwtauth 2024-03-26 15:04:30 -07:00
Krrish Dholakia
752516df1b fix(handle_jwt.py): support public key caching ttl param 2024-03-26 14:32:55 -07:00
Krrish Dholakia
d90f44fe8e fix(proxy_server.py): check if team scope in jwt 2024-03-26 14:01:02 -07:00
Krrish Dholakia
7d38c62717 fix(handle_jwt.py): enable team-based jwt-auth access 
Move auth to check on ‘client_id’ not ‘sub
 2024-03-26 12:25:38 -07:00
Ishaan Jaff
da503eab18
Merge branch 'main' into litellm_remove_litellm_telemetry 2024-03-26 11:35:02 -07:00
Ishaan Jaff
6b4b05b58f (fix) remove litellm.telemetry 2024-03-26 11:21:09 -07:00
Ishaan Jaff
2ecdd92619
Merge pull request #2702 from BerriAI/litellm_cache_flush 
[Feat] Proxy - /cache/flushall - delete all elements from cache
 2024-03-26 09:34:39 -07:00
Ishaan Jaff
7409dcd222 (fix) doc string 2024-03-26 09:25:44 -07:00
Ishaan Jaff
b8af946fb9 (feat) /cache/flushall 2024-03-26 09:18:58 -07:00
Ishaan Jaff
151b717ae2 (feat) support cache flush on redis 2024-03-26 09:12:30 -07:00
Antonio Molner Domenech
c713648db1 Update print statements to use verbose logger and DEBUG level 2024-03-26 22:41:28 +07:00
Krrish Dholakia
49e8cdbff9 fix(router.py): check for context window error when handling 400 status code errors 
was causing proxy context window fallbacks to not work as expected
 2024-03-26 08:08:15 -07:00
Ishaan Jaff
7134d66fae
Merge branch 'main' into litellm_batch_write_redis_cache 2024-03-25 16:41:29 -07:00
Ishaan Jaff
4ae51e9fd5 (fix) locust load test use uuid 2024-03-25 15:36:30 -07:00
Krish Dholakia
f15ba10170
Merge pull request #2687 from BerriAI/litellm_jwt_auth_fixes_2 
Litellm jwt auth fixes
 2024-03-25 13:27:19 -07:00
Krrish Dholakia
2e4e97a48f test(test_jwt.py): add unit tests for jwt auth integration 2024-03-25 13:24:39 -07:00
Krrish Dholakia
c2ffb83c71 fix(handle_jwt.py): cache public keys 
caches jwt public keys - reducing need for making http calls on every request
 2024-03-25 12:36:32 -07:00
Krrish Dholakia
f1b1640a31 fix(handle_jwt.py): support scopes being a list 
allow scopes in jwt to be a list, not just a space-separated string
 2024-03-25 12:30:40 -07:00
Krrish Dholakia
5aa1c10929 fix(handle_jwt.py): don't require kid to be set 2024-03-25 12:28:16 -07:00
Krrish Dholakia
93959ab5aa fix(handle_jwt.py): allow setting proxy admin role string for jwt auth 2024-03-25 12:20:14 -07:00
Krrish Dholakia
edd00af6f2 fix(handle_jwt.py): enable user to set jwt admin scope string in config 2024-03-25 11:34:49 -07:00
Ishaan Jaff
734a51c049 (fix) stop using f strings in verbose logger 2024-03-25 10:55:30 -07:00
Ishaan Jaff
5d121a9f3c (fix) stop using f strings with logger 2024-03-25 10:47:18 -07:00
Ishaan Jaff
dad4bd58bc (feat) stop eagerly evaluating fstring 2024-03-25 09:01:42 -07:00
Krish Dholakia
8f966cd78f
Merge pull request #2666 from BerriAI/litellm_model_fix_v_3 
fix(proxy_server.py): fix model info check
 2024-03-23 19:39:03 -07:00
Krish Dholakia
c92fa1af7c
Merge pull request #2669 from BerriAI/litellm_router_pre_call_checks 
feat(router.py): enable pre-call checks
 2024-03-23 19:38:09 -07:00
Krrish Dholakia
eb3ca85d7e feat(router.py): enable pre-call checks 
filter models outside of context window limits of a given message for a model group

 https://github.com/BerriAI/litellm/issues/872
 2024-03-23 18:03:30 -07:00
Ishaan Jaff
925e785a6a (fix) update locustfile 2024-03-23 17:59:54 -07:00
Ishaan Jaff
0c17fe9a32 (feat) update config.yaml 2024-03-23 17:59:16 -07:00
Krrish Dholakia
c81c9c2583 fix(proxy_server.py): fix model info check 2024-03-23 15:59:17 -07:00