Krrish Dholakia
|
b204f0c01c
|
fix(proxy_cli.py): fix circular import issue
|
2024-03-26 21:16:41 -07:00 |
|
Krish Dholakia
|
c1f8d346b8
|
Merge pull request #2706 from BerriAI/litellm_key_llm_guardrails
feat(llm_guard.py): enable key-specific llm guard check
|
2024-03-26 19:02:11 -07:00 |
|
Krish Dholakia
|
e266142d2b
|
Merge pull request #2705 from BerriAI/litellm_permissions_table
enable new `/team/disable` endpoint
|
2024-03-26 18:47:34 -07:00 |
|
Krrish Dholakia
|
6d418a2920
|
fix(llm_guard.py): working llm-guard 'key-specific' mode
|
2024-03-26 17:47:20 -07:00 |
|
Krrish Dholakia
|
e10eb8f6fe
|
feat(llm_guard.py): enable key-specific llm guard check
|
2024-03-26 17:21:51 -07:00 |
|
Krrish Dholakia
|
bec093675c
|
build(schema.prisma): update schema to enable team blocking
|
2024-03-26 17:03:32 -07:00 |
|
Krrish Dholakia
|
77472b80eb
|
fix(proxy_server.py): use consistent naming schema - move to /team/block
|
2024-03-26 16:59:36 -07:00 |
|
Krish Dholakia
|
9d7aceb06e
|
Merge pull request #2697 from antoniomdk/fix-database-credentials-leakage
(fix) Remove print statements from append_query_params
|
2024-03-26 16:07:33 -07:00 |
|
Krish Dholakia
|
0ab708e6f1
|
Merge pull request #2704 from BerriAI/litellm_jwt_auth_improvements_3
fix(handle_jwt.py): enable team-based jwt-auth access
|
2024-03-26 16:06:56 -07:00 |
|
Krrish Dholakia
|
4f7ba902d8
|
feat(proxy_server.py): enable new /team/disable endpoint
reject all requests from this team id, without deleting it.
|
2024-03-26 15:40:50 -07:00 |
|
Krrish Dholakia
|
7b37f4c05f
|
fix(proxy_server.py): rename proxy roles param to litellm_jwtauth
|
2024-03-26 15:04:30 -07:00 |
|
Krrish Dholakia
|
752516df1b
|
fix(handle_jwt.py): support public key caching ttl param
|
2024-03-26 14:32:55 -07:00 |
|
Krrish Dholakia
|
d90f44fe8e
|
fix(proxy_server.py): check if team scope in jwt
|
2024-03-26 14:01:02 -07:00 |
|
Krrish Dholakia
|
7d38c62717
|
fix(handle_jwt.py): enable team-based jwt-auth access
Move auth to check on ‘client_id’ not ‘sub
|
2024-03-26 12:25:38 -07:00 |
|
Ishaan Jaff
|
da503eab18
|
Merge branch 'main' into litellm_remove_litellm_telemetry
|
2024-03-26 11:35:02 -07:00 |
|
Ishaan Jaff
|
6b4b05b58f
|
(fix) remove litellm.telemetry
|
2024-03-26 11:21:09 -07:00 |
|
Ishaan Jaff
|
2ecdd92619
|
Merge pull request #2702 from BerriAI/litellm_cache_flush
[Feat] Proxy - /cache/flushall - delete all elements from cache
|
2024-03-26 09:34:39 -07:00 |
|
Ishaan Jaff
|
7409dcd222
|
(fix) doc string
|
2024-03-26 09:25:44 -07:00 |
|
Ishaan Jaff
|
b8af946fb9
|
(feat) /cache/flushall
|
2024-03-26 09:18:58 -07:00 |
|
Ishaan Jaff
|
151b717ae2
|
(feat) support cache flush on redis
|
2024-03-26 09:12:30 -07:00 |
|
Antonio Molner Domenech
|
c713648db1
|
Update print statements to use verbose logger and DEBUG level
|
2024-03-26 22:41:28 +07:00 |
|
Krrish Dholakia
|
49e8cdbff9
|
fix(router.py): check for context window error when handling 400 status code errors
was causing proxy context window fallbacks to not work as expected
|
2024-03-26 08:08:15 -07:00 |
|
Ishaan Jaff
|
7134d66fae
|
Merge branch 'main' into litellm_batch_write_redis_cache
|
2024-03-25 16:41:29 -07:00 |
|
Ishaan Jaff
|
4ae51e9fd5
|
(fix) locust load test use uuid
|
2024-03-25 15:36:30 -07:00 |
|
Krish Dholakia
|
f15ba10170
|
Merge pull request #2687 from BerriAI/litellm_jwt_auth_fixes_2
Litellm jwt auth fixes
|
2024-03-25 13:27:19 -07:00 |
|
Krrish Dholakia
|
2e4e97a48f
|
test(test_jwt.py): add unit tests for jwt auth integration
|
2024-03-25 13:24:39 -07:00 |
|
Krrish Dholakia
|
c2ffb83c71
|
fix(handle_jwt.py): cache public keys
caches jwt public keys - reducing need for making http calls on every request
|
2024-03-25 12:36:32 -07:00 |
|
Krrish Dholakia
|
f1b1640a31
|
fix(handle_jwt.py): support scopes being a list
allow scopes in jwt to be a list, not just a space-separated string
|
2024-03-25 12:30:40 -07:00 |
|
Krrish Dholakia
|
5aa1c10929
|
fix(handle_jwt.py): don't require kid to be set
|
2024-03-25 12:28:16 -07:00 |
|
Krrish Dholakia
|
93959ab5aa
|
fix(handle_jwt.py): allow setting proxy admin role string for jwt auth
|
2024-03-25 12:20:14 -07:00 |
|
Krrish Dholakia
|
edd00af6f2
|
fix(handle_jwt.py): enable user to set jwt admin scope string in config
|
2024-03-25 11:34:49 -07:00 |
|
Ishaan Jaff
|
734a51c049
|
(fix) stop using f strings in verbose logger
|
2024-03-25 10:55:30 -07:00 |
|
Ishaan Jaff
|
5d121a9f3c
|
(fix) stop using f strings with logger
|
2024-03-25 10:47:18 -07:00 |
|
Ishaan Jaff
|
dad4bd58bc
|
(feat) stop eagerly evaluating fstring
|
2024-03-25 09:01:42 -07:00 |
|
Krish Dholakia
|
8f966cd78f
|
Merge pull request #2666 from BerriAI/litellm_model_fix_v_3
fix(proxy_server.py): fix model info check
|
2024-03-23 19:39:03 -07:00 |
|
Krish Dholakia
|
c92fa1af7c
|
Merge pull request #2669 from BerriAI/litellm_router_pre_call_checks
feat(router.py): enable pre-call checks
|
2024-03-23 19:38:09 -07:00 |
|
Krrish Dholakia
|
eb3ca85d7e
|
feat(router.py): enable pre-call checks
filter models outside of context window limits of a given message for a model group
https://github.com/BerriAI/litellm/issues/872
|
2024-03-23 18:03:30 -07:00 |
|
Ishaan Jaff
|
925e785a6a
|
(fix) update locustfile
|
2024-03-23 17:59:54 -07:00 |
|
Ishaan Jaff
|
0c17fe9a32
|
(feat) update config.yaml
|
2024-03-23 17:59:16 -07:00 |
|
Krrish Dholakia
|
c81c9c2583
|
fix(proxy_server.py): fix model info check
|
2024-03-23 15:59:17 -07:00 |
|
Ishaan Jaff
|
aca6ec85e2
|
(fix) add some better load testing
|
2024-03-22 19:48:54 -07:00 |
|
Ishaan Jaff
|
28e62af4e1
|
(fix) update load test used
|
2024-03-22 19:48:54 -07:00 |
|
Krrish Dholakia
|
d06b9a5a47
|
fix(proxy_server.py): enable jwt-auth for users
allow a user to auth into the proxy via jwt's and call allowed routes
|
2024-03-22 17:08:10 -07:00 |
|
Krrish Dholakia
|
9bf086386e
|
fix(handle_jwt.py): add more logging for jwt header
|
2024-03-22 16:33:32 -07:00 |
|
Krish Dholakia
|
8c45986e72
|
Merge pull request #2619 from BerriAI/litellm_install_tenacity
(fix) include tenacity in req.txt
|
2024-03-21 20:55:56 -07:00 |
|
Krrish Dholakia
|
d57995a73d
|
build(schema.prisma): use jsonProtocol to fix db connection issues
https://github.com/prisma/prisma/discussions/19978
|
2024-03-21 18:01:45 -07:00 |
|
Krrish Dholakia
|
4ac14a4e85
|
build(networking.tsx): fix trailing slash
|
2024-03-21 17:50:59 -07:00 |
|
Krrish Dholakia
|
d9577c3e2b
|
build(networking.tsx): modify url to prevent redirects
|
2024-03-21 17:43:41 -07:00 |
|
Krrish Dholakia
|
33964233a5
|
fix(proxy_server.py): allow user to disable swagger ui docs via env
user can disable swagger ui docs by setting 'NO_DOCS="True"' in their env
|
2024-03-21 17:15:18 -07:00 |
|
Krish Dholakia
|
33a433eb0a
|
Merge branch 'main' into litellm_llm_api_prompt_injection_check
|
2024-03-21 09:57:10 -07:00 |
|