Commit graph

9378 commits

Author SHA1 Message Date
Krish Dholakia
9d7aceb06e
Merge pull request #2697 from antoniomdk/fix-database-credentials-leakage
(fix) Remove print statements from append_query_params
2024-03-26 16:07:33 -07:00
Krish Dholakia
0ab708e6f1
Merge pull request #2704 from BerriAI/litellm_jwt_auth_improvements_3
fix(handle_jwt.py): enable team-based jwt-auth access
2024-03-26 16:06:56 -07:00
Krrish Dholakia
4f7ba902d8 feat(proxy_server.py): enable new /team/disable endpoint
reject all requests from this team id, without deleting it.
2024-03-26 15:40:50 -07:00
Krrish Dholakia
ea8f6672c5 test(test_jwt.py): fix test 2024-03-26 15:22:05 -07:00
Krrish Dholakia
7b37f4c05f fix(proxy_server.py): rename proxy roles param to litellm_jwtauth 2024-03-26 15:04:30 -07:00
Krrish Dholakia
4281f1545b fix(utils.py): check if item in list is pydantic object or dict before dereferencing 2024-03-26 14:39:16 -07:00
Krrish Dholakia
752516df1b fix(handle_jwt.py): support public key caching ttl param 2024-03-26 14:32:55 -07:00
Krrish Dholakia
d90f44fe8e fix(proxy_server.py): check if team scope in jwt 2024-03-26 14:01:02 -07:00
Krrish Dholakia
4d7f4550e2 test(test_batch_completions.py): handle anthropic overloaded error 2024-03-26 13:55:03 -07:00
Krrish Dholakia
6b1d2551d1 test(test_batch_completions.py): handle overloaded anthropic error 2024-03-26 13:53:18 -07:00
Krrish Dholakia
3a82ff2ef2 fix(utils.py): don't send subsequent chunks if last chunk sent
prevents multiple empty finish chunks from being sent
2024-03-26 13:49:42 -07:00
Krrish Dholakia
7d38c62717 fix(handle_jwt.py): enable team-based jwt-auth access
Move auth to check on ‘client_id’ not ‘sub
2024-03-26 12:25:38 -07:00
Ishaan Jaff
0f432dfb4b
Merge pull request #2703 from BerriAI/litellm_remove_litellm_telemetry
[Fix] remove litellm telemetry from proxy server
2024-03-26 11:35:18 -07:00
Ishaan Jaff
da503eab18
Merge branch 'main' into litellm_remove_litellm_telemetry 2024-03-26 11:35:02 -07:00
Ishaan Jaff
b6af44c4dc (fix) telemetry = false 2024-03-26 11:23:23 -07:00
Ishaan Jaff
6b4b05b58f (fix) remove litellm.telemetry 2024-03-26 11:21:09 -07:00
Ishaan Jaff
4d81df3d6f (docs) switch of litellm telemetry 2024-03-26 11:19:55 -07:00
Krish Dholakia
f3f56204c5
Update README.md 2024-03-26 10:34:16 -07:00
Krrish Dholakia
b4d0a95cff test(test_router_debug_logs.py): add info statement to log test 2024-03-26 09:54:26 -07:00
Krrish Dholakia
584d187e0e fix(utils.py): check if message is pydantic object or dict before dereferencing 2024-03-26 09:47:44 -07:00
Ishaan Jaff
2ecdd92619
Merge pull request #2702 from BerriAI/litellm_cache_flush
[Feat] Proxy - /cache/flushall - delete all elements from cache
2024-03-26 09:34:39 -07:00
Ishaan Jaff
7409dcd222 (fix) doc string 2024-03-26 09:25:44 -07:00
Ishaan Jaff
75ef51b714 (fix) undo change from other branch 2024-03-26 09:24:12 -07:00
Ishaan Jaff
098a03facc (fix) undo changes from other branches 2024-03-26 09:22:19 -07:00
Ishaan Jaff
b8af946fb9 (feat) /cache/flushall 2024-03-26 09:18:58 -07:00
Ishaan Jaff
151b717ae2 (feat) support cache flush on redis 2024-03-26 09:12:30 -07:00
Ishaan Jaff
ade5d58331 (fix) in mem redis reads 2024-03-26 09:10:49 -07:00
Krrish Dholakia
2dd2b8a8e3 test(test_streaming.py): add unit testing for custom stream wrapper 2024-03-26 08:57:44 -07:00
Rob Mann
e80aae5c30 Updating the default Claude3 max tokens 2024-03-26 11:46:59 -04:00
Antonio Molner Domenech
c713648db1 Update print statements to use verbose logger and DEBUG level 2024-03-26 22:41:28 +07:00
Krish Dholakia
6f11f300fc
Merge pull request #2656 from TashaSkyUp/patch-1
fix for: when using ModelResponse.json() to save and then reconstruct a ModelResponse the choices field ends up empty
2024-03-26 08:36:55 -07:00
Krrish Dholakia
49e8cdbff9 fix(router.py): check for context window error when handling 400 status code errors
was causing proxy context window fallbacks to not work as expected
2024-03-26 08:08:15 -07:00
Ishaan Jaff
787c9b7df0 (test) claude-1 api is unstable 2024-03-26 08:07:16 -07:00
Ishaan Jaff
81b716d8da (fix) cache control logic 2024-03-26 07:36:45 -07:00
Ishaan Jaff
995c379a63 (fix) prod.md 2024-03-25 22:30:22 -07:00
Ishaan Jaff
5b2698a9ed (kub) always pull litellm image 2024-03-25 22:29:23 -07:00
Ishaan Jaff
965fb6eb2c (fix) cache control logic 2024-03-25 22:19:34 -07:00
Krrish Dholakia
a3617a6af6 bump: version 1.34.3 → 1.34.4 2024-03-25 21:58:49 -07:00
Krish Dholakia
eb859f5dba
Merge pull request #2692 from BerriAI/litellm_streaming_fixes
fix(utils.py): ensure last chunk is always empty delta w/ finish reason
2024-03-25 21:57:04 -07:00
Krrish Dholakia
643fd6ac96 test(test_caching.py): fix test_redis_cache_acompletion_stream 2024-03-25 21:36:47 -07:00
Krrish Dholakia
4d85387b5a test(test_azure_astreaming_and_function_calling): fix test to handle caching 2024-03-25 19:33:57 -07:00
Krrish Dholakia
1c55f2ccc5 fix(utils.py): persist system fingerprint across chunks 2024-03-25 19:24:09 -07:00
Krrish Dholakia
fa297b67ca fix(test_amazing_vertex_completion.py): fix test to check if content is none 2024-03-25 19:11:39 -07:00
Krish Dholakia
f702d49e00
Update README.md 2024-03-25 19:03:48 -07:00
Krrish Dholakia
bd75498913 fix(utils.py): log success event for streaming 2024-03-25 19:03:10 -07:00
Ishaan Jaff
ef93fcaa8e bump: version 1.34.2 → 1.34.3 2024-03-25 18:58:40 -07:00
Ishaan Jaff
ab8e264691
Merge pull request #2695 from BerriAI/litellm_fix_cache_controls
(test) Using Cache controls with litellm - `no-cache=True`
2024-03-25 18:58:05 -07:00
Ishaan Jaff
07fe08d8b5 (test) no cache hit 2024-03-25 18:56:36 -07:00
Ishaan Jaff
cf9b3bf462
Merge pull request #2694 from BerriAI/litellm_better_cache_debugging
[Fix] better cache debugging/error statements
2024-03-25 18:47:54 -07:00
Ishaan Jaff
08653aaf27
Merge pull request #2693 from BerriAI/litellm_batch_write_redis_cache
[FEAT] batch write redis cache
2024-03-25 18:47:24 -07:00