phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-25 10:44:24 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
21569 commits 2480 branches 894 tags 534 MiB
Commit graph

692 commits

Author SHA1 Message Date
Krrish Dholakia
718f423d7d feat(slack_alerting.py): support sending daily reports on deployments 
allow admin to easily know slow + failing deployments

Closes  https://github.com/BerriAI/litellm/issues/3483
 2024-05-06 17:18:42 -07:00
Ishaan Jaff
040dc1f23e fix retry policy 2024-05-06 16:43:42 -07:00
Ishaan Jaff
1725b7a9e1
Merge pull request #3461 from BerriAI/litellm_set_router_retry_policy_ui 
[UI] Set Router Retry Policy
 2024-05-06 16:36:09 -07:00
Krrish Dholakia
e95be13f10 fix(router.py): fix router retry policy logic 2024-05-04 23:02:50 -07:00
Ishaan Jaff
3175be6303 get correct settings on router 2024-05-04 21:51:25 -07:00
Ishaan Jaff
157b2b3a06 fix python 3.8 install 2024-05-04 21:00:39 -07:00
Ishaan Jaff
4dcb4b81f1 fix - python 3.8 error 2024-05-04 20:44:40 -07:00
Ishaan Jaff
713e04848d
Merge pull request #3460 from BerriAI/litellm_use_retry_policy_per_mg 
[Feat] Set a Retry Policy per model group
 2024-05-04 20:42:40 -07:00
Ishaan Jaff
90ac1e3fd9 feat - set retry policy per model group 2024-05-04 20:39:51 -07:00
Ishaan Jaff
dfc22194b2 fix - undo local dev changes 2024-05-04 19:11:57 -07:00
Ishaan Jaff
6b59aeb603 fix return num retries in exceptions 2024-05-04 19:09:34 -07:00
Ishaan Jaff
009f7c9bfc support dynamic retry policies 2024-05-04 18:10:15 -07:00
Ishaan Jaff
f70ae68188 fix router test 2024-05-04 17:58:54 -07:00
Ishaan Jaff
5d17c814a3 router - use retry policy 2024-05-04 17:04:51 -07:00
Krrish Dholakia
a732d8772a fix(bedrock.py): convert httpx.timeout to boto3 valid timeout 
Closes https://github.com/BerriAI/litellm/issues/3398
 2024-05-03 16:24:21 -07:00
Ishaan Jaff
540a35ed5e fix update router logic 2024-05-03 08:48:11 -07:00
Krrish Dholakia
91971fa9e0 feat(router.py): add 'get_model_info' helper function to get the model info for a specific model, based on it's id 2024-05-02 17:53:09 -07:00
Krrish Dholakia
1ad67a0d75 fix(router.py): fix update routing strategy 2024-05-01 09:51:11 -07:00
Krish Dholakia
9f55a99e98
Merge pull request #3376 from BerriAI/litellm_routing_logic 
fix(router.py): unify retry timeout logic across sync + async function_with_retries
 2024-04-30 19:58:45 -07:00
Krrish Dholakia
bc5c9d7da9 fix(test_router_fallbacks.py): fix tests 2024-04-30 18:48:39 -07:00
Krrish Dholakia
1baad80c7d fix(router.py): cooldown deployments, for 401 errors 2024-04-30 17:54:00 -07:00
Krish Dholakia
ce9ede6110
Merge pull request #3370 from BerriAI/litellm_latency_buffer 
fix(lowest_latency.py): allow setting a buffer for getting values within a certain latency threshold
 2024-04-30 16:01:47 -07:00
Krrish Dholakia
0267069c6a fix(router.py): return routing args as dict 2024-04-30 15:39:14 -07:00
Krrish Dholakia
668a5353ee fix(router.py): fix linting issue 2024-04-30 15:35:16 -07:00
Krrish Dholakia
6a2b4bcab8 fix(router.py): only check /v1 for azure ai studio models 
Fixes https://github.com/BerriAI/litellm/issues/3346
 2024-04-30 15:29:50 -07:00
Krrish Dholakia
87ff26ff27 fix(router.py): unify retry timeout logic across sync + async function_with_retries 2024-04-30 15:23:19 -07:00
Krrish Dholakia
470dbf9745 build(ui): allow user to modify 'lowest_latency_buffer' on UI 2024-04-30 13:54:43 -07:00
Krrish Dholakia
f0e48cdd53 fix(router.py): raise better exception when no deployments are available 
Fixes https://github.com/BerriAI/litellm/issues/3355
 2024-04-29 18:48:04 -07:00
Krrish Dholakia
e7b4882e97 fix(router.py): fix high-traffic bug for usage-based-routing-v2 2024-04-29 16:48:01 -07:00
Krrish Dholakia
f10a066d36 fix(lowest_tpm_rpm_v2.py): add more detail to 'No deployments available' error message 2024-04-29 15:04:37 -07:00
Krrish Dholakia
b9c0b55e7c test: fix test - set num_retries=0 2024-04-27 21:02:19 -07:00
Krrish Dholakia
280148543f fix(router.py): fix trailing slash handling for api base which contains /v1 2024-04-27 17:36:28 -07:00
Krrish Dholakia
ec19c1654b fix(router.py): set initial value of default litellm params to none 2024-04-27 17:22:50 -07:00
Krrish Dholakia
87aad0d2c8 fix(router.py): fix router should retry logic 2024-04-27 15:59:38 -07:00
Krrish Dholakia
9f24421d44 fix(router.py): fix router should_retry 2024-04-27 15:13:20 -07:00
Krrish Dholakia
5e0bd5982e fix(router.py): fix sync should_retry logic 2024-04-27 14:48:07 -07:00
Krish Dholakia
1a06f009d1
Merge branch 'main' into litellm_default_router_retries 2024-04-27 11:21:57 -07:00
Krrish Dholakia
e05764bdb7 fix(router.py): add /v1/ if missing to base url, for openai-compatible api's 
Fixes https://github.com/BerriAI/litellm/issues/2279
 2024-04-26 17:05:07 -07:00
Krrish Dholakia
180718c33f fix(router.py): support verify_ssl flag 
Fixes https://github.com/BerriAI/litellm/issues/3162#issuecomment-2075273807
 2024-04-26 15:38:01 -07:00
Krrish Dholakia
160acc085a fix(router.py): fix default retry logic 2024-04-25 11:57:27 -07:00
Ishaan Jaff
4e707af592 Revert "fix(router.py): fix max retries on set_client" 
This reverts commit 821844c1a3.
 2024-04-24 23:19:14 -07:00
Krrish Dholakia
72dffdba39 fix(router.py): fix default retry on router 2024-04-24 23:06:53 -07:00
Krrish Dholakia
821844c1a3 fix(router.py): fix max retries on set_client 2024-04-24 22:03:01 -07:00
Ishaan Jaff
2c7f4695d9
Merge pull request #3283 from BerriAI/litellm_debug_lowest_latency 
[Fix] Add better observability for debugging lowest latency routing
 2024-04-24 20:42:52 -07:00
Ishaan Jaff
212369498e fix - set latency stats in kwargs 2024-04-24 20:13:45 -07:00
Krrish Dholakia
5650e8ea44 feat(router.py): support mock testing fallbacks flag 
allow user to test if fallbacks work as expected with a `mock_testing_fallbacks = True` flag set during a call
 2024-04-24 20:13:10 -07:00
Krrish Dholakia
94cbe5516e feat(router.py): support mock testing fallbacks flag on router 2024-04-24 17:33:00 -07:00
Krrish Dholakia
f54510b6ee fix(proxy_server.py): fix /config/update/ 
allows updating router config via UI and having the change be propogated across all proxy instances by persisting config changes to the db
 2024-04-24 16:42:42 -07:00
Krrish Dholakia
bae6f41017 build(add-fallbacks-on-UI): allows admin to add fallbacks on the UI 2024-04-24 15:40:02 -07:00
Ishaan Jaff
3d1a158b63 feat - update deployments 2024-04-24 09:53:42 -07:00