phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-25 18:54:30 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
19734 commits 2481 branches 894 tags 535 MiB
Commit graph

654 commits

Author SHA1 Message Date
Ishaan Jaff
597b09598c feat - send alert on cooling down a deploymeny 2024-05-08 14:14:14 -07:00
David Manouchehri
77b3acb396
fix(router.py): Add missing azure_ad_token param. 2024-05-08 15:47:46 +00:00
Krish Dholakia
0e709fdc21
Merge branch 'main' into litellm_ui_fixes_6 2024-05-07 22:01:04 -07:00
Krrish Dholakia
fbcda918de feat(ui/model_dashboard.tsx): show if model is config or db model 2024-05-07 21:34:18 -07:00
Krrish Dholakia
5a16bec6a1 feat(model_dashboard.tsx): allow user to edit input cost per token for model on ui 
also contains fixes for `/model/update`
 2024-05-07 20:57:21 -07:00
Krrish Dholakia
312249ca44 feat(ui/model_dashboard.tsx): show if model is config or db model 2024-05-07 18:29:14 -07:00
Ishaan Jaff
c08352a0ce router- initialize alerting 2024-05-07 18:03:04 -07:00
Ishaan Jaff
6983e7a84f feat - make lowest_cost pure async 2024-05-07 13:51:50 -07:00
David Manouchehri
9a0bb36865
fix+feat(router.py): Fix missing azure_ad_token, and allow use OIDC auth 2024-05-07 20:01:40 +00:00
Ishaan Jaff
6cb059cce8 fix - use cost-based-routing 2024-05-07 12:48:53 -07:00
Ishaan Jaff
1ba4440096 feat add lowest cost router 2024-05-07 12:12:39 -07:00
Krish Dholakia
aa62d891a0
Merge branch 'main' into litellm_slack_daily_reports 2024-05-06 19:31:20 -07:00
Krrish Dholakia
718f423d7d feat(slack_alerting.py): support sending daily reports on deployments 
allow admin to easily know slow + failing deployments

Closes  https://github.com/BerriAI/litellm/issues/3483
 2024-05-06 17:18:42 -07:00
Ishaan Jaff
040dc1f23e fix retry policy 2024-05-06 16:43:42 -07:00
Ishaan Jaff
1725b7a9e1
Merge pull request #3461 from BerriAI/litellm_set_router_retry_policy_ui 
[UI] Set Router Retry Policy
 2024-05-06 16:36:09 -07:00
Krrish Dholakia
e95be13f10 fix(router.py): fix router retry policy logic 2024-05-04 23:02:50 -07:00
Ishaan Jaff
3175be6303 get correct settings on router 2024-05-04 21:51:25 -07:00
Ishaan Jaff
157b2b3a06 fix python 3.8 install 2024-05-04 21:00:39 -07:00
Ishaan Jaff
4dcb4b81f1 fix - python 3.8 error 2024-05-04 20:44:40 -07:00
Ishaan Jaff
713e04848d
Merge pull request #3460 from BerriAI/litellm_use_retry_policy_per_mg 
[Feat] Set a Retry Policy per model group
 2024-05-04 20:42:40 -07:00
Ishaan Jaff
90ac1e3fd9 feat - set retry policy per model group 2024-05-04 20:39:51 -07:00
Ishaan Jaff
dfc22194b2 fix - undo local dev changes 2024-05-04 19:11:57 -07:00
Ishaan Jaff
6b59aeb603 fix return num retries in exceptions 2024-05-04 19:09:34 -07:00
Ishaan Jaff
009f7c9bfc support dynamic retry policies 2024-05-04 18:10:15 -07:00
Ishaan Jaff
f70ae68188 fix router test 2024-05-04 17:58:54 -07:00
Ishaan Jaff
5d17c814a3 router - use retry policy 2024-05-04 17:04:51 -07:00
Krrish Dholakia
a732d8772a fix(bedrock.py): convert httpx.timeout to boto3 valid timeout 
Closes https://github.com/BerriAI/litellm/issues/3398
 2024-05-03 16:24:21 -07:00
Ishaan Jaff
540a35ed5e fix update router logic 2024-05-03 08:48:11 -07:00
Krrish Dholakia
91971fa9e0 feat(router.py): add 'get_model_info' helper function to get the model info for a specific model, based on it's id 2024-05-02 17:53:09 -07:00
Krrish Dholakia
1ad67a0d75 fix(router.py): fix update routing strategy 2024-05-01 09:51:11 -07:00
Krish Dholakia
9f55a99e98
Merge pull request #3376 from BerriAI/litellm_routing_logic 
fix(router.py): unify retry timeout logic across sync + async function_with_retries
 2024-04-30 19:58:45 -07:00
Krrish Dholakia
bc5c9d7da9 fix(test_router_fallbacks.py): fix tests 2024-04-30 18:48:39 -07:00
Krrish Dholakia
1baad80c7d fix(router.py): cooldown deployments, for 401 errors 2024-04-30 17:54:00 -07:00
Krish Dholakia
ce9ede6110
Merge pull request #3370 from BerriAI/litellm_latency_buffer 
fix(lowest_latency.py): allow setting a buffer for getting values within a certain latency threshold
 2024-04-30 16:01:47 -07:00
Krrish Dholakia
0267069c6a fix(router.py): return routing args as dict 2024-04-30 15:39:14 -07:00
Krrish Dholakia
668a5353ee fix(router.py): fix linting issue 2024-04-30 15:35:16 -07:00
Krrish Dholakia
6a2b4bcab8 fix(router.py): only check /v1 for azure ai studio models 
Fixes https://github.com/BerriAI/litellm/issues/3346
 2024-04-30 15:29:50 -07:00
Krrish Dholakia
87ff26ff27 fix(router.py): unify retry timeout logic across sync + async function_with_retries 2024-04-30 15:23:19 -07:00
Krrish Dholakia
470dbf9745 build(ui): allow user to modify 'lowest_latency_buffer' on UI 2024-04-30 13:54:43 -07:00
Krrish Dholakia
f0e48cdd53 fix(router.py): raise better exception when no deployments are available 
Fixes https://github.com/BerriAI/litellm/issues/3355
 2024-04-29 18:48:04 -07:00
Krrish Dholakia
e7b4882e97 fix(router.py): fix high-traffic bug for usage-based-routing-v2 2024-04-29 16:48:01 -07:00
Krrish Dholakia
f10a066d36 fix(lowest_tpm_rpm_v2.py): add more detail to 'No deployments available' error message 2024-04-29 15:04:37 -07:00
Krrish Dholakia
b9c0b55e7c test: fix test - set num_retries=0 2024-04-27 21:02:19 -07:00
Krrish Dholakia
280148543f fix(router.py): fix trailing slash handling for api base which contains /v1 2024-04-27 17:36:28 -07:00
Krrish Dholakia
ec19c1654b fix(router.py): set initial value of default litellm params to none 2024-04-27 17:22:50 -07:00
Krrish Dholakia
87aad0d2c8 fix(router.py): fix router should retry logic 2024-04-27 15:59:38 -07:00
Krrish Dholakia
9f24421d44 fix(router.py): fix router should_retry 2024-04-27 15:13:20 -07:00
Krrish Dholakia
5e0bd5982e fix(router.py): fix sync should_retry logic 2024-04-27 14:48:07 -07:00
Krish Dholakia
1a06f009d1
Merge branch 'main' into litellm_default_router_retries 2024-04-27 11:21:57 -07:00
Krrish Dholakia
e05764bdb7 fix(router.py): add /v1/ if missing to base url, for openai-compatible api's 
Fixes https://github.com/BerriAI/litellm/issues/2279
 2024-04-26 17:05:07 -07:00