phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-26 11:14:04 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
13180 commits 2484 branches 894 tags 537 MiB
Commit graph

460 commits

Author SHA1 Message Date
Ishaan Jaff
99fd2228ba fix feature flag logic 2024-05-10 12:50:46 -07:00
Ishaan Jaff
db22da0dbc fix - explain why behind feature flag 2024-05-10 12:39:19 -07:00
Ishaan Jaff
437af37f97 fix hide - _auto_infer_region behind a feature flag 2024-05-10 12:38:06 -07:00
Ishaan Jaff
4244bb8a57 fix - router add model logic 2024-05-10 12:32:16 -07:00
Krrish Dholakia
62ba6f20f1 test(test_router_fallbacks.py): fix test 2024-05-10 09:58:40 -07:00
Krrish Dholakia
0ea8222508 feat(router.py): enable filtering model group by 'allowed_model_region' 2024-05-08 22:10:17 -07:00
Ishaan Jaff
051f20ca4b feat - send alert on cooling down a deploymeny 2024-05-08 14:14:14 -07:00
David Manouchehri
5d62f8ee6c fix(router.py): Add missing azure_ad_token param. 2024-05-08 15:47:46 +00:00
Krish Dholakia
1eb75273cf Merge branch 'main' into litellm_ui_fixes_6 2024-05-07 22:01:04 -07:00
Krrish Dholakia
ae442f895b feat(ui/model_dashboard.tsx): show if model is config or db model 2024-05-07 21:34:18 -07:00
Krrish Dholakia
b9ec7acb08 feat(model_dashboard.tsx): allow user to edit input cost per token for model on ui 
also contains fixes for `/model/update`
 2024-05-07 20:57:21 -07:00
Krrish Dholakia
1882ee1c4c feat(ui/model_dashboard.tsx): show if model is config or db model 2024-05-07 18:29:14 -07:00
Ishaan Jaff
0bdf31c4f3 router- initialize alerting 2024-05-07 18:03:04 -07:00
Ishaan Jaff
3bc0b998b2 feat - make lowest_cost pure async 2024-05-07 13:51:50 -07:00
David Manouchehri
5205d3913e fix+feat(router.py): Fix missing azure_ad_token, and allow use OIDC auth 2024-05-07 20:01:40 +00:00
Ishaan Jaff
a7f79774bc fix - use cost-based-routing 2024-05-07 12:48:53 -07:00
Ishaan Jaff
e8ce014e3d feat add lowest cost router 2024-05-07 12:12:39 -07:00
Krish Dholakia
185581d5a9 Merge branch 'main' into litellm_slack_daily_reports 2024-05-06 19:31:20 -07:00
Krrish Dholakia
0c1fc34e9f feat(slack_alerting.py): support sending daily reports on deployments 
allow admin to easily know slow + failing deployments

Closes  https://github.com/BerriAI/litellm/issues/3483
 2024-05-06 17:18:42 -07:00
Ishaan Jaff
cc83d8ec1a fix retry policy 2024-05-06 16:43:42 -07:00
Ishaan Jaff
a1e53247ee Merge pull request #3461 from BerriAI/litellm_set_router_retry_policy_ui 
[UI] Set Router Retry Policy
 2024-05-06 16:36:09 -07:00
Krrish Dholakia
9f930f3cd8 fix(router.py): fix router retry policy logic 2024-05-04 23:02:50 -07:00
Ishaan Jaff
5d1d6f2a44 get correct settings on router 2024-05-04 21:51:25 -07:00
Ishaan Jaff
4f019abe53 fix python 3.8 install 2024-05-04 21:00:39 -07:00
Ishaan Jaff
3bdb981782 fix - python 3.8 error 2024-05-04 20:44:40 -07:00
Ishaan Jaff
040bf1f15e Merge pull request #3460 from BerriAI/litellm_use_retry_policy_per_mg 
[Feat] Set a Retry Policy per model group
 2024-05-04 20:42:40 -07:00
Ishaan Jaff
8d59f6f724 feat - set retry policy per model group 2024-05-04 20:39:51 -07:00
Ishaan Jaff
909e8470a7 fix - undo local dev changes 2024-05-04 19:11:57 -07:00
Ishaan Jaff
653d0cf512 fix return num retries in exceptions 2024-05-04 19:09:34 -07:00
Ishaan Jaff
433333400f support dynamic retry policies 2024-05-04 18:10:15 -07:00
Ishaan Jaff
b8f8b6c31b fix router test 2024-05-04 17:58:54 -07:00
Ishaan Jaff
f2a537d143 router - use retry policy 2024-05-04 17:04:51 -07:00
Krrish Dholakia
7715a9d333 fix(bedrock.py): convert httpx.timeout to boto3 valid timeout 
Closes https://github.com/BerriAI/litellm/issues/3398
 2024-05-03 16:24:21 -07:00
Ishaan Jaff
c1d156ecf8 fix update router logic 2024-05-03 08:48:11 -07:00
Krrish Dholakia
b22c604c8c feat(router.py): add 'get_model_info' helper function to get the model info for a specific model, based on it's id 2024-05-02 17:53:09 -07:00
Krrish Dholakia
c09097d108 fix(router.py): fix update routing strategy 2024-05-01 09:51:11 -07:00
Krish Dholakia
ec3e35730b Merge pull request #3376 from BerriAI/litellm_routing_logic 
fix(router.py): unify retry timeout logic across sync + async function_with_retries
 2024-04-30 19:58:45 -07:00
Krrish Dholakia
b4ec16fd5f fix(test_router_fallbacks.py): fix tests 2024-04-30 18:48:39 -07:00
Krrish Dholakia
a12878b0f8 fix(router.py): cooldown deployments, for 401 errors 2024-04-30 17:54:00 -07:00
Krish Dholakia
6e84e2080d Merge pull request #3370 from BerriAI/litellm_latency_buffer 
fix(lowest_latency.py): allow setting a buffer for getting values within a certain latency threshold
 2024-04-30 16:01:47 -07:00
Krrish Dholakia
3a901fc343 fix(router.py): return routing args as dict 2024-04-30 15:39:14 -07:00
Krrish Dholakia
b93d1381c6 fix(router.py): fix linting issue 2024-04-30 15:35:16 -07:00
Krrish Dholakia
66c5b5b9dd fix(router.py): only check /v1 for azure ai studio models 
Fixes https://github.com/BerriAI/litellm/issues/3346
 2024-04-30 15:29:50 -07:00
Krrish Dholakia
17c3f110c1 fix(router.py): unify retry timeout logic across sync + async function_with_retries 2024-04-30 15:23:19 -07:00
Krrish Dholakia
92796d5422 build(ui): allow user to modify 'lowest_latency_buffer' on UI 2024-04-30 13:54:43 -07:00
Krrish Dholakia
eea8a37ec9 fix(router.py): raise better exception when no deployments are available 
Fixes https://github.com/BerriAI/litellm/issues/3355
 2024-04-29 18:48:04 -07:00
Krrish Dholakia
14f9a6f679 fix(router.py): fix high-traffic bug for usage-based-routing-v2 2024-04-29 16:48:01 -07:00
Krrish Dholakia
c39f8f3ef1 fix(lowest_tpm_rpm_v2.py): add more detail to 'No deployments available' error message 2024-04-29 15:04:37 -07:00
Krrish Dholakia
146e5d04ef test: fix test - set num_retries=0 2024-04-27 21:02:19 -07:00
Krrish Dholakia
e322b8a1f8 fix(router.py): fix trailing slash handling for api base which contains /v1 2024-04-27 17:36:28 -07:00