phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-26 19:24:27 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
20043 commits 2490 branches 894 tags 548 MiB
Commit graph

667 commits

Author SHA1 Message Date
Krish Dholakia
997ef2e480 Merge pull request #3507 from Manouchehri/oidc-3505-part-1 
Initial OIDC support (Google/GitHub/CircleCI -> Amazon Bedrock & Azure OpenAI)
 2024-05-11 09:25:17 -07:00
Krish Dholakia
1510f3a37a Merge pull request #3576 from BerriAI/litellm_langfuse_fix 
fix(langfuse.py): fix logging user_id in trace param on new trace creation
 2024-05-10 19:27:34 -07:00
Krrish Dholakia
3a98b6b8df fix(langfuse.py): fix logging user_id in trace param on new trace creation 
Closes https://github.com/BerriAI/litellm/issues/3560
 2024-05-10 18:25:07 -07:00
Ishaan Jaff
58acc76352 fix auto inferring region 2024-05-10 16:08:05 -07:00
Ishaan Jaff
2848c0ff2b fix AUTO_INFER_REGION 2024-05-10 14:08:38 -07:00
Ishaan Jaff
4faaf30fe1 fix bug upsert_deployment 2024-05-10 13:54:52 -07:00
Ishaan Jaff
70e37877c2 fix - upsert_deployment logic 2024-05-10 13:41:51 -07:00
Ishaan Jaff
99fd2228ba fix feature flag logic 2024-05-10 12:50:46 -07:00
Ishaan Jaff
db22da0dbc fix - explain why behind feature flag 2024-05-10 12:39:19 -07:00
Ishaan Jaff
437af37f97 fix hide - _auto_infer_region behind a feature flag 2024-05-10 12:38:06 -07:00
Ishaan Jaff
4244bb8a57 fix - router add model logic 2024-05-10 12:32:16 -07:00
Krrish Dholakia
62ba6f20f1 test(test_router_fallbacks.py): fix test 2024-05-10 09:58:40 -07:00
Krrish Dholakia
0ea8222508 feat(router.py): enable filtering model group by 'allowed_model_region' 2024-05-08 22:10:17 -07:00
Ishaan Jaff
051f20ca4b feat - send alert on cooling down a deploymeny 2024-05-08 14:14:14 -07:00
David Manouchehri
5d62f8ee6c fix(router.py): Add missing azure_ad_token param. 2024-05-08 15:47:46 +00:00
Krish Dholakia
1eb75273cf Merge branch 'main' into litellm_ui_fixes_6 2024-05-07 22:01:04 -07:00
Krrish Dholakia
ae442f895b feat(ui/model_dashboard.tsx): show if model is config or db model 2024-05-07 21:34:18 -07:00
Krrish Dholakia
b9ec7acb08 feat(model_dashboard.tsx): allow user to edit input cost per token for model on ui 
also contains fixes for `/model/update`
 2024-05-07 20:57:21 -07:00
Krrish Dholakia
1882ee1c4c feat(ui/model_dashboard.tsx): show if model is config or db model 2024-05-07 18:29:14 -07:00
Ishaan Jaff
0bdf31c4f3 router- initialize alerting 2024-05-07 18:03:04 -07:00
Ishaan Jaff
3bc0b998b2 feat - make lowest_cost pure async 2024-05-07 13:51:50 -07:00
David Manouchehri
5205d3913e fix+feat(router.py): Fix missing azure_ad_token, and allow use OIDC auth 2024-05-07 20:01:40 +00:00
Ishaan Jaff
a7f79774bc fix - use cost-based-routing 2024-05-07 12:48:53 -07:00
Ishaan Jaff
e8ce014e3d feat add lowest cost router 2024-05-07 12:12:39 -07:00
Krish Dholakia
185581d5a9 Merge branch 'main' into litellm_slack_daily_reports 2024-05-06 19:31:20 -07:00
Krrish Dholakia
0c1fc34e9f feat(slack_alerting.py): support sending daily reports on deployments 
allow admin to easily know slow + failing deployments

Closes  https://github.com/BerriAI/litellm/issues/3483
 2024-05-06 17:18:42 -07:00
Ishaan Jaff
cc83d8ec1a fix retry policy 2024-05-06 16:43:42 -07:00
Ishaan Jaff
a1e53247ee Merge pull request #3461 from BerriAI/litellm_set_router_retry_policy_ui 
[UI] Set Router Retry Policy
 2024-05-06 16:36:09 -07:00
Krrish Dholakia
9f930f3cd8 fix(router.py): fix router retry policy logic 2024-05-04 23:02:50 -07:00
Ishaan Jaff
5d1d6f2a44 get correct settings on router 2024-05-04 21:51:25 -07:00
Ishaan Jaff
4f019abe53 fix python 3.8 install 2024-05-04 21:00:39 -07:00
Ishaan Jaff
3bdb981782 fix - python 3.8 error 2024-05-04 20:44:40 -07:00
Ishaan Jaff
040bf1f15e Merge pull request #3460 from BerriAI/litellm_use_retry_policy_per_mg 
[Feat] Set a Retry Policy per model group
 2024-05-04 20:42:40 -07:00
Ishaan Jaff
8d59f6f724 feat - set retry policy per model group 2024-05-04 20:39:51 -07:00
Ishaan Jaff
909e8470a7 fix - undo local dev changes 2024-05-04 19:11:57 -07:00
Ishaan Jaff
653d0cf512 fix return num retries in exceptions 2024-05-04 19:09:34 -07:00
Ishaan Jaff
433333400f support dynamic retry policies 2024-05-04 18:10:15 -07:00
Ishaan Jaff
b8f8b6c31b fix router test 2024-05-04 17:58:54 -07:00
Ishaan Jaff
f2a537d143 router - use retry policy 2024-05-04 17:04:51 -07:00
Krrish Dholakia
7715a9d333 fix(bedrock.py): convert httpx.timeout to boto3 valid timeout 
Closes https://github.com/BerriAI/litellm/issues/3398
 2024-05-03 16:24:21 -07:00
Ishaan Jaff
c1d156ecf8 fix update router logic 2024-05-03 08:48:11 -07:00
Krrish Dholakia
b22c604c8c feat(router.py): add 'get_model_info' helper function to get the model info for a specific model, based on it's id 2024-05-02 17:53:09 -07:00
Krrish Dholakia
c09097d108 fix(router.py): fix update routing strategy 2024-05-01 09:51:11 -07:00
Krish Dholakia
ec3e35730b Merge pull request #3376 from BerriAI/litellm_routing_logic 
fix(router.py): unify retry timeout logic across sync + async function_with_retries
 2024-04-30 19:58:45 -07:00
Krrish Dholakia
b4ec16fd5f fix(test_router_fallbacks.py): fix tests 2024-04-30 18:48:39 -07:00
Krrish Dholakia
a12878b0f8 fix(router.py): cooldown deployments, for 401 errors 2024-04-30 17:54:00 -07:00
Krish Dholakia
6e84e2080d Merge pull request #3370 from BerriAI/litellm_latency_buffer 
fix(lowest_latency.py): allow setting a buffer for getting values within a certain latency threshold
 2024-04-30 16:01:47 -07:00
Krrish Dholakia
3a901fc343 fix(router.py): return routing args as dict 2024-04-30 15:39:14 -07:00
Krrish Dholakia
b93d1381c6 fix(router.py): fix linting issue 2024-04-30 15:35:16 -07:00
Krrish Dholakia
66c5b5b9dd fix(router.py): only check /v1 for azure ai studio models 
Fixes https://github.com/BerriAI/litellm/issues/3346
 2024-04-30 15:29:50 -07:00