phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-25 18:54:30 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
13492 commits 2481 branches 894 tags 535 MiB
Commit graph

467 commits

Author SHA1 Message Date
Krish Dholakia
40063798bd
Merge pull request #3507 from Manouchehri/oidc-3505-part-1 
Initial OIDC support (Google/GitHub/CircleCI -> Amazon Bedrock & Azure OpenAI)
 2024-05-11 09:25:17 -07:00
Krish Dholakia
363cdb1a0c
Merge pull request #3576 from BerriAI/litellm_langfuse_fix 
fix(langfuse.py): fix logging user_id in trace param on new trace creation
 2024-05-10 19:27:34 -07:00
Krrish Dholakia
0115c79222 fix(langfuse.py): fix logging user_id in trace param on new trace creation 
Closes https://github.com/BerriAI/litellm/issues/3560
 2024-05-10 18:25:07 -07:00
Ishaan Jaff
7d96272d52 fix auto inferring region 2024-05-10 16:08:05 -07:00
Ishaan Jaff
c744851d13 fix AUTO_INFER_REGION 2024-05-10 14:08:38 -07:00
Ishaan Jaff
9bbb13c373 fix bug upsert_deployment 2024-05-10 13:54:52 -07:00
Ishaan Jaff
5c69515a13 fix - upsert_deployment logic 2024-05-10 13:41:51 -07:00
Ishaan Jaff
547976448f fix feature flag logic 2024-05-10 12:50:46 -07:00
Ishaan Jaff
75d6658bbc fix - explain why behind feature flag 2024-05-10 12:39:19 -07:00
Ishaan Jaff
6fd6490d63 fix hide - _auto_infer_region behind a feature flag 2024-05-10 12:38:06 -07:00
Ishaan Jaff
9d3f01c6ae fix - router add model logic 2024-05-10 12:32:16 -07:00
Krrish Dholakia
cdec7a414f test(test_router_fallbacks.py): fix test 2024-05-10 09:58:40 -07:00
Krrish Dholakia
3d18897d69 feat(router.py): enable filtering model group by 'allowed_model_region' 2024-05-08 22:10:17 -07:00
Ishaan Jaff
597b09598c feat - send alert on cooling down a deploymeny 2024-05-08 14:14:14 -07:00
David Manouchehri
77b3acb396
fix(router.py): Add missing azure_ad_token param. 2024-05-08 15:47:46 +00:00
Krish Dholakia
0e709fdc21
Merge branch 'main' into litellm_ui_fixes_6 2024-05-07 22:01:04 -07:00
Krrish Dholakia
fbcda918de feat(ui/model_dashboard.tsx): show if model is config or db model 2024-05-07 21:34:18 -07:00
Krrish Dholakia
5a16bec6a1 feat(model_dashboard.tsx): allow user to edit input cost per token for model on ui 
also contains fixes for `/model/update`
 2024-05-07 20:57:21 -07:00
Krrish Dholakia
312249ca44 feat(ui/model_dashboard.tsx): show if model is config or db model 2024-05-07 18:29:14 -07:00
Ishaan Jaff
c08352a0ce router- initialize alerting 2024-05-07 18:03:04 -07:00
Ishaan Jaff
6983e7a84f feat - make lowest_cost pure async 2024-05-07 13:51:50 -07:00
David Manouchehri
9a0bb36865
fix+feat(router.py): Fix missing azure_ad_token, and allow use OIDC auth 2024-05-07 20:01:40 +00:00
Ishaan Jaff
6cb059cce8 fix - use cost-based-routing 2024-05-07 12:48:53 -07:00
Ishaan Jaff
1ba4440096 feat add lowest cost router 2024-05-07 12:12:39 -07:00
Krish Dholakia
aa62d891a0
Merge branch 'main' into litellm_slack_daily_reports 2024-05-06 19:31:20 -07:00
Krrish Dholakia
718f423d7d feat(slack_alerting.py): support sending daily reports on deployments 
allow admin to easily know slow + failing deployments

Closes  https://github.com/BerriAI/litellm/issues/3483
 2024-05-06 17:18:42 -07:00
Ishaan Jaff
040dc1f23e fix retry policy 2024-05-06 16:43:42 -07:00
Ishaan Jaff
1725b7a9e1
Merge pull request #3461 from BerriAI/litellm_set_router_retry_policy_ui 
[UI] Set Router Retry Policy
 2024-05-06 16:36:09 -07:00
Krrish Dholakia
e95be13f10 fix(router.py): fix router retry policy logic 2024-05-04 23:02:50 -07:00
Ishaan Jaff
3175be6303 get correct settings on router 2024-05-04 21:51:25 -07:00
Ishaan Jaff
157b2b3a06 fix python 3.8 install 2024-05-04 21:00:39 -07:00
Ishaan Jaff
4dcb4b81f1 fix - python 3.8 error 2024-05-04 20:44:40 -07:00
Ishaan Jaff
713e04848d
Merge pull request #3460 from BerriAI/litellm_use_retry_policy_per_mg 
[Feat] Set a Retry Policy per model group
 2024-05-04 20:42:40 -07:00
Ishaan Jaff
90ac1e3fd9 feat - set retry policy per model group 2024-05-04 20:39:51 -07:00
Ishaan Jaff
dfc22194b2 fix - undo local dev changes 2024-05-04 19:11:57 -07:00
Ishaan Jaff
6b59aeb603 fix return num retries in exceptions 2024-05-04 19:09:34 -07:00
Ishaan Jaff
009f7c9bfc support dynamic retry policies 2024-05-04 18:10:15 -07:00
Ishaan Jaff
f70ae68188 fix router test 2024-05-04 17:58:54 -07:00
Ishaan Jaff
5d17c814a3 router - use retry policy 2024-05-04 17:04:51 -07:00
Krrish Dholakia
a732d8772a fix(bedrock.py): convert httpx.timeout to boto3 valid timeout 
Closes https://github.com/BerriAI/litellm/issues/3398
 2024-05-03 16:24:21 -07:00
Ishaan Jaff
540a35ed5e fix update router logic 2024-05-03 08:48:11 -07:00
Krrish Dholakia
91971fa9e0 feat(router.py): add 'get_model_info' helper function to get the model info for a specific model, based on it's id 2024-05-02 17:53:09 -07:00
Krrish Dholakia
1ad67a0d75 fix(router.py): fix update routing strategy 2024-05-01 09:51:11 -07:00
Krish Dholakia
9f55a99e98
Merge pull request #3376 from BerriAI/litellm_routing_logic 
fix(router.py): unify retry timeout logic across sync + async function_with_retries
 2024-04-30 19:58:45 -07:00
Krrish Dholakia
bc5c9d7da9 fix(test_router_fallbacks.py): fix tests 2024-04-30 18:48:39 -07:00
Krrish Dholakia
1baad80c7d fix(router.py): cooldown deployments, for 401 errors 2024-04-30 17:54:00 -07:00
Krish Dholakia
ce9ede6110
Merge pull request #3370 from BerriAI/litellm_latency_buffer 
fix(lowest_latency.py): allow setting a buffer for getting values within a certain latency threshold
 2024-04-30 16:01:47 -07:00
Krrish Dholakia
0267069c6a fix(router.py): return routing args as dict 2024-04-30 15:39:14 -07:00
Krrish Dholakia
668a5353ee fix(router.py): fix linting issue 2024-04-30 15:35:16 -07:00
Krrish Dholakia
6a2b4bcab8 fix(router.py): only check /v1 for azure ai studio models 
Fixes https://github.com/BerriAI/litellm/issues/3346
 2024-04-30 15:29:50 -07:00