580 commits

Author	SHA1	Message	Date
Ishaan Jaff	8f2e61dccc	fix - test router fallbacks	2024-05-11 19:13:22 -07:00
Ishaan Jaff	ffdf68d7e8	fix - _time_to_sleep_before_retry	2024-05-11 19:08:10 -07:00
Ishaan Jaff	a3b4074c22	unify sync and async logic for retries	2024-05-11 18:17:04 -07:00
Ishaan Jaff	04bb2bf9f2	fix _time_to_sleep_before_retry	2024-05-11 18:05:12 -07:00
Ishaan Jaff	c57ddf0537	fix _time_to_sleep_before_retry logic	2024-05-11 18:00:02 -07:00
Ishaan Jaff	9ca793fffd	router - clean up should_retry_this_error	2024-05-11 17:30:21 -07:00
Ishaan Jaff	6a967b3267	retry logic on router	2024-05-11 17:04:19 -07:00
Krrish Dholakia	bd0c3a81cb	fix(bedrock_httpx.py): working async bedrock command r calls	2024-05-11 16:45:20 -07:00
Ishaan Jaff	b71f35de72	Merge pull request #3585 from BerriAI/litellm_router_batch_comp ... [Litellm Proxy + litellm.Router] - Pass the same message/prompt to N models	2024-05-11 13:51:45 -07:00
Ishaan Jaff	6704b32e44	feat - router async batch acompletion	2024-05-11 13:08:16 -07:00
Krish Dholakia	7f64c61275	Merge pull request #3582 from BerriAI/litellm_explicit_region_name_setting ... feat(router.py): allow setting model_region in litellm_params	2024-05-11 11:36:22 -07:00
Krrish Dholakia	691c185ff8	feat(router.py): support region routing for bedrock, vertex ai, watsonx	2024-05-11 11:04:00 -07:00
Krrish Dholakia	2ed155b4d4	feat(router.py): allow setting model_region in litellm_params ... Closes https://github.com/BerriAI/litellm/issues/3580	2024-05-11 10:18:08 -07:00
Krish Dholakia	997ef2e480	Merge pull request #3507 from Manouchehri/oidc-3505-part-1 ... Initial OIDC support (Google/GitHub/CircleCI -> Amazon Bedrock & Azure OpenAI)	2024-05-11 09:25:17 -07:00
Krish Dholakia	1510f3a37a	Merge pull request #3576 from BerriAI/litellm_langfuse_fix ... fix(langfuse.py): fix logging user_id in trace param on new trace creation	2024-05-10 19:27:34 -07:00
Krrish Dholakia	3a98b6b8df	fix(langfuse.py): fix logging user_id in trace param on new trace creation ... Closes https://github.com/BerriAI/litellm/issues/3560	2024-05-10 18:25:07 -07:00
Ishaan Jaff	58acc76352	fix auto inferring region	2024-05-10 16:08:05 -07:00
Ishaan Jaff	2848c0ff2b	fix AUTO_INFER_REGION	2024-05-10 14:08:38 -07:00
Ishaan Jaff	4faaf30fe1	fix bug upsert_deployment	2024-05-10 13:54:52 -07:00
Ishaan Jaff	70e37877c2	fix - upsert_deployment logic	2024-05-10 13:41:51 -07:00
Ishaan Jaff	99fd2228ba	fix feature flag logic	2024-05-10 12:50:46 -07:00
Ishaan Jaff	db22da0dbc	fix - explain why behind feature flag	2024-05-10 12:39:19 -07:00
Ishaan Jaff	437af37f97	fix hide - _auto_infer_region behind a feature flag	2024-05-10 12:38:06 -07:00
Ishaan Jaff	4244bb8a57	fix - router add model logic	2024-05-10 12:32:16 -07:00
Krrish Dholakia	62ba6f20f1	test(test_router_fallbacks.py): fix test	2024-05-10 09:58:40 -07:00
Krrish Dholakia	0ea8222508	feat(router.py): enable filtering model group by 'allowed_model_region'	2024-05-08 22:10:17 -07:00
Ishaan Jaff	051f20ca4b	feat - send alert on cooling down a deploymeny	2024-05-08 14:14:14 -07:00
David Manouchehri	5d62f8ee6c	fix(router.py): Add missing azure_ad_token param.	2024-05-08 15:47:46 +00:00
Krish Dholakia	1eb75273cf	Merge branch 'main' into litellm_ui_fixes_6	2024-05-07 22:01:04 -07:00
Krrish Dholakia	ae442f895b	feat(ui/model_dashboard.tsx): show if model is config or db model	2024-05-07 21:34:18 -07:00
Krrish Dholakia	b9ec7acb08	feat(model_dashboard.tsx): allow user to edit input cost per token for model on ui ... also contains fixes for `/model/update`	2024-05-07 20:57:21 -07:00
Krrish Dholakia	1882ee1c4c	feat(ui/model_dashboard.tsx): show if model is config or db model	2024-05-07 18:29:14 -07:00
Ishaan Jaff	0bdf31c4f3	router- initialize alerting	2024-05-07 18:03:04 -07:00
Ishaan Jaff	3bc0b998b2	feat - make lowest_cost pure async	2024-05-07 13:51:50 -07:00
David Manouchehri	5205d3913e	fix+feat(router.py): Fix missing azure_ad_token, and allow use OIDC auth	2024-05-07 20:01:40 +00:00
Ishaan Jaff	a7f79774bc	fix - use cost-based-routing	2024-05-07 12:48:53 -07:00
Ishaan Jaff	e8ce014e3d	feat add lowest cost router	2024-05-07 12:12:39 -07:00
Krish Dholakia	185581d5a9	Merge branch 'main' into litellm_slack_daily_reports	2024-05-06 19:31:20 -07:00
Krrish Dholakia	0c1fc34e9f	feat(slack_alerting.py): support sending daily reports on deployments ... allow admin to easily know slow + failing deployments Closes https://github.com/BerriAI/litellm/issues/3483	2024-05-06 17:18:42 -07:00
Ishaan Jaff	cc83d8ec1a	fix retry policy	2024-05-06 16:43:42 -07:00
Ishaan Jaff	a1e53247ee	Merge pull request #3461 from BerriAI/litellm_set_router_retry_policy_ui ... [UI] Set Router Retry Policy	2024-05-06 16:36:09 -07:00
Krrish Dholakia	9f930f3cd8	fix(router.py): fix router retry policy logic	2024-05-04 23:02:50 -07:00
Ishaan Jaff	5d1d6f2a44	get correct settings on router	2024-05-04 21:51:25 -07:00
Ishaan Jaff	4f019abe53	fix python 3.8 install	2024-05-04 21:00:39 -07:00
Ishaan Jaff	3bdb981782	fix - python 3.8 error	2024-05-04 20:44:40 -07:00
Ishaan Jaff	040bf1f15e	Merge pull request #3460 from BerriAI/litellm_use_retry_policy_per_mg ... [Feat] Set a Retry Policy per model group	2024-05-04 20:42:40 -07:00
Ishaan Jaff	8d59f6f724	feat - set retry policy per model group	2024-05-04 20:39:51 -07:00
Ishaan Jaff	909e8470a7	fix - undo local dev changes	2024-05-04 19:11:57 -07:00
Ishaan Jaff	653d0cf512	fix return num retries in exceptions	2024-05-04 19:09:34 -07:00
Ishaan Jaff	433333400f	support dynamic retry policies	2024-05-04 18:10:15 -07:00