681 commits

Author	SHA1	Message	Date
Ishaan Jaff	61a3e5d5a9	fix get healthy deployments	2024-05-11 19:46:35 -07:00
Ishaan Jaff	7930653872	fix - test router fallbacks	2024-05-11 19:13:22 -07:00
Ishaan Jaff	4d648a6d89	fix - _time_to_sleep_before_retry	2024-05-11 19:08:10 -07:00
Ishaan Jaff	a978326c99	unify sync and async logic for retries	2024-05-11 18:17:04 -07:00
Ishaan Jaff	6e39760779	fix _time_to_sleep_before_retry	2024-05-11 18:05:12 -07:00
Ishaan Jaff	3e6097d9f8	fix _time_to_sleep_before_retry logic	2024-05-11 18:00:02 -07:00
Ishaan Jaff	104fd4d048	router - clean up should_retry_this_error	2024-05-11 17:30:21 -07:00
Ishaan Jaff	18c2da213a	retry logic on router	2024-05-11 17:04:19 -07:00
Krrish Dholakia	49ab1a1d3f	fix(bedrock_httpx.py): working async bedrock command r calls	2024-05-11 16:45:20 -07:00
Ishaan Jaff	bf909a89f8	Merge pull request #3585 from BerriAI/litellm_router_batch_comp ... [Litellm Proxy + litellm.Router] - Pass the same message/prompt to N models	2024-05-11 13:51:45 -07:00
Ishaan Jaff	9156b7448a	feat - router async batch acompletion	2024-05-11 13:08:16 -07:00
Krish Dholakia	86d0c0ae4e	Merge pull request #3582 from BerriAI/litellm_explicit_region_name_setting ... feat(router.py): allow setting model_region in litellm_params	2024-05-11 11:36:22 -07:00
Krrish Dholakia	6714854bb7	feat(router.py): support region routing for bedrock, vertex ai, watsonx	2024-05-11 11:04:00 -07:00
Krrish Dholakia	ebc927f1c8	feat(router.py): allow setting model_region in litellm_params ... Closes https://github.com/BerriAI/litellm/issues/3580	2024-05-11 10:18:08 -07:00
Krish Dholakia	40063798bd	Merge pull request #3507 from Manouchehri/oidc-3505-part-1 ... Initial OIDC support (Google/GitHub/CircleCI -> Amazon Bedrock & Azure OpenAI)	2024-05-11 09:25:17 -07:00
Krish Dholakia	363cdb1a0c	Merge pull request #3576 from BerriAI/litellm_langfuse_fix ... fix(langfuse.py): fix logging user_id in trace param on new trace creation	2024-05-10 19:27:34 -07:00
Krrish Dholakia	0115c79222	fix(langfuse.py): fix logging user_id in trace param on new trace creation ... Closes https://github.com/BerriAI/litellm/issues/3560	2024-05-10 18:25:07 -07:00
Ishaan Jaff	7d96272d52	fix auto inferring region	2024-05-10 16:08:05 -07:00
Ishaan Jaff	c744851d13	fix AUTO_INFER_REGION	2024-05-10 14:08:38 -07:00
Ishaan Jaff	9bbb13c373	fix bug upsert_deployment	2024-05-10 13:54:52 -07:00
Ishaan Jaff	5c69515a13	fix - upsert_deployment logic	2024-05-10 13:41:51 -07:00
Ishaan Jaff	547976448f	fix feature flag logic	2024-05-10 12:50:46 -07:00
Ishaan Jaff	75d6658bbc	fix - explain why behind feature flag	2024-05-10 12:39:19 -07:00
Ishaan Jaff	6fd6490d63	fix hide - _auto_infer_region behind a feature flag	2024-05-10 12:38:06 -07:00
Ishaan Jaff	9d3f01c6ae	fix - router add model logic	2024-05-10 12:32:16 -07:00
Krrish Dholakia	cdec7a414f	test(test_router_fallbacks.py): fix test	2024-05-10 09:58:40 -07:00
Krrish Dholakia	3d18897d69	feat(router.py): enable filtering model group by 'allowed_model_region'	2024-05-08 22:10:17 -07:00
Ishaan Jaff	597b09598c	feat - send alert on cooling down a deploymeny	2024-05-08 14:14:14 -07:00
David Manouchehri	77b3acb396	fix(router.py): Add missing azure_ad_token param.	2024-05-08 15:47:46 +00:00
Krish Dholakia	0e709fdc21	Merge branch 'main' into litellm_ui_fixes_6	2024-05-07 22:01:04 -07:00
Krrish Dholakia	fbcda918de	feat(ui/model_dashboard.tsx): show if model is config or db model	2024-05-07 21:34:18 -07:00
Krrish Dholakia	5a16bec6a1	feat(model_dashboard.tsx): allow user to edit input cost per token for model on ui ... also contains fixes for `/model/update`	2024-05-07 20:57:21 -07:00
Krrish Dholakia	312249ca44	feat(ui/model_dashboard.tsx): show if model is config or db model	2024-05-07 18:29:14 -07:00
Ishaan Jaff	c08352a0ce	router- initialize alerting	2024-05-07 18:03:04 -07:00
Ishaan Jaff	6983e7a84f	feat - make lowest_cost pure async	2024-05-07 13:51:50 -07:00
David Manouchehri	9a0bb36865	fix+feat(router.py): Fix missing azure_ad_token, and allow use OIDC auth	2024-05-07 20:01:40 +00:00
Ishaan Jaff	6cb059cce8	fix - use cost-based-routing	2024-05-07 12:48:53 -07:00
Ishaan Jaff	1ba4440096	feat add lowest cost router	2024-05-07 12:12:39 -07:00
Krish Dholakia	aa62d891a0	Merge branch 'main' into litellm_slack_daily_reports	2024-05-06 19:31:20 -07:00
Krrish Dholakia	718f423d7d	feat(slack_alerting.py): support sending daily reports on deployments ... allow admin to easily know slow + failing deployments Closes https://github.com/BerriAI/litellm/issues/3483	2024-05-06 17:18:42 -07:00
Ishaan Jaff	040dc1f23e	fix retry policy	2024-05-06 16:43:42 -07:00
Ishaan Jaff	1725b7a9e1	Merge pull request #3461 from BerriAI/litellm_set_router_retry_policy_ui ... [UI] Set Router Retry Policy	2024-05-06 16:36:09 -07:00
Krrish Dholakia	e95be13f10	fix(router.py): fix router retry policy logic	2024-05-04 23:02:50 -07:00
Ishaan Jaff	3175be6303	get correct settings on router	2024-05-04 21:51:25 -07:00
Ishaan Jaff	157b2b3a06	fix python 3.8 install	2024-05-04 21:00:39 -07:00
Ishaan Jaff	4dcb4b81f1	fix - python 3.8 error	2024-05-04 20:44:40 -07:00
Ishaan Jaff	713e04848d	Merge pull request #3460 from BerriAI/litellm_use_retry_policy_per_mg ... [Feat] Set a Retry Policy per model group	2024-05-04 20:42:40 -07:00
Ishaan Jaff	90ac1e3fd9	feat - set retry policy per model group	2024-05-04 20:39:51 -07:00
Ishaan Jaff	dfc22194b2	fix - undo local dev changes	2024-05-04 19:11:57 -07:00
Ishaan Jaff	6b59aeb603	fix return num retries in exceptions	2024-05-04 19:09:34 -07:00