22 commits

Author	SHA1	Message	Date
Krrish Dholakia	cd7dd2a511	fix(cooldown_cache.py): fix linting errors	2024-08-27 07:40:28 -07:00
Krrish Dholakia	5572ad7241	fix(cooldown_cache.py): fix linting errors	2024-08-24 17:11:32 -07:00
Krrish Dholakia	33972cc79c	fix(router.py): enable dynamic retry after in exception string ... Updates cooldown logic to cooldown individual models Closes https://github.com/BerriAI/litellm/issues/1339	2024-08-24 16:59:30 -07:00
Ishaan Jaff	f13a65be2d	fix azure_ad_token_provider	2024-08-22 16:15:53 -07:00
Ishaan Jaff	08fa3f346a	add new litellm params for client_id, tenant_id etc	2024-08-22 11:37:30 -07:00
Ishaan Jaff	8f657b40f5	use azure_ad_token_provider to init clients	2024-08-22 11:03:49 -07:00
Ishaan Jaff	f6d97c25f2	fix run sync fallbacks	2024-08-20 12:55:36 -07:00
Ishaan Jaff	e4b5e88a57	fix fallbacks dont recurse on the same fallback	2024-08-20 12:50:20 -07:00
Marc Abramowitz	ac9aa1ab67	Use AZURE_API_VERSION as default azure openai version ... Without this change, the default version of the Azure OpenAI API is hardcoded in the code as an old version, `"2024-02-01"`. This change allows the user to set the default version of the Azure OpenAI API by setting the environment variable `AZURE_API_VERSION` or by using the command-line parameter `--api_version`.	2024-08-14 15:47:57 -07:00
Ishaan Jaff	2a54be4a43	feat - log fallbacks events on prometheus	2024-08-10 13:57:25 -07:00
Ishaan Jaff	45186718aa	v0 add event handlers for logging fallback events	2024-08-10 13:28:08 -07:00
Ishaan Jaff	0b9ad45790	refactor prom metrics	2024-08-09 09:02:23 -07:00
Ishaan Jaff	579f09b334	fix logging cool down deployment	2024-08-07 11:27:05 -07:00
Ishaan Jaff	d1e519afd1	use router_cooldown_handler	2024-08-07 10:40:55 -07:00
Ishaan Jaff	9a545c1ff8	Revert "[Ui] add together AI, Mistral, PerplexityAI, OpenRouter models on Admin UI "	2024-07-20 19:04:22 -07:00
Ishaan Jaff	3708355f91	router fix init openai compatible providers	2024-07-19 19:42:04 -07:00
Krrish Dholakia	0710c167ab	fix(client_initialization_utils.py): fix import logic	2024-07-06 19:28:38 -07:00
Krrish Dholakia	14ab1e5d2d	fix(client_initialization_utils.py): fix merge conflicts	2024-07-06 19:20:28 -07:00
Ishaan Jaff	984cc4722e	fix should_initialize_sync_client	2024-07-06 13:10:22 -07:00
Ishaan Jaff	2609de43d0	use helper for init client + check if we should init sync clients	2024-07-06 12:52:41 -07:00
Ishaan Jaff	2d2650a2b6	fix use safe access for router alerting	2024-06-14 15:17:32 -07:00
Ishaan Jaff	a0ecc6f414	fix - send alert on router level exceptions	2024-06-14 08:41:12 -07:00