Commit graph

22 commits

Author SHA1 Message Date
Krrish Dholakia
7243e6c8ce fix(cooldown_cache.py): fix linting errors 2024-08-27 07:40:28 -07:00
Krrish Dholakia
4918082cd7 fix(cooldown_cache.py): fix linting errors 2024-08-24 17:11:32 -07:00
Krrish Dholakia
c795e9feeb fix(router.py): enable dynamic retry after in exception string
Updates cooldown logic to cooldown individual models

 Closes https://github.com/BerriAI/litellm/issues/1339
2024-08-24 16:59:30 -07:00
Ishaan Jaff
2203dad29e fix azure_ad_token_provider 2024-08-22 16:15:53 -07:00
Ishaan Jaff
b16752f0bc add new litellm params for client_id, tenant_id etc 2024-08-22 11:37:30 -07:00
Ishaan Jaff
525d152d85 use azure_ad_token_provider to init clients 2024-08-22 11:03:49 -07:00
Ishaan Jaff
165e0e3ad1 fix run sync fallbacks 2024-08-20 12:55:36 -07:00
Ishaan Jaff
078fe97053 fix fallbacks dont recurse on the same fallback 2024-08-20 12:50:20 -07:00
Marc Abramowitz
4e2e8101c6 Use AZURE_API_VERSION as default azure openai version
Without this change, the default version of the Azure OpenAI API is hardcoded in
the code as an old version, `"2024-02-01"`. This change allows the user to set
the default version of the Azure OpenAI API by setting the environment variable
`AZURE_API_VERSION` or by using the command-line parameter `--api_version`.
2024-08-14 15:47:57 -07:00
Ishaan Jaff
ada3ae670b feat - log fallbacks events on prometheus 2024-08-10 13:57:25 -07:00
Ishaan Jaff
5ccc358c2a v0 add event handlers for logging fallback events 2024-08-10 13:28:08 -07:00
Ishaan Jaff
408d17dfee refactor prom metrics 2024-08-09 09:02:23 -07:00
Ishaan Jaff
27e8a89077 fix logging cool down deployment 2024-08-07 11:27:05 -07:00
Ishaan Jaff
0dd8f50477 use router_cooldown_handler 2024-08-07 10:40:55 -07:00
Ishaan Jaff
037f737aa1 Revert "[Ui] add together AI, Mistral, PerplexityAI, OpenRouter models on Admin UI " 2024-07-20 19:04:22 -07:00
Ishaan Jaff
368e0109a4 router fix init openai compatible providers 2024-07-19 19:42:04 -07:00
Krrish Dholakia
8275e29030 fix(client_initialization_utils.py): fix import logic 2024-07-06 19:28:38 -07:00
Krrish Dholakia
71ea98d5ea fix(client_initialization_utils.py): fix merge conflicts 2024-07-06 19:20:28 -07:00
Ishaan Jaff
37312f08f2 fix should_initialize_sync_client 2024-07-06 13:10:22 -07:00
Ishaan Jaff
f6eccf84ce use helper for init client + check if we should init sync clients 2024-07-06 12:52:41 -07:00
Ishaan Jaff
fcbd496ed1 fix use safe access for router alerting 2024-06-14 15:17:32 -07:00
Ishaan Jaff
bd341c69b5 fix - send alert on router level exceptions 2024-06-14 08:41:12 -07:00