Krrish Dholakia
cd7dd2a511
fix(cooldown_cache.py): fix linting errors
2024-08-27 07:40:28 -07:00
Krrish Dholakia
5572ad7241
fix(cooldown_cache.py): fix linting errors
2024-08-24 17:11:32 -07:00
Krrish Dholakia
33972cc79c
fix(router.py): enable dynamic retry after in exception string
...
Updates cooldown logic to cooldown individual models
Closes https://github.com/BerriAI/litellm/issues/1339
2024-08-24 16:59:30 -07:00
Ishaan Jaff
f13a65be2d
fix azure_ad_token_provider
2024-08-22 16:15:53 -07:00
Ishaan Jaff
08fa3f346a
add new litellm params for client_id, tenant_id etc
2024-08-22 11:37:30 -07:00
Ishaan Jaff
8f657b40f5
use azure_ad_token_provider to init clients
2024-08-22 11:03:49 -07:00
Ishaan Jaff
f6d97c25f2
fix run sync fallbacks
2024-08-20 12:55:36 -07:00
Ishaan Jaff
e4b5e88a57
fix fallbacks dont recurse on the same fallback
2024-08-20 12:50:20 -07:00
Marc Abramowitz
ac9aa1ab67
Use AZURE_API_VERSION as default azure openai version
...
Without this change, the default version of the Azure OpenAI API is hardcoded in
the code as an old version, `"2024-02-01"`. This change allows the user to set
the default version of the Azure OpenAI API by setting the environment variable
`AZURE_API_VERSION` or by using the command-line parameter `--api_version`.
2024-08-14 15:47:57 -07:00
Ishaan Jaff
2a54be4a43
feat - log fallbacks events on prometheus
2024-08-10 13:57:25 -07:00
Ishaan Jaff
45186718aa
v0 add event handlers for logging fallback events
2024-08-10 13:28:08 -07:00
Ishaan Jaff
0b9ad45790
refactor prom metrics
2024-08-09 09:02:23 -07:00
Ishaan Jaff
579f09b334
fix logging cool down deployment
2024-08-07 11:27:05 -07:00
Ishaan Jaff
d1e519afd1
use router_cooldown_handler
2024-08-07 10:40:55 -07:00
Ishaan Jaff
9a545c1ff8
Revert "[Ui] add together AI, Mistral, PerplexityAI, OpenRouter models on Admin UI "
2024-07-20 19:04:22 -07:00
Ishaan Jaff
3708355f91
router fix init openai compatible providers
2024-07-19 19:42:04 -07:00
Krrish Dholakia
0710c167ab
fix(client_initialization_utils.py): fix import logic
2024-07-06 19:28:38 -07:00
Krrish Dholakia
14ab1e5d2d
fix(client_initialization_utils.py): fix merge conflicts
2024-07-06 19:20:28 -07:00
Ishaan Jaff
984cc4722e
fix should_initialize_sync_client
2024-07-06 13:10:22 -07:00
Ishaan Jaff
2609de43d0
use helper for init client + check if we should init sync clients
2024-07-06 12:52:41 -07:00
Ishaan Jaff
2d2650a2b6
fix use safe access for router alerting
2024-06-14 15:17:32 -07:00
Ishaan Jaff
a0ecc6f414
fix - send alert on router level exceptions
2024-06-14 08:41:12 -07:00