litellm-mirror/litellm/router_utils
Krish Dholakia e6bdec4eed Controll fallback prompts client-side (#7334)
* feat(router.py): support passing model-specific messages in fallbacks

* docs(routing.md): separate router timeouts into separate doc

allow for 1 fallbacks doc (across proxy/router)

* docs(routing.md): cleanup router docs

* docs(reliability.md): cleanup docs

* docs(reliability.md): cleaned up fallback doc

just have 1 doc across sdk/proxy

simplifies docs

* docs(reliability.md): add setting model-specific fallback prompts

* fix: fix linting errors

* test: skip test causing openai rate limit errros

* test: fix test

* test: run vertex test first to catch error
2024-12-20 19:09:53 -08:00
..
pre_call_checks Litellm dev readd prompt caching (#7299) 2024-12-18 15:13:49 -08:00
router_callbacks (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
batch_utils.py (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
client_initalization_utils.py (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
cooldown_cache.py (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
cooldown_callbacks.py Litellm dev readd prompt caching (#7299) 2024-12-18 15:13:49 -08:00
cooldown_handlers.py (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
fallback_event_handlers.py Controll fallback prompts client-side (#7334) 2024-12-20 19:09:53 -08:00
get_retry_from_policy.py Litellm dev 12 06 2024 (#7067) 2024-12-06 22:44:18 -08:00
handle_error.py (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
pattern_match_deployments.py (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
prompt_caching_cache.py (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
response_headers.py LiteLLM Minor Fixes & Improvements (11/26/2024) (#6913) 2024-11-28 00:01:38 +05:30