docs(routing.md): refactor docs to show how to use pre-call checks and fallback across model groups

This commit is contained in:
Krrish Dholakia 2024-04-01 11:21:27 -07:00
parent 52b1538b2e
commit a917fadf45
5 changed files with 274 additions and 137 deletions

View file

@ -2170,7 +2170,7 @@ class Router:
Filter out model in model group, if:
- model context window < message length
- function call and model doesn't support function calling
- [TODO] function call and model doesn't support function calling
"""
verbose_router_logger.debug(
f"Starting Pre-call checks for deployments in model={model}"