docs(routing.md): add pre-call checks to docs

This commit is contained in:
Krrish Dholakia 2024-03-23 19:10:34 -07:00
parent b7321ae4ee
commit e8e7964025
3 changed files with 94 additions and 4 deletions

View file

@ -301,7 +301,7 @@ def test_router_azure_acompletion():
def test_router_context_window_check():
"""
- Give a gpt-3.5-turbo model group with different context windows (4k vs. 16k)
- Send a 10k prompt
- Send a 5k prompt
- Assert it works
"""
from large_text import text