docs(routing.md): add pre-call checks to docs

This commit is contained in:
Krrish Dholakia 2024-03-23 19:10:34 -07:00
parent 292cdd81e4
commit 8c6402b02d
3 changed files with 94 additions and 4 deletions

View file

@ -301,7 +301,7 @@ def test_router_azure_acompletion():
def test_router_context_window_check():
"""
- Give a gpt-3.5-turbo model group with different context windows (4k vs. 16k)
- Send a 10k prompt
- Send a 5k prompt
- Assert it works
"""
from large_text import text