Commit graph

6 commits

Author SHA1 Message Date
Krrish Dholakia
32d1d64b63 refactor(lowest_latency.py): fix linting issue 2024-01-09 12:59:42 +05:30
Krrish Dholakia
832c10b402 feat(lowest_latency.py): support expanded time window for latency based routing
uses a 1hr avg. of latency for deployments, to determine which to route to

https://github.com/BerriAI/litellm/issues/1361
2024-01-09 12:59:42 +05:30
Krrish Dholakia
9dc2bc227b refactor(lowest_latency.py): fix linting error 2024-01-09 12:58:58 +05:30
Krrish Dholakia
9ddcdc4716 feat(lowest_latency.py): support expanded time window for latency based routing
uses a 1hr avg. of latency for deployments, to determine which to route to

https://github.com/BerriAI/litellm/issues/1361
2024-01-09 12:58:58 +05:30
Krrish Dholakia
027218c3f0 test(test_lowest_latency_routing.py): add more tests 2023-12-30 17:41:42 +05:30
Krrish Dholakia
f2d0d5584a fix(router.py): fix latency based routing 2023-12-30 17:25:40 +05:30