Krrish Dholakia
|
32d1d64b63
|
refactor(lowest_latency.py): fix linting issue
|
2024-01-09 12:59:42 +05:30 |
|
Krrish Dholakia
|
832c10b402
|
feat(lowest_latency.py): support expanded time window for latency based routing
uses a 1hr avg. of latency for deployments, to determine which to route to
https://github.com/BerriAI/litellm/issues/1361
|
2024-01-09 12:59:42 +05:30 |
|
Krrish Dholakia
|
9dc2bc227b
|
refactor(lowest_latency.py): fix linting error
|
2024-01-09 12:58:58 +05:30 |
|
Krrish Dholakia
|
9ddcdc4716
|
feat(lowest_latency.py): support expanded time window for latency based routing
uses a 1hr avg. of latency for deployments, to determine which to route to
https://github.com/BerriAI/litellm/issues/1361
|
2024-01-09 12:58:58 +05:30 |
|
Krrish Dholakia
|
027218c3f0
|
test(test_lowest_latency_routing.py): add more tests
|
2023-12-30 17:41:42 +05:30 |
|
Krrish Dholakia
|
f2d0d5584a
|
fix(router.py): fix latency based routing
|
2023-12-30 17:25:40 +05:30 |
|