Commit graph

28 commits

Author SHA1 Message Date
Krrish Dholakia
1738341dcb fix(main.py): misrouting ollama models to nlp cloud 2023-11-14 18:55:08 -08:00
Krrish Dholakia
4475f2bbdd bump: version 1.0.0.dev1 → 1.0.0 2023-11-13 16:48:53 -08:00
Krrish Dholakia
1d635aff08 fix(router.py): enable calling router with instructor 2023-11-13 15:16:57 -08:00
Krrish Dholakia
a4c9e6bd46 fix(utils.py): fix cached responses - translate dict to objects 2023-11-10 10:38:20 -08:00
Nathan Kim
f7dc2bf545 first commit 2023-11-09 22:12:39 -08:00
Nathan Kim
ee92c9c8b6 first commit 2023-11-09 22:07:19 -08:00
Krrish Dholakia
ba66294a3d fix(router.py): fix linting issues 2023-11-06 18:50:09 -08:00
Krrish Dholakia
2b48a1fc3e fix(router.py): adding health checks 2023-11-06 18:26:41 -08:00
Krrish Dholakia
6a45879932 bump: version 0.13.6.dev3 → 0.13.6 2023-11-06 18:19:20 -08:00
Krish Dholakia
9bef396d04
Merge pull request #722 from karvetskiy/fix-router-caching
Fix caching for Router
2023-10-31 16:39:18 -07:00
mc-marcocheng
0a2cb9555c Handle empty input edge case 2023-10-31 14:38:04 +08:00
seva
5e1e8820b4 Router & Caching fixes:
- Add optional TTL to Cache parameters
- Fix tpm and rpm caching in Router
2023-10-30 13:29:35 +01:00
mc-marcocheng
f43d59fff8 avoid overwriting litellm_params 2023-10-27 15:30:34 +08:00
mc-marcocheng
bf98d48bba Feature: Router aembedding 2023-10-25 11:19:45 +08:00
Krrish Dholakia
0f08335edd fix(router.py): adding support for async completion calls
https://github.com/BerriAI/litellm/issues/676
2023-10-24 17:20:31 -07:00
Krrish Dholakia
b7a023a82b refactor(router.py): spacing 2023-10-24 12:30:59 -07:00
Krrish Dholakia
f12dc5df21 fix(vertex_ai.py): fix output parsing 2023-10-24 12:08:22 -07:00
Krrish Dholakia
653863f787 test(test_router.py): fixing router testing 2023-10-24 10:21:10 -07:00
mc-marcocheng
0590ec620b
Fix data being overwritten 2023-10-24 16:02:15 +08:00
Krrish Dholakia
05740fed9d fix(router.py): enable additional params to be passe din 2023-10-23 20:41:18 -07:00
Krrish Dholakia
5516113f18 docs(router.py): fix linting issue 2023-10-23 15:15:10 -07:00
Krrish Dholakia
cfed9fff74 fix(router.py): fix null model names error
https://github.com/BerriAI/litellm/issues/669#issuecomment-1775456245
2023-10-23 09:30:04 -07:00
ishaan-jaff
220935c3cc (fix) litellm proxy with router 2023-10-20 09:38:22 -07:00
Krrish Dholakia
04f8840a92 test: fix linting testing 2023-10-19 18:40:33 -07:00
Krrish Dholakia
3a8c8f56d6 feat(proxy_server.py): add model router to proxy 2023-10-18 17:40:08 -07:00
Krrish Dholakia
e35562d188 fix(router.py): completing redis support work for router 2023-10-18 12:13:00 -07:00
Krrish Dholakia
fa488e29e0 fix(test_proxy.py): fix tests 2023-10-17 22:34:12 -07:00
Krrish Dholakia
b20cf3171b feat(router.py): add routing capabilities for multiple deployments 2023-10-17 22:28:31 -07:00