Ishaan Jaff
4ec4d02474
[Feat-Router] Allow setting which environment to use a model on ( #5892 )
...
* add check deployment_is_active_for_environment
* add test for test_init_router_with_supported_environments
* show good example config for environments
* docs clean up config.yaml
* docs cleanup
* docs configs
* docs specfic env
2024-09-25 10:12:06 -07:00
Krrish Dholakia
4603eedcc1
fix: fix test
2024-08-05 22:20:33 -07:00
Krrish Dholakia
ea902f40de
test(test_router_init.py): cleanup tests
2024-08-05 21:48:43 -07:00
Ishaan Jaff
3fa64023ea
test - test_init_clients_async_mode
2024-07-06 14:08:35 -07:00
Krrish Dholakia
a3257fd5d3
test(test_router_init.py): fix test
2024-04-27 18:40:00 -07:00
Krrish Dholakia
5e0bd5982e
fix(router.py): fix sync should_retry logic
2024-04-27 14:48:07 -07:00
Ishaan Jaff
3b622556be
test - setting org for openai text completion
2024-04-06 11:53:26 -07:00
Ishaan Jaff
faa0d38087
Merge pull request #2868 from BerriAI/litellm_add_command_r_on_proxy
...
Add Azure Command-r-plus on litellm proxy
2024-04-05 15:13:47 -07:00
Ishaan Jaff
9055a071e6
proxy - add azure/command r
2024-04-05 14:35:31 -07:00
Krrish Dholakia
695eb129ad
fix(router.py): fix client init for streaming timeouts
2024-04-05 12:30:15 -07:00
ishaan-jaff
66c484f9d1
(test) setting organization as litellm_param
2024-01-30 10:52:50 -08:00
ishaan-jaff
85b5395692
(test) use os.environ/ for azure vision enhance
2024-01-17 21:26:47 -08:00
ishaan-jaff
67db73ab1a
(test) init proxy router with gpt-vision enhancements
2024-01-17 10:54:37 -08:00
ishaan-jaff
aa757d19f5
(test) router - init clients - azure cloudflare, openai etc
2024-01-04 10:55:18 +05:30
ishaan-jaff
14738ec89d
(test) xinference on litellm router
2024-01-02 16:51:08 +05:30
Krrish Dholakia
f2d0d5584a
fix(router.py): fix latency based routing
2023-12-30 17:25:40 +05:30
Krrish Dholakia
c41b1418d4
test(test_router_init.py): fix test router init
2023-12-30 16:51:39 +05:30
Krrish Dholakia
4905929de3
refactor: add black formatting
2023-12-25 14:11:20 +05:30
ishaan-jaff
fa5b453d39
(test) init router
2023-12-04 17:31:12 -08:00
ishaan-jaff
886b52d448
(test) init router clients
2023-12-04 17:31:12 -08:00
ishaan-jaff
cba98cf530
(test) init router with 4 clients
2023-12-04 17:31:12 -08:00