litellm-mirror/litellm/router_utils
Krish Dholakia 18da7adce9 feat(router.py): Support Loadbalancing batch azure api endpoints (#5469)
* feat(router.py): initial commit for loadbalancing azure batch api endpoints

Closes https://github.com/BerriAI/litellm/issues/5396

* fix(router.py): working `router.acreate_file()`

* feat(router.py): working router.acreate_batch endpoint

* feat(router.py): expose router.aretrieve_batch function

Make it easy for user to retrieve the batch information

* feat(router.py): support 'router.alist_batches' endpoint

Adds support for getting all batches across all endpoints

* feat(router.py): working loadbalancing on `/v1/files`

* feat(proxy_server.py): working loadbalancing on `/v1/batches`

* feat(proxy_server.py): working loadbalancing on Retrieve + List batch
2024-09-02 21:32:55 -07:00
..
batch_utils.py feat(router.py): Support Loadbalancing batch azure api endpoints (#5469) 2024-09-02 21:32:55 -07:00
client_initalization_utils.py Azure Service Principal with Secret authentication workflow. (#5131) (#5437) 2024-09-02 14:29:00 -07:00
cooldown_cache.py fix(cooldown_cache.py): fix linting errors 2024-08-27 07:40:28 -07:00
cooldown_callbacks.py refactor prom metrics 2024-08-09 09:02:23 -07:00
fallback_event_handlers.py fix run sync fallbacks 2024-08-20 12:55:36 -07:00
handle_error.py fix use safe access for router alerting 2024-06-14 15:17:32 -07:00