Commit graph

11 commits

Author SHA1 Message Date
Krish Dholakia
18da7adce9 feat(router.py): Support Loadbalancing batch azure api endpoints (#5469)
* feat(router.py): initial commit for loadbalancing azure batch api endpoints

Closes https://github.com/BerriAI/litellm/issues/5396

* fix(router.py): working `router.acreate_file()`

* feat(router.py): working router.acreate_batch endpoint

* feat(router.py): expose router.aretrieve_batch function

Make it easy for user to retrieve the batch information

* feat(router.py): support 'router.alist_batches' endpoint

Adds support for getting all batches across all endpoints

* feat(router.py): working loadbalancing on `/v1/files`

* feat(proxy_server.py): working loadbalancing on `/v1/batches`

* feat(proxy_server.py): working loadbalancing on Retrieve + List batch
2024-09-02 21:32:55 -07:00
Krrish Dholakia
b95d4bb61a fix(files_endpoints.py): fix multiple args error 2024-08-22 16:42:44 -07:00
Krrish Dholakia
5959cf0b50 fix: fix linting errors 2024-08-22 15:51:59 -07:00
Krrish Dholakia
f9ab33cbc2 feat(proxy_server.py): support azure batch api endpoints 2024-08-22 15:21:43 -07:00
Ishaan Jaff
b1196c6afa fix POST files 2024-07-31 16:27:59 -07:00
Ishaan Jaff
098e1eb8ad fix reading files/ft config 2024-07-31 16:23:36 -07:00
Ishaan Jaff
7cded198c2 add test for ft endpoints on azure 2024-07-31 15:30:26 -07:00
Ishaan Jaff
fd270166fd add file content 2024-07-10 16:15:43 -07:00
Ishaan Jaff
c22da9ab0d add file delete path 2024-07-10 16:08:58 -07:00
Ishaan Jaff
9e71006d07 add /v1/files LIST 2024-07-10 16:04:07 -07:00
Ishaan Jaff
f118123ae1 add /files endpoints 2024-07-10 14:55:10 -07:00