Commit graph

11 commits

Author SHA1 Message Date
Krish Dholakia
9f3fa29624
feat(router.py): Support Loadbalancing batch azure api endpoints (#5469)
* feat(router.py): initial commit for loadbalancing azure batch api endpoints

Closes https://github.com/BerriAI/litellm/issues/5396

* fix(router.py): working `router.acreate_file()`

* feat(router.py): working router.acreate_batch endpoint

* feat(router.py): expose router.aretrieve_batch function

Make it easy for user to retrieve the batch information

* feat(router.py): support 'router.alist_batches' endpoint

Adds support for getting all batches across all endpoints

* feat(router.py): working loadbalancing on `/v1/files`

* feat(proxy_server.py): working loadbalancing on `/v1/batches`

* feat(proxy_server.py): working loadbalancing on Retrieve + List batch
2024-09-02 21:32:55 -07:00
Krrish Dholakia
7398e94472 fix(files_endpoints.py): fix multiple args error 2024-08-22 16:42:44 -07:00
Krrish Dholakia
63cd94c32a fix: fix linting errors 2024-08-22 15:51:59 -07:00
Krrish Dholakia
8625663458 feat(proxy_server.py): support azure batch api endpoints 2024-08-22 15:21:43 -07:00
Ishaan Jaff
e626f5c7d6 fix POST files 2024-07-31 16:27:59 -07:00
Ishaan Jaff
ddc74dbccc fix reading files/ft config 2024-07-31 16:23:36 -07:00
Ishaan Jaff
287b09cff6 add test for ft endpoints on azure 2024-07-31 15:30:26 -07:00
Ishaan Jaff
a5f12aba81 add file content 2024-07-10 16:15:43 -07:00
Ishaan Jaff
cb300d30a9 add file delete path 2024-07-10 16:08:58 -07:00
Ishaan Jaff
0b39ec6a8e add /v1/files LIST 2024-07-10 16:04:07 -07:00
Ishaan Jaff
393ce7df14 add /files endpoints 2024-07-10 14:55:10 -07:00