Ishaan Jaff
47e12802df
(feat) /batches Add support for using /batches endpoints in OAI format ( #7402 )
...
* run azure testing on ci/cd
* update docs on azure batches endpoints
* add input azure.jsonl
* refactor - use separate file for batches endpoints
* fixes for passing custom llm provider to /batch endpoints
* pass custom llm provider to files endpoints
* update azure batches doc
* add info for azure batches api
* update batches endpoints
* use simple helper for raising proxy exception
* update config.yml
* fix imports
* update tests
* use existing settings
* update env var used
* update configs
* update config.yml
* update ft testing
2024-12-24 16:58:05 -08:00
Ishaan Jaff
b90b98b88f
(fix) LiteLLM Proxy fix GET /files/{file_id:path}/content" endpoint ( #7342 )
...
* fix order of get_file_content
* update e2 files tests
* add e2 batches endpoint testing
* update config.yml
* write content to file
* use correct oai_misc_config
* fixes for openai batches endpoint testing
* remove extra out file
* fix input.jsonl
2024-12-20 21:27:45 -08:00
Ishaan Jaff
c7f14e936a
(code quality) run ruff rule to ban unused imports ( #7313 )
...
* remove unused imports
* fix AmazonConverseConfig
* fix test
* fix import
* ruff check fixes
* test fixes
* fix testing
* fix imports
2024-12-19 12:33:42 -08:00
Ishaan Jaff
84db69d4c4
(feat) add Vertex Batches API support in OpenAI format ( #7032 )
...
* working request
* working transform
* working request
* transform vertex batch response
* add _async_create_batch
* move gcs functions to base
* fix _get_content_from_openai_file
* transform_openai_file_content_to_vertex_ai_file_content
* fix transform vertex gcs bucket upload to OAI files format
* working e2e test
* _get_gcs_object_name
* fix linting
* add doc string
* fix transform_gcs_bucket_response_to_openai_file_object
* use vertex for batch endpoints
* add batches support for vertex
* test_vertex_batches_endpoint
* test_vertex_batch_prediction
* fix gcs bucket base auth
* docs clean up batches
* docs Batch API
* docs vertex batches api
* test_get_gcs_logging_config_without_service_account
* undo change
* fix vertex md
* test_get_gcs_logging_config_without_service_account
* ci/cd run again
2024-12-04 19:40:28 -08:00
Krish Dholakia
d57be47b0f
Litellm ruff linting enforcement ( #5992 )
...
* ci(config.yml): add a 'check_code_quality' step
Addresses https://github.com/BerriAI/litellm/issues/5991
* ci(config.yml): check why circle ci doesn't pick up this test
* ci(config.yml): fix to run 'check_code_quality' tests
* fix(__init__.py): fix unprotected import
* fix(__init__.py): don't remove unused imports
* build(ruff.toml): update ruff.toml to ignore unused imports
* fix: fix: ruff + pyright - fix linting + type-checking errors
* fix: fix linting errors
* fix(lago.py): fix module init error
* fix: fix linting errors
* ci(config.yml): cd into correct dir for checks
* fix(proxy_server.py): fix linting error
* fix(utils.py): fix bare except
causes ruff linting errors
* fix: ruff - fix remaining linting errors
* fix(clickhouse.py): use standard logging object
* fix(__init__.py): fix unprotected import
* fix: ruff - fix linting errors
* fix: fix linting errors
* ci(config.yml): cleanup code qa step (formatting handled in local_testing)
* fix(_health_endpoints.py): fix ruff linting errors
* ci(config.yml): just use ruff in check_code_quality pipeline for now
* build(custom_guardrail.py): include missing file
* style(embedding_handler.py): fix ruff check
2024-10-01 19:44:20 -04:00
Krish Dholakia
9f3fa29624
feat(router.py): Support Loadbalancing batch azure api endpoints ( #5469 )
...
* feat(router.py): initial commit for loadbalancing azure batch api endpoints
Closes https://github.com/BerriAI/litellm/issues/5396
* fix(router.py): working `router.acreate_file()`
* feat(router.py): working router.acreate_batch endpoint
* feat(router.py): expose router.aretrieve_batch function
Make it easy for user to retrieve the batch information
* feat(router.py): support 'router.alist_batches' endpoint
Adds support for getting all batches across all endpoints
* feat(router.py): working loadbalancing on `/v1/files`
* feat(proxy_server.py): working loadbalancing on `/v1/batches`
* feat(proxy_server.py): working loadbalancing on Retrieve + List batch
2024-09-02 21:32:55 -07:00
Krrish Dholakia
7398e94472
fix(files_endpoints.py): fix multiple args error
2024-08-22 16:42:44 -07:00
Krrish Dholakia
63cd94c32a
fix: fix linting errors
2024-08-22 15:51:59 -07:00
Krrish Dholakia
8625663458
feat(proxy_server.py): support azure batch api endpoints
2024-08-22 15:21:43 -07:00
Ishaan Jaff
e626f5c7d6
fix POST files
2024-07-31 16:27:59 -07:00
Ishaan Jaff
ddc74dbccc
fix reading files/ft config
2024-07-31 16:23:36 -07:00
Ishaan Jaff
287b09cff6
add test for ft endpoints on azure
2024-07-31 15:30:26 -07:00
Ishaan Jaff
a5f12aba81
add file content
2024-07-10 16:15:43 -07:00
Ishaan Jaff
cb300d30a9
add file delete path
2024-07-10 16:08:58 -07:00
Ishaan Jaff
0b39ec6a8e
add /v1/files LIST
2024-07-10 16:04:07 -07:00
Ishaan Jaff
393ce7df14
add /files endpoints
2024-07-10 14:55:10 -07:00
