Commit graph

22 commits

Author SHA1 Message Date
Ishaan Jaff
0eef9df396 (feat) add Vertex Batches API support in OpenAI format (#7032)
* working request

* working transform

* working request

* transform vertex batch response

* add _async_create_batch

* move gcs functions to base

* fix _get_content_from_openai_file

* transform_openai_file_content_to_vertex_ai_file_content

* fix transform vertex gcs bucket upload to OAI files format

* working e2e test

* _get_gcs_object_name

* fix linting

* add doc string

* fix transform_gcs_bucket_response_to_openai_file_object

* use vertex for batch endpoints

* add batches support for vertex

* test_vertex_batches_endpoint

* test_vertex_batch_prediction

* fix gcs bucket base auth

* docs clean up batches

* docs Batch API

* docs vertex batches api

* test_get_gcs_logging_config_without_service_account

* undo change

* fix vertex md

* test_get_gcs_logging_config_without_service_account

* ci/cd run again
2024-12-04 19:40:28 -08:00
Krish Dholakia
94a05ca5d0 Litellm ruff linting enforcement (#5992)
* ci(config.yml): add a 'check_code_quality' step

Addresses https://github.com/BerriAI/litellm/issues/5991

* ci(config.yml): check why circle ci doesn't pick up this test

* ci(config.yml): fix to run 'check_code_quality' tests

* fix(__init__.py): fix unprotected import

* fix(__init__.py): don't remove unused imports

* build(ruff.toml): update ruff.toml to ignore unused imports

* fix: fix: ruff + pyright - fix linting + type-checking errors

* fix: fix linting errors

* fix(lago.py): fix module init error

* fix: fix linting errors

* ci(config.yml): cd into correct dir for checks

* fix(proxy_server.py): fix linting error

* fix(utils.py): fix bare except

causes ruff linting errors

* fix: ruff - fix remaining linting errors

* fix(clickhouse.py): use standard logging object

* fix(__init__.py): fix unprotected import

* fix: ruff - fix linting errors

* fix: fix linting errors

* ci(config.yml): cleanup code qa step (formatting handled in local_testing)

* fix(_health_endpoints.py): fix ruff linting errors

* ci(config.yml): just use ruff in check_code_quality pipeline for now

* build(custom_guardrail.py): include missing file

* style(embedding_handler.py): fix ruff check
2024-10-01 19:44:20 -04:00
Ishaan Jaff
7370a994f5 use correct type hints for audio transcriptions 2024-09-05 09:12:27 -07:00
Ishaan Jaff
09519b74db refactor get_secret 2024-09-03 10:42:12 -07:00
Krrish Dholakia
88d18c7340 refactor: ci/cd run again 2024-09-03 07:17:02 -07:00
Krrish Dholakia
5959cf0b50 fix: fix linting errors 2024-08-22 15:51:59 -07:00
Krrish Dholakia
f9ab33cbc2 feat(proxy_server.py): support azure batch api endpoints 2024-08-22 15:21:43 -07:00
Krrish Dholakia
a9b5d5271f feat(batches): add azure openai batches endpoint support
Closes https://github.com/BerriAI/litellm/issues/5073
2024-08-22 14:46:51 -07:00
Ishaan Jaff
b64e0fad81 test batches endpoint on proxy 2024-07-30 09:46:30 -07:00
Ishaan Jaff
4d2e98802f feat add support for alist_batches 2024-07-30 08:18:52 -07:00
Ishaan Jaff
dc6fce3140 fix typing errors 2024-07-19 16:43:31 -07:00
Ishaan Jaff
cf7db1280f fix typing errors 2024-07-19 16:18:53 -07:00
Ishaan Jaff
6dd2487206 test - deleting a file 2024-07-10 15:41:32 -07:00
Krrish Dholakia
a4dae8e9f1 docs(customers.md): add customer cost tracking to docs 2024-05-29 14:55:33 -07:00
Ishaan Jaff
cd4a3627e8 feat - add afile_content, file_content 2024-05-28 20:58:22 -07:00
Ishaan Jaff
be38c3142d fix python3.8 error 2024-05-28 17:25:08 -07:00
Ishaan Jaff
fe704e5857 feat - add aretrieve_batch 2024-05-28 17:12:41 -07:00
Ishaan Jaff
c580fe03a0 feat - add acreate_batch 2024-05-28 17:03:29 -07:00
Ishaan Jaff
80cae343cc feat - add litellm.acreate_file 2024-05-28 16:47:27 -07:00
Ishaan Jaff
06c254ae47 feat- add retrieve_batch() 2024-05-28 15:55:32 -07:00
Ishaan Jaff
fc4ca265b8 working create_batch 2024-05-28 15:45:23 -07:00
Ishaan Jaff
4dc7bfebd4 feat - import batches in __init__ 2024-05-28 15:35:11 -07:00