Krish Dholakia
5e386c28b2
Litellm dev 03 04 2025 p3 ( #8997 )
...
* fix(core_helpers.py): handle litellm_metadata instead of 'metadata'
* feat(batches/): ensure batches logs are written to db
makes batches response dict compatible
* fix(cost_calculator.py): handle batch response being a dictionary
* fix(batches/main.py): modify retrieve endpoints to use @client decorator
enables logging to work on retrieve call
* fix(batches/main.py): fix retrieve batch response type to be 'dict' compatible
* fix(spend_tracking_utils.py): send unique uuid for retrieve batch call type
create batch and retrieve batch share the same id
* fix(spend_tracking_utils.py): prevent duplicate retrieve batch calls from being double counted
* refactor(batches/): refactor cost tracking for batches - do it on retrieve, and within the established litellm_logging pipeline
ensures cost is always logged to db
* fix: fix linting errors
* fix: fix linting error
2025-03-04 21:58:03 -08:00
Ishaan Jaff
13f364682d
(Feat - Batches API) add support for retrieving vertex api batch jobs ( #7661 )
...
* add _async_retrieve_batch
* fix aretrieve_batch
* fix _get_batch_id_from_vertex_ai_batch_response
* fix batches docs
2025-01-09 18:35:03 -08:00
Ishaan Jaff
81be0b4090
(Feat) add `"/v1/batches/{batch_id:path}/cancel" endpoint ( #7406 )
...
* use 1 file for azure batches handling
* add cancel_batch endpoint
* add a cancel batch on open ai
* add cancel_batch endpoint
* add cancel batches to test
* remove unused imports
* test_batches_operations
* update test_batches_operations
2024-12-24 20:23:50 -08:00
Ishaan Jaff
08a4c72692
(feat) /batches - track user_api_key_alias, user_api_key_team_alias etc for /batch requests ( #7401 )
...
* run azure testing on ci/cd
* update docs on azure batches endpoints
* add input azure.jsonl
* refactor - use separate file for batches endpoints
* fixes for passing custom llm provider to /batch endpoints
* pass custom llm provider to files endpoints
* update azure batches doc
* add info for azure batches api
* update batches endpoints
* use simple helper for raising proxy exception
* update config.yml
* fix imports
* add type hints to get_litellm_params
* update get_litellm_params
* update get_litellm_params
* update get slp
* QOL - stop double logging a create batch operations on custom loggers
* re use slp from og event
* _create_standard_logging_object_for_completed_batch
* fix linting errors
* reduce num changes in PR
* update BATCH_STATUS_POLL_MAX_ATTEMPTS
2024-12-24 17:44:28 -08:00
Ishaan Jaff
47e12802df
(feat) /batches Add support for using /batches endpoints in OAI format ( #7402 )
...
* run azure testing on ci/cd
* update docs on azure batches endpoints
* add input azure.jsonl
* refactor - use separate file for batches endpoints
* fixes for passing custom llm provider to /batch endpoints
* pass custom llm provider to files endpoints
* update azure batches doc
* add info for azure batches api
* update batches endpoints
* use simple helper for raising proxy exception
* update config.yml
* fix imports
* update tests
* use existing settings
* update env var used
* update configs
* update config.yml
* update ft testing
2024-12-24 16:58:05 -08:00
Ishaan Jaff
05b0d2026f
(feat) Add cost tracking for /batches requests OpenAI ( #7384 )
...
* add basic logging for create`batch`
* add create_batch as a call type
* add basic dd logging for batches
* basic batch creation logging on DD
* batch endpoints add cost calc
* fix batches_async_logging
* separate folder for batches testing
* new job for batches tests
* test batches logging
* fix validation logic
* add vertex_batch_completions.jsonl
* test test_async_create_batch
* test_async_create_batch
* update tests
* test_completion_with_no_model
* remove dead code
* update load_vertex_ai_credentials
* test_avertex_batch_prediction
* update get async httpx client
* fix get_async_httpx_client
* update test_avertex_batch_prediction
* fix batches testing config.yaml
* add google deps
* fix vertex files handler
2024-12-23 17:47:26 -08:00
Ishaan Jaff
87f19d6f13
(feat) Add basic logging support for /batches endpoints ( #7381 )
...
* add basic logging for create`batch`
* add create_batch as a call type
* add basic dd logging for batches
* basic batch creation logging on DD
2024-12-23 17:45:03 -08:00
Ishaan Jaff
c7f14e936a
(code quality) run ruff rule to ban unused imports ( #7313 )
...
* remove unused imports
* fix AmazonConverseConfig
* fix test
* fix import
* ruff check fixes
* test fixes
* fix testing
* fix imports
2024-12-19 12:33:42 -08:00
Ishaan Jaff
21003c4337
Code Quality Improvement - use vertex_ai/ as folder name for vertexAI ( #7166 )
...
* fix rename vertex ai
* run ci/cd again
2024-12-11 00:32:41 -08:00
Ishaan Jaff
bfb6891eb7
rename llms/OpenAI/ -> llms/openai/ ( #7154 )
...
* rename OpenAI -> openai
* fix file rename
* fix rename changes
* fix organization of openai/transcription
* fix import OA fine tuning API
* fix openai ft handler
* fix handler import
2024-12-10 20:14:07 -08:00
Ishaan Jaff
36e99ebce7
fix use consistent naming ( #7092 )
Read Version from pyproject.toml / read-version (push) Successful in 11s
2024-12-07 22:01:00 -08:00
Ishaan Jaff
84db69d4c4
(feat) add Vertex Batches API support in OpenAI format ( #7032 )
...
* working request
* working transform
* working request
* transform vertex batch response
* add _async_create_batch
* move gcs functions to base
* fix _get_content_from_openai_file
* transform_openai_file_content_to_vertex_ai_file_content
* fix transform vertex gcs bucket upload to OAI files format
* working e2e test
* _get_gcs_object_name
* fix linting
* add doc string
* fix transform_gcs_bucket_response_to_openai_file_object
* use vertex for batch endpoints
* add batches support for vertex
* test_vertex_batches_endpoint
* test_vertex_batch_prediction
* fix gcs bucket base auth
* docs clean up batches
* docs Batch API
* docs vertex batches api
* test_get_gcs_logging_config_without_service_account
* undo change
* fix vertex md
* test_get_gcs_logging_config_without_service_account
* ci/cd run again
2024-12-04 19:40:28 -08:00
Krish Dholakia
d57be47b0f
Litellm ruff linting enforcement ( #5992 )
...
* ci(config.yml): add a 'check_code_quality' step
Addresses https://github.com/BerriAI/litellm/issues/5991
* ci(config.yml): check why circle ci doesn't pick up this test
* ci(config.yml): fix to run 'check_code_quality' tests
* fix(__init__.py): fix unprotected import
* fix(__init__.py): don't remove unused imports
* build(ruff.toml): update ruff.toml to ignore unused imports
* fix: fix: ruff + pyright - fix linting + type-checking errors
* fix: fix linting errors
* fix(lago.py): fix module init error
* fix: fix linting errors
* ci(config.yml): cd into correct dir for checks
* fix(proxy_server.py): fix linting error
* fix(utils.py): fix bare except
causes ruff linting errors
* fix: ruff - fix remaining linting errors
* fix(clickhouse.py): use standard logging object
* fix(__init__.py): fix unprotected import
* fix: ruff - fix linting errors
* fix: fix linting errors
* ci(config.yml): cleanup code qa step (formatting handled in local_testing)
* fix(_health_endpoints.py): fix ruff linting errors
* ci(config.yml): just use ruff in check_code_quality pipeline for now
* build(custom_guardrail.py): include missing file
* style(embedding_handler.py): fix ruff check
2024-10-01 19:44:20 -04:00
Ishaan Jaff
81ee1653af
use correct type hints for audio transcriptions
2024-09-05 09:12:27 -07:00
Ishaan Jaff
b0178a85cf
refactor get_secret
2024-09-03 10:42:12 -07:00
Krrish Dholakia
36ce43ed95
refactor: ci/cd run again
2024-09-03 07:17:02 -07:00
Krrish Dholakia
63cd94c32a
fix: fix linting errors
2024-08-22 15:51:59 -07:00
Krrish Dholakia
8625663458
feat(proxy_server.py): support azure batch api endpoints
2024-08-22 15:21:43 -07:00
Krrish Dholakia
80675b22bd
feat(batches): add azure openai batches endpoint support
...
Closes https://github.com/BerriAI/litellm/issues/5073
2024-08-22 14:46:51 -07:00
Ishaan Jaff
563d59a305
test batches endpoint on proxy
2024-07-30 09:46:30 -07:00
Ishaan Jaff
43a06f408c
feat add support for alist_batches
2024-07-30 08:18:52 -07:00
Ishaan Jaff
f7b1c33208
fix typing errors
2024-07-19 16:43:31 -07:00
Ishaan Jaff
f3ac6493e8
fix typing errors
2024-07-19 16:18:53 -07:00
Ishaan Jaff
fc2b2fbe49
test - deleting a file
2024-07-10 15:41:32 -07:00
Krrish Dholakia
8f0019c241
docs(customers.md): add customer cost tracking to docs
2024-05-29 14:55:33 -07:00
Ishaan Jaff
ca8163bbba
feat - add afile_content, file_content
2024-05-28 20:58:22 -07:00
Ishaan Jaff
215f19440c
fix python3.8 error
2024-05-28 17:25:08 -07:00
Ishaan Jaff
6688215c18
feat - add aretrieve_batch
2024-05-28 17:12:41 -07:00
Ishaan Jaff
1ef7cd923c
feat - add acreate_batch
2024-05-28 17:03:29 -07:00
Ishaan Jaff
758ed9e923
feat - add litellm.acreate_file
2024-05-28 16:47:27 -07:00
Ishaan Jaff
938f4703c3
feat- add retrieve_batch()
2024-05-28 15:55:32 -07:00
Ishaan Jaff
38285e53c3
working create_batch
2024-05-28 15:45:23 -07:00
Ishaan Jaff
d5dbf084ed
feat - import batches in __init__
2024-05-28 15:35:11 -07:00
