Ishaan Jaff
|
05b0d2026f
|
(feat) Add cost tracking for /batches requests OpenAI (#7384)
* add basic logging for create`batch`
* add create_batch as a call type
* add basic dd logging for batches
* basic batch creation logging on DD
* batch endpoints add cost calc
* fix batches_async_logging
* separate folder for batches testing
* new job for batches tests
* test batches logging
* fix validation logic
* add vertex_batch_completions.jsonl
* test test_async_create_batch
* test_async_create_batch
* update tests
* test_completion_with_no_model
* remove dead code
* update load_vertex_ai_credentials
* test_avertex_batch_prediction
* update get async httpx client
* fix get_async_httpx_client
* update test_avertex_batch_prediction
* fix batches testing config.yaml
* add google deps
* fix vertex files handler
|
2024-12-23 17:47:26 -08:00 |
|
Ishaan Jaff
|
87f19d6f13
|
(feat) Add basic logging support for /batches endpoints (#7381)
* add basic logging for create`batch`
* add create_batch as a call type
* add basic dd logging for batches
* basic batch creation logging on DD
|
2024-12-23 17:45:03 -08:00 |
|
Ishaan Jaff
|
84db69d4c4
|
(feat) add Vertex Batches API support in OpenAI format (#7032)
* working request
* working transform
* working request
* transform vertex batch response
* add _async_create_batch
* move gcs functions to base
* fix _get_content_from_openai_file
* transform_openai_file_content_to_vertex_ai_file_content
* fix transform vertex gcs bucket upload to OAI files format
* working e2e test
* _get_gcs_object_name
* fix linting
* add doc string
* fix transform_gcs_bucket_response_to_openai_file_object
* use vertex for batch endpoints
* add batches support for vertex
* test_vertex_batches_endpoint
* test_vertex_batch_prediction
* fix gcs bucket base auth
* docs clean up batches
* docs Batch API
* docs vertex batches api
* test_get_gcs_logging_config_without_service_account
* undo change
* fix vertex md
* test_get_gcs_logging_config_without_service_account
* ci/cd run again
|
2024-12-04 19:40:28 -08:00 |
|
Krrish Dholakia
|
3560f0ef2c
|
refactor: move all testing to top-level of repo
Closes https://github.com/BerriAI/litellm/issues/486
|
2024-09-28 21:08:14 -07:00 |
|