Ishaan Jaff
1bac18a98c
cleanup_azure_files
2025-02-15 15:32:42 -08:00
Ishaan Jaff
0ffd99afff
test_avertex_batch_prediction
Read Version from pyproject.toml / read-version (push) Successful in 36s
2025-02-14 22:03:24 -08:00
Ishaan Jaff
0bdebe36d8
test fix openai batches and files
2025-02-14 19:03:30 -08:00
Ishaan Jaff
8a235e7d38
(Refactor / QA) - Use LoggingCallbackManager to append callbacks and ensure no duplicate callbacks are added ( #8112 )
...
* LoggingCallbackManager
* add logging_callback_manager
* use logging_callback_manager
* add add_litellm_failure_callback
* use add_litellm_callback
* use add_litellm_async_success_callback
* add_litellm_async_failure_callback
* linting fix
* fix logging callback manager
* test_duplicate_multiple_loggers_test
* use _reset_all_callbacks
* fix testing with dup callbacks
* test_basic_image_generation
* reset callbacks for tests
* fix check for _add_custom_logger_to_list
* fix test_amazing_sync_embedding
* fix _get_custom_logger_key
* fix batches testing
* fix _reset_all_callbacks
* fix _check_callback_list_size
* add callback_manager_test
* fix test gemini-2.0-flash-thinking-exp-01-21
2025-01-30 19:35:50 -08:00
Ishaan Jaff
5a7dc11432
test fix test_async_create_batch use only openai for testing, hitting azure limits
2025-01-28 22:17:49 -08:00
Ishaan Jaff
b60efd4646
fix test_async_create_batch
2025-01-22 22:15:49 -08:00
Ishaan Jaff
13f364682d
(Feat - Batches API) add support for retrieving vertex api batch jobs ( #7661 )
...
* add _async_retrieve_batch
* fix aretrieve_batch
* fix _get_batch_id_from_vertex_ai_batch_response
* fix batches docs
2025-01-09 18:35:03 -08:00
Ishaan Jaff
3110bb0723
use pathrise-convert-1606954137718
2025-01-05 14:14:43 -08:00
Ishaan Jaff
137879ffea
vertex testing use pathrise-convert-1606954137718
2025-01-05 14:00:17 -08:00
Ishaan Jaff
32e8bdef6f
update clean up jobs
2024-12-28 19:45:19 -08:00
Ishaan Jaff
6409de6291
fix ft job test - add resource cleanup
2024-12-28 19:28:54 -08:00
Ishaan Jaff
f719743d4a
cleanup_azure_ft_models
2024-12-28 19:10:23 -08:00
Ishaan Jaff
d36152f9eb
fix ft testing
2024-12-27 14:33:16 -08:00
Ishaan Jaff
81be0b4090
(Feat) add `"/v1/batches/{batch_id:path}/cancel" endpoint ( #7406 )
...
* use 1 file for azure batches handling
* add cancel_batch endpoint
* add a cancel batch on open ai
* add cancel_batch endpoint
* add cancel batches to test
* remove unused imports
* test_batches_operations
* update test_batches_operations
2024-12-24 20:23:50 -08:00
Ishaan Jaff
08a4c72692
(feat) /batches - track user_api_key_alias, user_api_key_team_alias etc for /batch requests ( #7401 )
...
* run azure testing on ci/cd
* update docs on azure batches endpoints
* add input azure.jsonl
* refactor - use separate file for batches endpoints
* fixes for passing custom llm provider to /batch endpoints
* pass custom llm provider to files endpoints
* update azure batches doc
* add info for azure batches api
* update batches endpoints
* use simple helper for raising proxy exception
* update config.yml
* fix imports
* add type hints to get_litellm_params
* update get_litellm_params
* update get_litellm_params
* update get slp
* QOL - stop double logging a create batch operations on custom loggers
* re use slp from og event
* _create_standard_logging_object_for_completed_batch
* fix linting errors
* reduce num changes in PR
* update BATCH_STATUS_POLL_MAX_ATTEMPTS
2024-12-24 17:44:28 -08:00
Ishaan Jaff
47e12802df
(feat) /batches Add support for using /batches endpoints in OAI format ( #7402 )
...
* run azure testing on ci/cd
* update docs on azure batches endpoints
* add input azure.jsonl
* refactor - use separate file for batches endpoints
* fixes for passing custom llm provider to /batch endpoints
* pass custom llm provider to files endpoints
* update azure batches doc
* add info for azure batches api
* update batches endpoints
* use simple helper for raising proxy exception
* update config.yml
* fix imports
* update tests
* use existing settings
* update env var used
* update configs
* update config.yml
* update ft testing
2024-12-24 16:58:05 -08:00
Ishaan Jaff
05b0d2026f
(feat) Add cost tracking for /batches requests OpenAI ( #7384 )
...
* add basic logging for create`batch`
* add create_batch as a call type
* add basic dd logging for batches
* basic batch creation logging on DD
* batch endpoints add cost calc
* fix batches_async_logging
* separate folder for batches testing
* new job for batches tests
* test batches logging
* fix validation logic
* add vertex_batch_completions.jsonl
* test test_async_create_batch
* test_async_create_batch
* update tests
* test_completion_with_no_model
* remove dead code
* update load_vertex_ai_credentials
* test_avertex_batch_prediction
* update get async httpx client
* fix get_async_httpx_client
* update test_avertex_batch_prediction
* fix batches testing config.yaml
* add google deps
* fix vertex files handler
2024-12-23 17:47:26 -08:00
