11 commits

Author	SHA1	Message	Date
Ishaan Jaff	19cac744f8	(Feat - Batches API) add support for retrieving vertex api batch jobs (#7661) ... * add _async_retrieve_batch * fix aretrieve_batch * fix _get_batch_id_from_vertex_ai_batch_response * fix batches docs	2025-01-09 18:35:03 -08:00
Ishaan Jaff	b953c85bbd	use pathrise-convert-1606954137718	2025-01-05 14:14:43 -08:00
Ishaan Jaff	7aff6342e3	vertex testing use pathrise-convert-1606954137718	2025-01-05 14:00:17 -08:00
Ishaan Jaff	ccdf263ad1	update clean up jobs	2024-12-28 19:45:19 -08:00
Ishaan Jaff	a453a174fb	fix ft job test - add resource cleanup	2024-12-28 19:28:54 -08:00
Ishaan Jaff	bcdf7503cf	cleanup_azure_ft_models	2024-12-28 19:10:23 -08:00
Ishaan Jaff	b1afd8f31e	fix ft testing	2024-12-27 14:33:16 -08:00
Ishaan Jaff	54cb64d03d	(Feat) add `"/v1/batches/{batch_id:path}/cancel" endpoint (#7406) ... * use 1 file for azure batches handling * add cancel_batch endpoint * add a cancel batch on open ai * add cancel_batch endpoint * add cancel batches to test * remove unused imports * test_batches_operations * update test_batches_operations	2024-12-24 20:23:50 -08:00
Ishaan Jaff	e98f1d16fd	(feat) /batches - track user_api_key_alias, user_api_key_team_alias etc for /batch requests (#7401) ... * run azure testing on ci/cd * update docs on azure batches endpoints * add input azure.jsonl * refactor - use separate file for batches endpoints * fixes for passing custom llm provider to /batch endpoints * pass custom llm provider to files endpoints * update azure batches doc * add info for azure batches api * update batches endpoints * use simple helper for raising proxy exception * update config.yml * fix imports * add type hints to get_litellm_params * update get_litellm_params * update get_litellm_params * update get slp * QOL - stop double logging a create batch operations on custom loggers * re use slp from og event * _create_standard_logging_object_for_completed_batch * fix linting errors * reduce num changes in PR * update BATCH_STATUS_POLL_MAX_ATTEMPTS	2024-12-24 17:44:28 -08:00
Ishaan Jaff	0627450808	(feat) /batches Add support for using /batches endpoints in OAI format (#7402) ... * run azure testing on ci/cd * update docs on azure batches endpoints * add input azure.jsonl * refactor - use separate file for batches endpoints * fixes for passing custom llm provider to /batch endpoints * pass custom llm provider to files endpoints * update azure batches doc * add info for azure batches api * update batches endpoints * use simple helper for raising proxy exception * update config.yml * fix imports * update tests * use existing settings * update env var used * update configs * update config.yml * update ft testing	2024-12-24 16:58:05 -08:00
Ishaan Jaff	00544b97c8	(feat) Add cost tracking for /batches requests OpenAI (#7384) ... * add basic logging for create`batch` * add create_batch as a call type * add basic dd logging for batches * basic batch creation logging on DD * batch endpoints add cost calc * fix batches_async_logging * separate folder for batches testing * new job for batches tests * test batches logging * fix validation logic * add vertex_batch_completions.jsonl * test test_async_create_batch * test_async_create_batch * update tests * test_completion_with_no_model * remove dead code * update load_vertex_ai_credentials * test_avertex_batch_prediction * update get async httpx client * fix get_async_httpx_client * update test_avertex_batch_prediction * fix batches testing config.yaml * add google deps * fix vertex files handler	2024-12-23 17:47:26 -08:00

Renamed from tests/local_testing/test_openai_batches_and_files.py (Browse further)