8 commits

Author	SHA1	Message	Date
Ishaan Jaff	32e8bdef6f	update clean up jobs	2024-12-28 19:45:19 -08:00
Ishaan Jaff	6409de6291	fix ft job test - add resource cleanup	2024-12-28 19:28:54 -08:00
Ishaan Jaff	f719743d4a	cleanup_azure_ft_models	2024-12-28 19:10:23 -08:00
Ishaan Jaff	d36152f9eb	fix ft testing	2024-12-27 14:33:16 -08:00
Ishaan Jaff	81be0b4090	(Feat) add `"/v1/batches/{batch_id:path}/cancel" endpoint (#7406) ... * use 1 file for azure batches handling * add cancel_batch endpoint * add a cancel batch on open ai * add cancel_batch endpoint * add cancel batches to test * remove unused imports * test_batches_operations * update test_batches_operations	2024-12-24 20:23:50 -08:00
Ishaan Jaff	08a4c72692	(feat) /batches - track user_api_key_alias, user_api_key_team_alias etc for /batch requests (#7401) ... * run azure testing on ci/cd * update docs on azure batches endpoints * add input azure.jsonl * refactor - use separate file for batches endpoints * fixes for passing custom llm provider to /batch endpoints * pass custom llm provider to files endpoints * update azure batches doc * add info for azure batches api * update batches endpoints * use simple helper for raising proxy exception * update config.yml * fix imports * add type hints to get_litellm_params * update get_litellm_params * update get_litellm_params * update get slp * QOL - stop double logging a create batch operations on custom loggers * re use slp from og event * _create_standard_logging_object_for_completed_batch * fix linting errors * reduce num changes in PR * update BATCH_STATUS_POLL_MAX_ATTEMPTS	2024-12-24 17:44:28 -08:00
Ishaan Jaff	47e12802df	(feat) /batches Add support for using /batches endpoints in OAI format (#7402) ... * run azure testing on ci/cd * update docs on azure batches endpoints * add input azure.jsonl * refactor - use separate file for batches endpoints * fixes for passing custom llm provider to /batch endpoints * pass custom llm provider to files endpoints * update azure batches doc * add info for azure batches api * update batches endpoints * use simple helper for raising proxy exception * update config.yml * fix imports * update tests * use existing settings * update env var used * update configs * update config.yml * update ft testing	2024-12-24 16:58:05 -08:00
Ishaan Jaff	05b0d2026f	(feat) Add cost tracking for /batches requests OpenAI (#7384) ... * add basic logging for create`batch` * add create_batch as a call type * add basic dd logging for batches * basic batch creation logging on DD * batch endpoints add cost calc * fix batches_async_logging * separate folder for batches testing * new job for batches tests * test batches logging * fix validation logic * add vertex_batch_completions.jsonl * test test_async_create_batch * test_async_create_batch * update tests * test_completion_with_no_model * remove dead code * update load_vertex_ai_credentials * test_avertex_batch_prediction * update get async httpx client * fix get_async_httpx_client * update test_avertex_batch_prediction * fix batches testing config.yaml * add google deps * fix vertex files handler	2024-12-23 17:47:26 -08:00

Renamed from tests/local_testing/test_openai_batches_and_files.py (Browse further)