Ishaan Jaff
|
05b0d2026f
|
(feat) Add cost tracking for /batches requests OpenAI (#7384)
* add basic logging for create`batch`
* add create_batch as a call type
* add basic dd logging for batches
* basic batch creation logging on DD
* batch endpoints add cost calc
* fix batches_async_logging
* separate folder for batches testing
* new job for batches tests
* test batches logging
* fix validation logic
* add vertex_batch_completions.jsonl
* test test_async_create_batch
* test_async_create_batch
* update tests
* test_completion_with_no_model
* remove dead code
* update load_vertex_ai_credentials
* test_avertex_batch_prediction
* update get async httpx client
* fix get_async_httpx_client
* update test_avertex_batch_prediction
* fix batches testing config.yaml
* add google deps
* fix vertex files handler
|
2024-12-23 17:47:26 -08:00 |
|