litellm-mirror/litellm/llms/vertex_ai
Ishaan Jaff 00544b97c8 (feat) Add cost tracking for /batches requests OpenAI (#7384)
* add basic logging for create`batch`

* add create_batch as a call type

* add basic dd logging for batches

* basic batch creation logging on DD

* batch endpoints add cost calc

* fix batches_async_logging

* separate folder for batches testing

* new job for batches tests

* test batches logging

* fix validation logic

* add vertex_batch_completions.jsonl

* test test_async_create_batch

* test_async_create_batch

* update tests

* test_completion_with_no_model

* remove dead code

* update load_vertex_ai_credentials

* test_avertex_batch_prediction

* update get async httpx client

* fix get_async_httpx_client

* update test_avertex_batch_prediction

* fix batches testing config.yaml

* add google deps

* fix vertex files handler
2024-12-23 17:47:26 -08:00
..
batches (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
context_caching (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
files (feat) Add cost tracking for /batches requests OpenAI (#7384) 2024-12-23 17:47:26 -08:00
fine_tuning (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
gemini (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
gemini_embeddings (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
image_generation (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
multimodal_embeddings (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
text_to_speech (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
vertex_ai_partner_models Litellm dev 2024 12 19 p3 (#7322) 2024-12-20 13:30:16 -08:00
vertex_embeddings (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
vertex_model_garden Litellm dev 2024 12 19 p3 (#7322) 2024-12-20 13:30:16 -08:00
common_utils.py (fix) unable to pass input_type parameter to Voyage AI embedding mode (#7276) 2024-12-17 19:23:49 -08:00
vertex_ai_non_gemini.py (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
vertex_llm_base.py (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00