litellm-mirror/litellm
Ishaan Jaff 00544b97c8 (feat) Add cost tracking for /batches requests OpenAI (#7384)
* add basic logging for create`batch`

* add create_batch as a call type

* add basic dd logging for batches

* basic batch creation logging on DD

* batch endpoints add cost calc

* fix batches_async_logging

* separate folder for batches testing

* new job for batches tests

* test batches logging

* fix validation logic

* add vertex_batch_completions.jsonl

* test test_async_create_batch

* test_async_create_batch

* update tests

* test_completion_with_no_model

* remove dead code

* update load_vertex_ai_credentials

* test_avertex_batch_prediction

* update get async httpx client

* fix get_async_httpx_client

* update test_avertex_batch_prediction

* fix batches testing config.yaml

* add google deps

* fix vertex files handler
2024-12-23 17:47:26 -08:00
..
adapters (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
assistants (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
batch_completion (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
batches (feat) Add cost tracking for /batches requests OpenAI (#7384) 2024-12-23 17:47:26 -08:00
caching (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
deprecated_litellm_server (refactor) caching use LLMCachingHandler for async_get_cache and set_cache (#6208) 2024-10-14 16:34:01 +05:30
files (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
fine_tuning (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
integrations Litellm dev 12 20 2024 p3 (#7339) 2024-12-20 21:13:32 -08:00
litellm_core_utils (feat) Add basic logging support for /batches endpoints (#7381) 2024-12-23 17:45:03 -08:00
llms (feat) Add cost tracking for /batches requests OpenAI (#7384) 2024-12-23 17:47:26 -08:00
proxy LiteLLM Minor Fixes & Improvements (12/23/2024) - P2 (#7386) 2024-12-23 17:41:27 -08:00
realtime_api (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
rerank_api Litellm dev 2024 12 20 p1 (#7335) 2024-12-20 21:22:31 -08:00
router_strategy [Bug Fix]: Errors in LiteLLM When Using Embeddings Model with Usage-Based Routing (#7390) 2024-12-23 17:42:24 -08:00
router_utils Controll fallback prompts client-side (#7334) 2024-12-20 19:09:53 -08:00
secret_managers (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
types (feat) Add basic logging support for /batches endpoints (#7381) 2024-12-23 17:45:03 -08:00
__init__.py Complete 'requests' library removal (#7350) 2024-12-22 07:21:25 -08:00
_logging.py (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
_redis.py (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
_service_logger.py LiteLLM Minor Fixes & Improvements (12/05/2024) (#7037) 2024-12-05 00:02:31 -08:00
_version.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
budget_manager.py (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
constants.py (feat) Add cost tracking for /batches requests OpenAI (#7384) 2024-12-23 17:47:26 -08:00
cost.json
cost_calculator.py Litellm dev 12 23 2024 p1 (#7383) 2024-12-23 16:33:31 -08:00
exceptions.py Litellm 12 02 2024 (#6994) 2024-12-02 22:00:01 -08:00
main.py (feat) Add cost tracking for /batches requests OpenAI (#7384) 2024-12-23 17:47:26 -08:00
model_prices_and_context_window_backup.json (Feat) Add input_cost_per_token_batches, output_cost_per_token_batches for OpenAI cost tracking Batches API (#7391) 2024-12-23 17:42:58 -08:00
py.typed feature - Types for mypy - #360 2024-05-30 14:14:41 -04:00
router.py LiteLLM Minor Fixes & Improvements (12/23/2024) - P2 (#7386) 2024-12-23 17:41:27 -08:00
scheduler.py (refactor) caching use LLMCachingHandler for async_get_cache and set_cache (#6208) 2024-10-14 16:34:01 +05:30
timeout.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
utils.py (feat) Add basic logging support for /batches endpoints (#7381) 2024-12-23 17:45:03 -08:00