Commit graph

6 commits

Author SHA1 Message Date
Ishaan Jaff
94a7b536a2 move web search cost tracking 2025-03-22 17:02:43 -07:00
Ishaan Jaff
cf01f49893 fixes for web search cost tracking 2025-03-22 16:56:32 -07:00
Ishaan Jaff
02c5aebc87 search_context_cost_per_query 2025-03-22 14:52:58 -07:00
Ishaan Jaff
6ff79af33e test_openai_web_search_logging_cost_tracking 2025-03-22 14:29:02 -07:00
Ishaan Jaff
60b1d5bab6 (Bug Fix) - Accurate token counting for /anthropic/ API Routes on LiteLLM Proxy (#8880)
* fix _create_anthropic_response_logging_payload

* fix - pass through don't create standard logging payload

* fix logged key hash

* test_init_kwargs_for_pass_through_endpoint_basic

* test_unit_test_anthropic_pass_through

* fix anthropic pass through logging handler

* test_stream_token_counting_anthropic_with_include_usage

* convert_str_chunk_to_generic_chunk

* _build_complete_streaming_response

* test_anthropic_basic_completion_with_headers

* test_anthropic_streaming_with_headers

* improve test for pass through token counting
2025-02-27 15:43:03 -08:00
Ishaan Jaff
ef6ab91ac2 (Fixes) OpenAI Streaming Token Counting + Fixes usage track when litellm.turn_off_message_logging=True (#8156)
* working streaming usage tracking

* fix test_async_chat_openai_stream_options

* fix await asyncio.sleep(1)

* test_async_chat_azure

* fix s3 logging

* fix get_stream_options

* fix get_stream_options

* fix streaming handler

* test_stream_token_counting_with_redaction

* fix codeql concern
2025-01-31 15:06:37 -08:00