Ishaan Jaff
|
beb68037d0
|
move web search cost tracking
|
2025-03-22 17:02:43 -07:00 |
|
Ishaan Jaff
|
475dfaa156
|
fixes for web search cost tracking
|
2025-03-22 16:56:32 -07:00 |
|
Ishaan Jaff
|
cf22d31b2b
|
search_context_cost_per_query
|
2025-03-22 14:52:58 -07:00 |
|
Ishaan Jaff
|
bddbeff717
|
test_openai_web_search_logging_cost_tracking
|
2025-03-22 14:29:02 -07:00 |
|
Ishaan Jaff
|
047d1b1208
|
(Bug Fix) - Accurate token counting for /anthropic/ API Routes on LiteLLM Proxy (#8880)
* fix _create_anthropic_response_logging_payload
* fix - pass through don't create standard logging payload
* fix logged key hash
* test_init_kwargs_for_pass_through_endpoint_basic
* test_unit_test_anthropic_pass_through
* fix anthropic pass through logging handler
* test_stream_token_counting_anthropic_with_include_usage
* convert_str_chunk_to_generic_chunk
* _build_complete_streaming_response
* test_anthropic_basic_completion_with_headers
* test_anthropic_streaming_with_headers
* improve test for pass through token counting
|
2025-02-27 15:43:03 -08:00 |
|
Ishaan Jaff
|
2cf0daa31c
|
(Fixes) OpenAI Streaming Token Counting + Fixes usage track when litellm.turn_off_message_logging=True (#8156)
* working streaming usage tracking
* fix test_async_chat_openai_stream_options
* fix await asyncio.sleep(1)
* test_async_chat_azure
* fix s3 logging
* fix get_stream_options
* fix get_stream_options
* fix streaming handler
* test_stream_token_counting_with_redaction
* fix codeql concern
|
2025-01-31 15:06:37 -08:00 |
|