Ishaan Jaff
|
b6f2e659b9
|
(Feat) Add x-litellm-overhead-duration-ms and "x-litellm-response-duration-ms" in response from LiteLLM (#7899)
* add track_llm_api_timing
* add track_llm_api_timing
* test_litellm_overhead
* use ResponseMetadata class for setting hidden params and response overhead
* instrument http handler
* fix track_llm_api_timing
* track_llm_api_timing
* emit response overhead on hidden params
* fix resp metadata
* fix make_sync_openai_embedding_request
* test_aaaaatext_completion_endpoint fixes
* _get_value_from_hidden_params
* set_hidden_params
* test_litellm_overhead
* test_litellm_overhead
* test_litellm_overhead
* fix import
* test_litellm_overhead_stream
* add LiteLLMLoggingObject
* use diff folder for testing
* use diff folder for overhead testing
* test litellm overhead
* use typing
* clear typing
* test_litellm_overhead
* fix async_streaming
* update_response_metadata
* move test file
* pply metadata to the response objec
|
2025-01-21 20:27:55 -08:00 |
|