Ishaan Jaff
3a6349d871
(Feat) - Add support for structured output on bedrock/nova models + add util litellm.supports_tool_choice ( #8264 )
...
* fix supports_tool_choice
* TestBedrockNovaJson
* use supports_tool_choice
* fix supports_tool_choice
* add supports_tool_choice param
* script to add fields to model cost map
* test_supports_tool_choice
* test_supports_tool_choice
* fix supports tool choice check
* test_supports_tool_choice_simple_tests
* fix supports_tool_choice check
* fix supports_tool_choice bedrock
* test_supports_tool_choice
* test_supports_tool_choice
* fix bedrock/eu-west-3/mistral.mistral-large-2402-v1:0
* ci/cd run again
* test_supports_tool_choice_simple_tests
* TestGoogleAIStudioGemini temp - remove to run ci/cd
* test_aaalangfuse_logging_metadata
* TestGoogleAIStudioGemini
* test_check_provider_match
* remove add param to map
2025-02-04 21:47:16 -08:00
Ishaan Jaff
8a235e7d38
(Refactor / QA) - Use LoggingCallbackManager to append callbacks and ensure no duplicate callbacks are added ( #8112 )
...
* LoggingCallbackManager
* add logging_callback_manager
* use logging_callback_manager
* add add_litellm_failure_callback
* use add_litellm_callback
* use add_litellm_async_success_callback
* add_litellm_async_failure_callback
* linting fix
* fix logging callback manager
* test_duplicate_multiple_loggers_test
* use _reset_all_callbacks
* fix testing with dup callbacks
* test_basic_image_generation
* reset callbacks for tests
* fix check for _add_custom_logger_to_list
* fix test_amazing_sync_embedding
* fix _get_custom_logger_key
* fix batches testing
* fix _reset_all_callbacks
* fix _check_callback_list_size
* add callback_manager_test
* fix test gemini-2.0-flash-thinking-exp-01-21
2025-01-30 19:35:50 -08:00
Ishaan Jaff
b812286534
(fix) - proxy reliability, ensure duplicate callbacks are not added to proxy ( #8067 )
...
* refactor _add_callbacks_from_db_config
* fix check for _custom_logger_exists_in_litellm_callbacks
* move loc of test utils
* run ci/cd again
* test_add_custom_logger_callback_to_specific_event_with_duplicates_callbacks
* fix _custom_logger_class_exists_in_success_callbacks
* unit testing for test_add_callbacks_from_db_config
* test_custom_logger_exists_in_callbacks_individual_functions
* fix config.yml
* fix test test_stream_chunk_builder_openai_audio_output_usage - use direct dict comparison
2025-01-28 21:01:56 -08:00
Ishaan Jaff
b6f2e659b9
(Feat) Add x-litellm-overhead-duration-ms and "x-litellm-response-duration-ms" in response from LiteLLM ( #7899 )
...
* add track_llm_api_timing
* add track_llm_api_timing
* test_litellm_overhead
* use ResponseMetadata class for setting hidden params and response overhead
* instrument http handler
* fix track_llm_api_timing
* track_llm_api_timing
* emit response overhead on hidden params
* fix resp metadata
* fix make_sync_openai_embedding_request
* test_aaaaatext_completion_endpoint fixes
* _get_value_from_hidden_params
* set_hidden_params
* test_litellm_overhead
* test_litellm_overhead
* test_litellm_overhead
* fix import
* test_litellm_overhead_stream
* add LiteLLMLoggingObject
* use diff folder for testing
* use diff folder for overhead testing
* test litellm overhead
* use typing
* clear typing
* test_litellm_overhead
* fix async_streaming
* update_response_metadata
* move test file
* pply metadata to the response objec
2025-01-21 20:27:55 -08:00
