13483 commits

Author	SHA1	Message	Date
Krrish Dholakia	3033c40739	fix(base_routing_strategy.py): fix base to handle no running event loop ... run in a separate thread	2025-03-18 22:20:39 -07:00
Ishaan Jaff	0f2e095b6b	_arize_otel_logger	2025-03-18 22:19:51 -07:00
Ishaan Jaff	57e5c94360	Merge branch 'main' into litellm_arize_dynamic_logging	2025-03-18 22:13:35 -07:00
Ishaan Jaff	c101fe9b5d	Merge pull request #9352 from BerriAI/litellm_arize_mar_18 ... [Bug Fix] Arize AI Logging Integration with LiteLLM	2025-03-18 22:12:46 -07:00
Krrish Dholakia	a3d000baaa	fix(test_base_routing_strategy.py): add unit testing for new base routing strategy test	2025-03-18 19:59:06 -07:00
Krrish Dholakia	ef008138a3	feat(base_routing_strategy.py): handle updating in-memory keys	2025-03-18 19:44:04 -07:00
Krrish Dholakia	1328afe612	fix(lowest_tpm_rpm_v2.py): support batch writing increments to redis	2025-03-18 19:09:53 -07:00
Ishaan Jaff	65083ca8da	get_openai_client_cache_key	2025-03-18 18:35:50 -07:00
Krish Dholakia	24fbadf072	Merge pull request #9355 from BerriAI/litellm_dev_03_18_2025_p1 ... Litellm dev 03 18 2025 p1	2025-03-18 18:34:06 -07:00
Ishaan Jaff	3daef0d740	fix common utils	2025-03-18 17:59:46 -07:00
Ishaan Jaff	a45830dac3	use common caching logic for openai/azure clients	2025-03-18 17:57:03 -07:00
Ishaan Jaff	f73e9047dc	use common logic for re-using openai clients	2025-03-18 17:56:32 -07:00
Krrish Dholakia	a34cc2031d	fix(response_metadata.py): log the litellm_model_name ... make it easier to track the model sent to the provider	2025-03-18 17:46:33 -07:00
Krrish Dholakia	453729b6c9	fix(litellm_logging.py): fix update	2025-03-18 17:18:58 -07:00
Krrish Dholakia	39ac9e3eca	fix(lowest_tpm_rpm_v2.py): fix updating limits	2025-03-18 17:10:17 -07:00
Ishaan Jaff	78a5dde31f	fix code qa	2025-03-18 17:07:44 -07:00
Ishaan Jaff	bd122f631e	fix arize config	2025-03-18 16:54:31 -07:00
Krrish Dholakia	cfe94c86cc	fix(lowest_tpm_rpm_routing_v2.py): fix deployment update to use correct keys	2025-03-18 16:28:37 -07:00
Krrish Dholakia	9bf6028f14	fix(lowest_tpm_rpm_v2.py): update key to use model name	2025-03-18 16:19:47 -07:00
Ishaan Jaff	de97cda445	refactor create_litellm_proxy_request_started_spen	2025-03-18 16:12:16 -07:00
Ishaan Jaff	f4b7b49e9a	fix arize logging	2025-03-18 15:51:58 -07:00
Ishaan Jaff	7a5726fc88	fix - Arize - only log LLM I/O	2025-03-18 15:50:38 -07:00
Ishaan Jaff	f8c49175ec	fix _get_span_processor	2025-03-18 14:59:13 -07:00
Ishaan Jaff	b940c969fd	use _get_headers_dictionary	2025-03-18 14:55:39 -07:00
Ishaan Jaff	57d08531a1	add arize_api_key to StandardCallbackDynamicParams	2025-03-18 14:46:55 -07:00
Ishaan Jaff	48663a0920	use safe dumps for arize ai	2025-03-18 14:30:00 -07:00
Ishaan Jaff	959299c8ea	Merge pull request #9338 from nate-mar/arize-integration-fixes ... Arize integration Fix	2025-03-18 14:28:25 -07:00
Ishaan Jaff	55ea2370ba	Union[TranscriptionResponse, Coroutine[Any, Any, TranscriptionResponse]]:	2025-03-18 14:23:14 -07:00
Ishaan Jaff	7384d45ef0	fix type errors on transcription azure	2025-03-18 14:22:30 -07:00
Ishaan Jaff	b20a69f9fc	fix code quality	2025-03-18 12:58:59 -07:00
Emerson Gomes	1cc832f53e	Fix TTFT prioritization for streaming in LowestLatencyLoggingHandler	2025-03-18 14:58:55 -05:00
Ishaan Jaff	dc3d7b3afc	test_azure_instruct	2025-03-18 12:56:11 -07:00
Ishaan Jaff	2cd49ef096	fix test_ensure_initialize_azure_sdk_client_always_used	2025-03-18 12:46:55 -07:00
Ishaan Jaff	b60178f534	fix azure chat logic	2025-03-18 12:42:24 -07:00
Ishaan Jaff	80a5cfa01d	test_azure_embedding_max_retries_0	2025-03-18 12:35:34 -07:00
Ishaan Jaff	b316911120	fix typing errors	2025-03-18 12:31:44 -07:00
Ishaan Jaff	842625a6f0	:test_completion_azure_ad_toke	2025-03-18 12:25:32 -07:00
Ishaan Jaff	d4b3082ca2	fix azure embedding test	2025-03-18 12:19:12 -07:00
Ishaan Jaff	5e892a1e92	ui new build	2025-03-18 11:46:23 -07:00
Ishaan Jaff	38e2dd00cc	fix amebedding issue on ssl azure	2025-03-18 11:42:11 -07:00
Ishaan Jaff	dfd7a7d547	fix linting error	2025-03-18 11:38:31 -07:00
Ishaan Jaff	3458c69eb0	fix common utils	2025-03-18 11:04:02 -07:00
Krrish Dholakia	2c094c2356	fix(get_llm_provider.py): Fixes https://github.com/BerriAI/litellm/issues/9291	2025-03-18 10:48:28 -07:00
Ishaan Jaff	c1e0cb136e	fix using azure openai clients	2025-03-18 10:47:29 -07:00
Ishaan Jaff	e34be5a3b6	use get_azure_openai_client	2025-03-18 10:28:39 -07:00
Ishaan Jaff	a0c5fb81b8	fix logic for intializing openai clients	2025-03-18 10:23:30 -07:00
Ishaan Jaff	0601768bb8	use ssl on initialize_azure_sdk_client	2025-03-18 10:14:51 -07:00
Ishaan Jaff	34142a1b62	_init_azure_client_for_cloudflare_ai_gateway	2025-03-18 10:11:54 -07:00
Ishaan Jaff	edfbf21c39	fix re-using azure openai client	2025-03-18 10:06:56 -07:00
Ishaan Jaff	f2026ef907	fix - correctly re-use azure openai client	2025-03-18 09:51:28 -07:00