1629 commits

Author	SHA1	Message	Date
Ishaan Jaff	57e5c94360	Merge branch 'main' into litellm_arize_dynamic_logging	2025-03-18 22:13:35 -07:00
Ishaan Jaff	c101fe9b5d	Merge pull request #9352 from BerriAI/litellm_arize_mar_18 ... [Bug Fix] Arize AI Logging Integration with LiteLLM	2025-03-18 22:12:46 -07:00
Ishaan Jaff	412ad0d64e	test_arize_callback	2025-03-18 20:21:23 -07:00
Krrish Dholakia	a3d000baaa	fix(test_base_routing_strategy.py): add unit testing for new base routing strategy test	2025-03-18 19:59:06 -07:00
Ishaan Jaff	19a7bfa6b5	test_arize_callback	2025-03-18 18:49:06 -07:00
Ishaan Jaff	00795f2bbf	test arize logging	2025-03-18 18:40:39 -07:00
Ishaan Jaff	65083ca8da	get_openai_client_cache_key	2025-03-18 18:35:50 -07:00
Ishaan Jaff	40418c7bd8	test_openai_client_reuse	2025-03-18 18:13:36 -07:00
Ishaan Jaff	d5150e000d	test openai common utils	2025-03-18 18:08:24 -07:00
Krrish Dholakia	a34cc2031d	fix(response_metadata.py): log the litellm_model_name ... make it easier to track the model sent to the provider	2025-03-18 17:46:33 -07:00
Krrish Dholakia	8ed3483adb	test(test_tpm_rpm_routing_v2.py): initial test, for asserting async pre call check works as expected	2025-03-18 17:36:55 -07:00
Ishaan Jaff	bdf77f6f4b	fix ensure async client test	2025-03-18 17:29:10 -07:00
Ishaan Jaff	c010cdef59	test_dynamic_azure_params	2025-03-18 17:26:23 -07:00
Krrish Dholakia	39ac9e3eca	fix(lowest_tpm_rpm_v2.py): fix updating limits	2025-03-18 17:10:17 -07:00
Ishaan Jaff	41d9cc14be	test_async_dynamic_arize_config	2025-03-18 15:02:22 -07:00
Ishaan Jaff	3e0df0fc1e	test_arize_set_attributes	2025-03-18 14:31:34 -07:00
Ishaan Jaff	959299c8ea	Merge pull request #9338 from nate-mar/arize-integration-fixes ... Arize integration Fix	2025-03-18 14:28:25 -07:00
Ishaan Jaff	55ea2370ba	Union[TranscriptionResponse, Coroutine[Any, Any, TranscriptionResponse]]:	2025-03-18 14:23:14 -07:00
Ishaan Jaff	6987a73e36	initialize_azure_sdk_client	2025-03-18 12:27:17 -07:00
Krrish Dholakia	00b338cb9c	test: refactor testing to handle routing correctly	2025-03-18 12:24:12 -07:00
Krrish Dholakia	267084a1af	test(test_get_llm_provider.py): cover scenario where xai not in model name	2025-03-18 11:04:59 -07:00
Krrish Dholakia	aeec703c4e	test(test_get_llm_provider.py): Minimal repro for https://github.com/BerriAI/litellm/issues/9291	2025-03-18 10:35:50 -07:00
Ishaan Jaff	f2026ef907	fix - correctly re-use azure openai client	2025-03-18 09:51:28 -07:00
Nate Mar	9f9e555342	Update test_arize_ai.py	2025-03-18 04:04:44 -07:00
Nate Mar	6b821fbbc0	restore previous formatting	2025-03-18 04:02:43 -07:00
Nate Mar	a1d188ba5e	Fix test and add comments	2025-03-18 03:46:53 -07:00
Nate Mar	434e262b8c	revert space_key change and add tests for arize integration	2025-03-18 01:40:10 -07:00
Krrish Dholakia	b341b788a5	test: update testing	2025-03-17 22:34:08 -07:00
Krish Dholakia	bcbb88d802	Merge pull request #9326 from andjsmi/main ... Modify completion handler for SageMaker to use payload from `prepared_request`	2025-03-17 22:16:43 -07:00
Ishaan Jaff	d42f84dd4e	Merge pull request #9328 from BerriAI/litellm_control_internal_user_settings_ui ... [UI] - Allow controlling default internal user settings on ui	2025-03-17 22:07:47 -07:00
Krish Dholakia	cd5024f3b1	Merge pull request #9333 from BerriAI/litellm_dev_03_17_2025_p2 ... fix(ollama/completions/transformation.py): pass prompt, untemplated o…	2025-03-17 21:48:30 -07:00
Ishaan Jaff	5400615ce8	Merge pull request #9329 from BerriAI/litellm_fix_reset_budget_job ... [Bug fix] Reset Budget Job	2025-03-17 21:46:08 -07:00
Nate Mar	35e0856f11	Fix wrong import and use space_id instead of space_key for Arize integration	2025-03-17 20:37:28 -07:00
Krish Dholakia	27768a4866	Merge pull request #9330 from BerriAI/litellm_dev_03_17_2025_p1 ... Litellm dev 03 17 2025 p1	2025-03-17 19:57:25 -07:00
Ishaan Jaff	fbace8d041	unit test reset budget job	2025-03-17 19:54:51 -07:00
Ishaan Jaff	63a32ff02c	test_reset_budget_job	2025-03-17 19:37:09 -07:00
Krrish Dholakia	22faf7d232	fix(ollama/completions/transformation.py): pass prompt, untemplated on /completions request ... Fixes https://github.com/BerriAI/litellm/issues/6900	2025-03-17 18:35:44 -07:00
Ishaan Jaff	b4568762d2	update_internal_user_settings	2025-03-17 18:26:42 -07:00
Krrish Dholakia	359b8298f8	test(test_assemble_streaming_responses.py): update test to use correct type	2025-03-17 18:17:01 -07:00
Krrish Dholakia	c4b2e0ae3d	fix(streaming_handler.py): support logging complete streaming response on cache hit	2025-03-17 18:10:39 -07:00
Krrish Dholakia	dd9e79adbd	fix(streaming_handler.py): emit deep copy of completed chunk	2025-03-17 17:26:21 -07:00
Andrew Smith	1b2439cb82	Merge branch 'BerriAI:main' into main	2025-03-18 11:10:02 +11:00
Andrew Smith	d5274efe62	Update test_sagemaker.py to match changed parameters	2025-03-18 11:09:52 +11:00
Krrish Dholakia	8e27b2026a	fix(http_handler.py): support reading ssl security level from env var ... Allows user to specify lower security settings	2025-03-17 15:48:31 -07:00
Krrish Dholakia	078e2d341b	feat(cost_calculator.py): support reading litellm response cost header in client sdk ... allows consistent cost tracking when sdk is calling proxy	2025-03-17 15:12:01 -07:00
Krrish Dholakia	db92956ae3	fix(redis_cache.py): add 5s default timeout	2025-03-17 14:27:36 -07:00
Krish Dholakia	d0d8ec2c40	Merge branch 'main' into litellm_dev_03_16_2025_p1	2025-03-17 10:02:53 -07:00
Krrish Dholakia	8618295911	test: loosen test	2025-03-17 09:44:22 -07:00
Krrish Dholakia	d01361747d	test: make test less flaky	2025-03-17 09:00:15 -07:00
Krrish Dholakia	a5b497667c	fix(logging_utils.py): revert change	2025-03-16 21:04:41 -07:00