Commit graph

20570 commits

Author SHA1 Message Date
Krrish Dholakia
3ba0df484e fix(lowest_tpm_rpm_v2.py): fix updating limits 2025-03-18 17:10:17 -07:00
Ishaan Jaff
182e2ef7dc fix code qa 2025-03-18 17:07:44 -07:00
Ishaan Jaff
c153fd3656 fix arize config 2025-03-18 16:54:31 -07:00
Krrish Dholakia
71ea42cbeb fix(lowest_tpm_rpm_routing_v2.py): fix deployment update to use correct keys 2025-03-18 16:28:37 -07:00
Krrish Dholakia
6756bf7735 fix(lowest_tpm_rpm_v2.py): update key to use model name 2025-03-18 16:19:47 -07:00
Ishaan Jaff
9144f25a69 refactor create_litellm_proxy_request_started_spen 2025-03-18 16:12:16 -07:00
Ishaan Jaff
063db7ba91 fix arize logging 2025-03-18 15:51:58 -07:00
Ishaan Jaff
c0351bbc37 fix - Arize - only log LLM I/O 2025-03-18 15:50:38 -07:00
Ishaan Jaff
b095332c20 test_async_dynamic_arize_config 2025-03-18 15:02:22 -07:00
Ishaan Jaff
ac4b0bd36a fix _get_span_processor 2025-03-18 14:59:13 -07:00
Ishaan Jaff
0237892c7d use _get_headers_dictionary 2025-03-18 14:55:39 -07:00
Ishaan Jaff
6468937b44 add arize_api_key to StandardCallbackDynamicParams 2025-03-18 14:46:55 -07:00
Ishaan Jaff
8a9d05a62f test_arize_set_attributes 2025-03-18 14:31:34 -07:00
Ishaan Jaff
f1b237aed7 use safe dumps for arize ai 2025-03-18 14:30:00 -07:00
Ishaan Jaff
608d69f396 Merge pull request #9338 from nate-mar/arize-integration-fixes
Arize integration Fix
2025-03-18 14:28:25 -07:00
Ishaan Jaff
caca5a1b58 Union[TranscriptionResponse, Coroutine[Any, Any, TranscriptionResponse]]: 2025-03-18 14:23:14 -07:00
Ishaan Jaff
fbc0c8b116 fix type errors on transcription azure 2025-03-18 14:22:30 -07:00
Ishaan Jaff
7e2d383885 fix code quality 2025-03-18 12:58:59 -07:00
Emerson Gomes
8a3dba52ad Fix TTFT prioritization for streaming in LowestLatencyLoggingHandler 2025-03-18 14:58:55 -05:00
Ishaan Jaff
0173ca3ad3 test_azure_instruct 2025-03-18 12:56:11 -07:00
Ishaan Jaff
94ac105c23 fix test_ensure_initialize_azure_sdk_client_always_used 2025-03-18 12:46:55 -07:00
Ishaan Jaff
70e80d2149 fix azure chat logic 2025-03-18 12:42:24 -07:00
Ishaan Jaff
069d14ad91 test_azure_embedding_max_retries_0 2025-03-18 12:35:34 -07:00
Ishaan Jaff
17e0742334 fix typing errors 2025-03-18 12:31:44 -07:00
Ishaan Jaff
3261c66b39 initialize_azure_sdk_client 2025-03-18 12:27:17 -07:00
Ishaan Jaff
b3bc8a3231 :test_completion_azure_ad_toke 2025-03-18 12:25:32 -07:00
Krrish Dholakia
e1860c3d9d test: refactor testing to handle routing correctly 2025-03-18 12:24:12 -07:00
Ishaan Jaff
57bb599b47 fix azure embedding test 2025-03-18 12:19:12 -07:00
Ishaan Jaff
27494ca5e7 ui new build 2025-03-18 11:46:23 -07:00
Ishaan Jaff
dbf1e34510 ui fix linting error 2025-03-18 11:45:22 -07:00
Ishaan Jaff
9d23214e87 fix amebedding issue on ssl azure 2025-03-18 11:42:11 -07:00
Ishaan Jaff
40736c3263 fix linting error 2025-03-18 11:38:31 -07:00
Krrish Dholakia
cf1b5b6590 test(test_get_llm_provider.py): cover scenario where xai not in model name 2025-03-18 11:04:59 -07:00
Ishaan Jaff
e3752cd32a fix common utils 2025-03-18 11:04:02 -07:00
Krrish Dholakia
f0da181215 fix(get_llm_provider.py): Fixes https://github.com/BerriAI/litellm/issues/9291 2025-03-18 10:48:28 -07:00
Ishaan Jaff
6bd6a2065a fix using azure openai clients 2025-03-18 10:47:29 -07:00
Krrish Dholakia
e1f0cffae7 test(test_get_llm_provider.py): Minimal repro for https://github.com/BerriAI/litellm/issues/9291 2025-03-18 10:35:50 -07:00
Ishaan Jaff
77d14fa038 use get_azure_openai_client 2025-03-18 10:28:39 -07:00
Ishaan Jaff
1ede6080ef fix logic for intializing openai clients 2025-03-18 10:23:30 -07:00
Ishaan Jaff
7bb90a15be use ssl on initialize_azure_sdk_client 2025-03-18 10:14:51 -07:00
Ishaan Jaff
cb55069a70 _init_azure_client_for_cloudflare_ai_gateway 2025-03-18 10:11:54 -07:00
Ishaan Jaff
860d96a01e fix re-using azure openai client 2025-03-18 10:06:56 -07:00
Ishaan Jaff
8b54873e9f fix - correctly re-use azure openai client 2025-03-18 09:51:28 -07:00
Ishaan Jaff
d991b3c398 _get_azure_openai_client 2025-03-18 09:38:27 -07:00
Ishaan Jaff
9e00fa8221 rename to _get_azure_openai_client 2025-03-18 09:25:26 -07:00
Krrish Dholakia
59d257a7c1 build(pyproject.toml): add boto3 to proxy deps on pyproject
fix issue with running unit tests
2025-03-18 09:15:45 -07:00
Ishaan Jaff
dd995945a0 docs - update release notes with known issue 2025-03-18 09:11:54 -07:00
Ishaan Jaff
01ed8e8a23 docs release notes Azure OpenAI 2025-03-18 09:10:59 -07:00
Krrish Dholakia
38c8f6c2c5 bump: version 1.63.11 → 1.63.12 2025-03-18 09:02:42 -07:00
Ishaan Jaff
3aa1e78ec3 handle _get_async_http_client for OpenAI 2025-03-18 08:56:08 -07:00