Commit graph

2221 commits

Author SHA1 Message Date
Sunny Wan
c942f4cd86 Merge branch 'main' of https://github.com/SunnyWan59/litellm 2025-03-13 19:42:25 -04:00
Sunny Wan
70770b6aa4 Removed unnecessary code and refactored 2025-03-13 19:42:10 -04:00
Sunny Wan
f9a5109203
Merge branch 'BerriAI:main' into main 2025-03-13 19:37:22 -04:00
Krrish Dholakia
0af6cde994 fix(invoke_handler.py): support cache token tracking on converse streaming 2025-03-13 16:10:13 -07:00
Krrish Dholakia
f99b1937db feat(converse_transformation.py): translate converse usage block with cache creation values to openai format 2025-03-13 15:49:25 -07:00
Krrish Dholakia
5ffd3f56f8 fix(azure.py): track azure llm api latency metric 2025-03-13 14:47:35 -07:00
Krish Dholakia
2c011d9a93
Merge pull request #9123 from omrishiv/8911-fix-model-encoding
Fixes bedrock modelId encoding for Inference Profiles
2025-03-13 10:42:32 -07:00
Krish Dholakia
58e5f3e0c9
Merge pull request #9193 from youngchannelforyou/feat/gemini_response_status_code
(gemini)Handle HTTP 201 status code in Vertex AI response
2025-03-12 22:24:01 -07:00
Krish Dholakia
cff1c1f7d8
Merge branch 'main' into litellm_dev_03_12_2025_p1 2025-03-12 22:14:02 -07:00
sven
8d053930e9 (gemini)Handle HTTP 201 status code in Vertex AI response 2025-03-13 13:44:38 +09:00
Krrish Dholakia
88e9edf7db refactor: update method signature 2025-03-12 15:23:38 -07:00
Krrish Dholakia
738c0b873d fix(azure_ai/transformation.py): support passing api version to azure ai services endpoint
Fixes https://github.com/BerriAI/litellm/issues/7275
2025-03-12 15:16:42 -07:00
Krish Dholakia
2d957a0ed9
Merge branch 'main' into litellm_dev_03_10_2025_p3 2025-03-12 14:56:01 -07:00
Ishaan Jaff
2460f3cbab test_validate_environment 2025-03-12 12:57:40 -07:00
Ishaan Jaff
39d391d8e7 Optional[Dict] 2025-03-12 12:29:13 -07:00
Ishaan Jaff
342741ede1 Merge branch 'main' into litellm_responses_api_support 2025-03-12 12:04:12 -07:00
Ishaan Jaff
181072e15d fix code quality checks 2025-03-12 11:47:10 -07:00
Ishaan Jaff
047879c004 add aresponses 2025-03-12 09:22:44 -07:00
Ishaan Jaff
4ff6e41c15 ResponsesAPIStreamEvents 2025-03-11 23:42:35 -07:00
Ishaan Jaff
278b6fb5f6 add debug logging 2025-03-11 23:13:10 -07:00
Krish Dholakia
a7e0e7283e
Merge pull request #9166 from BerriAI/litellm_dev_03_11_2025_p2
Litellm dev 03 11 2025 p2
2025-03-11 22:51:20 -07:00
Krish Dholakia
8c0bf06c87
Merge branch 'main' into litellm_dev_contributor_prs_03_10_2025_p1 2025-03-11 22:50:02 -07:00
Krrish Dholakia
b8d590da0c fix(azure/audio_transcriptions.py): support azure cost tracking
extract content time and log correctly as duration
2025-03-11 22:25:13 -07:00
Ishaan Jaff
ddb819da45 fix order of imports 2025-03-11 22:04:24 -07:00
Krrish Dholakia
92d85555fe fix(invoke_handler.py): fix converse chunk parsing to only return empty dict on tool use
Fixes https://github.com/BerriAI/litellm/issues/9127
2025-03-11 22:04:17 -07:00
Krrish Dholakia
571d5ed62a fix(audio_transcriptions.py): fix setting client 2025-03-11 21:48:10 -07:00
Krrish Dholakia
1051478e95 fix(azure_ai/): fix transformation to handle when models don't support tool_choice
All checks were successful
Read Version from pyproject.toml / read-version (push) Successful in 15s
Helm unit test / unit-test (push) Successful in 23s
2025-03-11 21:42:24 -07:00
Krrish Dholakia
16224f8db6 fix(o_series_handler.py): handle async calls 2025-03-11 21:22:13 -07:00
Ishaan Jaff
8fa313ab07 add async streaming support 2025-03-11 20:00:42 -07:00
Ishaan Jaff
cb270887a7 ResponsesAPIStreamingIterator 2025-03-11 19:49:09 -07:00
Sunny Wan
f4539fb95a changed to chat/transformations 2025-03-11 22:21:12 -04:00
Krrish Dholakia
9351b45d0c fix: fix linting errors 2025-03-11 18:49:55 -07:00
Krrish Dholakia
145cd483b9 fix(handler.py): same as last commit 2025-03-11 18:48:12 -07:00
Krrish Dholakia
2469072c50 fix: remove unused imports 2025-03-11 18:15:10 -07:00
Krrish Dholakia
9b588f53f5 fix: fix linting error 2025-03-11 18:08:01 -07:00
Krrish Dholakia
58888f117c feat(azure.py): fix azure client init 2025-03-11 18:05:11 -07:00
Krrish Dholakia
3bc7c35cb5 fix: consistent usage of http_client across azure client init 2025-03-11 17:48:31 -07:00
Krrish Dholakia
9af73f339a test: fix tests 2025-03-11 17:42:36 -07:00
Ishaan Jaff
f32968409e working basic openai response api request 2025-03-11 17:37:19 -07:00
Krrish Dholakia
cbc2e84044 refactor(azure.py): refactor to have client init work across all endpoints 2025-03-11 17:27:24 -07:00
Ishaan Jaff
b3999b4c75 transform_response_api_response 2025-03-11 17:03:31 -07:00
Ishaan Jaff
d3575f0a31 working async_response_api_handler 2025-03-11 16:58:43 -07:00
Ishaan Jaff
dff8308e92 add transform_response_api_response 2025-03-11 16:53:18 -07:00
Ishaan Jaff
0f8de3d0a5 add transform_request for OpenAI responses API 2025-03-11 16:33:26 -07:00
Ishaan Jaff
c7e8534df4 BaseResponsesAPIConfig 2025-03-11 16:14:14 -07:00
Ishaan Jaff
980354b78b add validate_environment, get_complete_url 2025-03-11 16:12:36 -07:00
Ishaan Jaff
2c6774e3ee get_optional_params_responses_api 2025-03-11 16:00:49 -07:00
Ishaan Jaff
4d55212c62 add BaseResponsesAPIConfig 2025-03-11 15:57:53 -07:00
Ishaan Jaff
401a52e694 working transform 2025-03-11 15:24:42 -07:00
Ishaan Jaff
368f1de2e1 add OpenAIResponsesAPIConfig 2025-03-11 15:10:34 -07:00