Commit graph

1677 commits

Author SHA1 Message Date
Krrish Dholakia
5dc46f0cf7 fix(converse_transformation.py): fix encoding model 2025-03-15 14:03:37 -07:00
Krrish Dholakia
612d5a284d refactor(litellm_logging.py): delegate returning a complete response to the streaming_handler
Removes incorrect logic for calculating complete streaming response from litellm logging
2025-03-15 09:55:33 -07:00
Krrish Dholakia
cc82d42d25 test(test_streaming_handler.py): add unit test to ensure model response stream with usage is always used 2025-03-15 09:35:48 -07:00
Krrish Dholakia
82252ecac1 test(test_streaming_handler.py): assert chunk is non-empty when usage block given 2025-03-15 09:26:01 -07:00
Krrish Dholakia
dd2c980d5b fix(utils.py): Prevents final chunk w/ usage from being ignored
Fixes https://github.com/BerriAI/litellm/issues/7112
2025-03-15 09:12:14 -07:00
Krish Dholakia
d4caaae1be
Merge pull request #9274 from BerriAI/litellm_contributor_rebase_branch
All checks were successful
Read Version from pyproject.toml / read-version (push) Successful in 43s
Helm unit test / unit-test (push) Successful in 50s
Litellm contributor rebase branch
2025-03-14 21:57:49 -07:00
Krish Dholakia
82f31beee5
Merge pull request #9271 from BerriAI/litellm_rc_03_14_2025_patch_1
Litellm rc 03 14 2025 patch 1
2025-03-14 20:57:22 -07:00
Krrish Dholakia
6ed995952f fix: fix test 2025-03-14 20:28:50 -07:00
Krish Dholakia
59fd58643b
Merge pull request #9261 from briandevvn/fix_ollama_pt
Fix "system" role has become unacceptable in ollama
2025-03-14 20:13:28 -07:00
Krrish Dholakia
c2f01b0fdc fix(router.py): add new test 2025-03-14 14:23:45 -07:00
Brian Dev
ff3f79e468 Update test_ollama_pt 2025-03-15 01:07:15 +07:00
Brian Dev
51589364a1 Add new line 2025-03-15 01:03:12 +07:00
Brian Dev
12db28b0af Support 'system' role ollama 2025-03-15 00:55:18 +07:00
Lucas Raschek
88798d4b3d Add unit test 2025-03-14 18:14:41 +01:00
Ishaan Jaff
276a7089df
Merge pull request #9220 from BerriAI/litellm_qa_responses_api
[Fixes] Responses API - allow /responses and subpaths as LLM API route + Add exception mapping for responses API
2025-03-13 21:36:59 -07:00
Ishaan Jaff
241a36a74f
Merge pull request #9222 from BerriAI/litellm_snowflake_pr_mar_13
[Feat] Add Snowflake Cortex to LiteLLM
2025-03-13 21:35:39 -07:00
Krish Dholakia
f89dbb8ab3
Merge branch 'main' into litellm_dev_03_13_2025_p3 2025-03-13 20:12:16 -07:00
Krish Dholakia
e8c67f25e3
Merge pull request #9221 from BerriAI/litellm_dev_03_13_2025_p2
Support bedrock converse cache token tracking
2025-03-13 20:08:33 -07:00
Krish Dholakia
fd8a5960ec
Merge pull request #9216 from BerriAI/litellm_dev_03_12_2025_contributor_prs_p2
Litellm dev 03 12 2025 contributor prs p2
2025-03-13 20:03:57 -07:00
Krrish Dholakia
8a6e4715aa feat(converse_transformation.py): fix type for bedrock cache usage block 2025-03-13 19:33:22 -07:00
Krrish Dholakia
81abb9c6a4 test: fix tests 2025-03-13 19:26:10 -07:00
Ishaan Jaff
7dd55ce70c fix @pytest.mark.skip(reason="lakera deprecated their v1 endpoint.") 2025-03-13 17:49:37 -07:00
Sunny Wan
f9a5109203
Merge branch 'BerriAI:main' into main 2025-03-13 19:37:22 -04:00
Ishaan Jaff
d41856ce3d test_bad_request_bad_param_error 2025-03-13 16:02:21 -07:00
Ishaan Jaff
3b632ac825 test_async_bad_request_bad_param_error 2025-03-13 15:57:19 -07:00
Krrish Dholakia
96bba9354e test(tests/litellm): add unit test for transform usage function 2025-03-13 15:56:55 -07:00
Krrish Dholakia
f99b1937db feat(converse_transformation.py): translate converse usage block with cache creation values to openai format 2025-03-13 15:49:25 -07:00
Ishaan Jaff
63783383e7 add basic validation tests for e2e responses create endpoint 2025-03-13 15:25:50 -07:00
Krrish Dholakia
f17bc60593 test: patch test to avoid lakera changes to sensitivity 2025-03-13 15:18:08 -07:00
Ishaan Jaff
e9f3d97eb0 working e2e tests for responses api 2025-03-13 15:17:47 -07:00
Ishaan Jaff
08f4a6844b rename folder to test openai endpoints 2025-03-13 15:13:48 -07:00
Krrish Dholakia
86ed6be85e fix: fix learnlm test 2025-03-13 10:54:09 -07:00
Krish Dholakia
a2414d09c1
Merge pull request #8356 from hakasecurity/feature/aim-post-call
Aim Security post-call guardrails support
2025-03-13 10:48:42 -07:00
Krish Dholakia
2c011d9a93
Merge pull request #9123 from omrishiv/8911-fix-model-encoding
Fixes bedrock modelId encoding for Inference Profiles
2025-03-13 10:42:32 -07:00
Tomer Bin
4a31b32a88 Support post-call guards for stream and non-stream responses 2025-03-13 08:53:54 +02:00
Krish Dholakia
58e5f3e0c9
Merge pull request #9193 from youngchannelforyou/feat/gemini_response_status_code
(gemini)Handle HTTP 201 status code in Vertex AI response
2025-03-12 22:24:01 -07:00
Krish Dholakia
cff1c1f7d8
Merge branch 'main' into litellm_dev_03_12_2025_p1 2025-03-12 22:14:02 -07:00
sven
2d4e58cf23 add test code 2025-03-13 14:00:12 +09:00
Ishaan Jaff
e0252a9b49 test_initialize_router_endpoints 2025-03-12 19:27:32 -07:00
Ishaan Jaff
ac928ebb16 test_initialize_router_endpoints 2025-03-12 19:24:25 -07:00
Ishaan Jaff
b055aae5ca test_generic_api_call_with_fallbacks_basic 2025-03-12 19:16:05 -07:00
Ishaan Jaff
ee47016300 test_openai_responses_litellm_router_with_metadata 2025-03-12 18:55:02 -07:00
Ishaan Jaff
d623183eee test_ensure_initialize_azure_sdk_client_always_used 2025-03-12 18:51:19 -07:00
Ishaan Jaff
c82ef41dc4 test_openai_responses_litellm_router_no_metadata 2025-03-12 18:18:07 -07:00
Krrish Dholakia
84514f0397 test: fix test 2025-03-12 16:51:01 -07:00
Krrish Dholakia
81d8a35348 fix: skip datazone models 2025-03-12 16:43:38 -07:00
Ishaan Jaff
d808fa3c23 test_openai_responses_litellm_router 2025-03-12 16:13:48 -07:00
Krrish Dholakia
3714694c60 fix: fix method signature in test 2025-03-12 15:32:35 -07:00
Krrish Dholakia
738c0b873d fix(azure_ai/transformation.py): support passing api version to azure ai services endpoint
Fixes https://github.com/BerriAI/litellm/issues/7275
2025-03-12 15:16:42 -07:00
Krish Dholakia
2d957a0ed9
Merge branch 'main' into litellm_dev_03_10_2025_p3 2025-03-12 14:56:01 -07:00