Commit graph

1605 commits

Author SHA1 Message Date
Ishaan Jaff
3fccf5fbef mock langchain MCP interface 2025-03-20 17:18:28 -07:00
Ishaan Jaff
93836fa84a sample mcp server 2025-03-20 15:37:24 -07:00
Ishaan Jaff
15048de5e2 test_prepare_fake_stream_request 2025-03-20 14:50:00 -07:00
Krrish Dholakia
46d68a61c8 fix: fix testing 2025-03-20 14:37:58 -07:00
Krish Dholakia
ab385848c1
Merge pull request #9260 from Grizzly-jobs/fix/voyage-ai-token-usage-tracking
fix: VoyageAI `prompt_token` always empty
2025-03-20 14:00:51 -07:00
Krish Dholakia
706bcf4432
Merge pull request #9366 from JamesGuthrie/jg/vertex-output-dimensionality
fix: VertexAI outputDimensionality configuration
2025-03-20 13:55:33 -07:00
Ishaan Jaff
b04cf226aa test_openai_o1_pro_response_api_streaming 2025-03-20 13:04:49 -07:00
Ishaan Jaff
d915ab3f07 test_openai_o1_pro_response_api 2025-03-20 09:18:38 -07:00
Ishaan Jaff
7fee847ffc test_openai_o1_pro_incomplete_response 2025-03-20 09:14:59 -07:00
Krrish Dholakia
8ef9129556 fix(types/utils.py): support openai 'file' message type
Closes https://github.com/BerriAI/litellm/issues/9365
2025-03-19 23:13:51 -07:00
Krrish Dholakia
fe24b9d90b feat(azure/gpt_transformation.py): add azure audio model support
Closes https://github.com/BerriAI/litellm/issues/6305
2025-03-19 22:57:49 -07:00
Ishaan Jaff
1bd7443c25
Merge pull request #9384 from BerriAI/litellm_prompt_management_custom
[Feat] - Allow building custom prompt management integration
2025-03-19 21:06:41 -07:00
Ishaan Jaff
247e4d09ee
Merge branch 'main' into litellm_fix_ssl_verify 2025-03-19 21:03:06 -07:00
Ishaan Jaff
30fdd934a4 TestCustomPromptManagement 2025-03-19 17:40:15 -07:00
Krish Dholakia
9432d1a865
Merge pull request #9357 from BerriAI/litellm_dev_03_18_2025_p2
fix(lowest_tpm_rpm_v2.py): support batch writing increments to redis
2025-03-19 15:45:10 -07:00
Krrish Dholakia
041d5391eb test(test_proxy_server.py): make test work on ci/cd 2025-03-19 12:01:37 -07:00
Krrish Dholakia
858da57b3c test(test_proxy_server.py): add unit test to ensure get credentials only called behind feature flag 2025-03-19 11:44:00 -07:00
James Guthrie
437dbe7246 fix: VertexAI outputDimensionality configuration
VertexAI's API documentation [1] is an absolute mess. In it, they
describe the parameter to configure output dimensionality as
`output_dimensionality`. In the API example, they switch to using snake
case `outputDimensionality`, which is the correct variant.

[1]: https://cloud.google.com/vertex-ai/generative-ai/docs/model-reference/text-embeddings-api#generative-ai-get-text-embedding-drest
2025-03-19 11:07:36 +01:00
Krish Dholakia
01c6cbd270
Merge pull request #9363 from BerriAI/litellm_dev_03_18_2025_p3
All checks were successful
Read Version from pyproject.toml / read-version (push) Successful in 18s
Helm unit test / unit-test (push) Successful in 21s
fix(common_utils.py): handle cris only model
2025-03-18 23:36:12 -07:00
Krrish Dholakia
9adad381b4 fix(common_utils.py): handle cris only model
Fixes https://github.com/BerriAI/litellm/issues/9161#issuecomment-2734905153
2025-03-18 23:35:43 -07:00
Ishaan Jaff
e32aee9124
Merge pull request #9353 from BerriAI/litellm_arize_dynamic_logging
[Feat] - API - Allow using dynamic Arize AI Spaces on LiteLLM
2025-03-18 23:35:28 -07:00
Krish Dholakia
6347b694ee
Merge pull request #9335 from BerriAI/litellm_dev_03_17_2025_p3
Contributor PR: Fix sagemaker too little data for content error
2025-03-18 23:24:07 -07:00
Ishaan Jaff
8690873488 test_arize_dynamic_params 2025-03-18 23:22:55 -07:00
Ishaan Jaff
8568caf532 test_arize_dynamic_params 2025-03-18 23:18:07 -07:00
Krrish Dholakia
084e8c425c refactor(base_routing_strategy.py): fix function names 2025-03-18 22:41:02 -07:00
Krrish Dholakia
3033c40739 fix(base_routing_strategy.py): fix base to handle no running event loop
run in a separate thread
2025-03-18 22:20:39 -07:00
Ishaan Jaff
57e5c94360 Merge branch 'main' into litellm_arize_dynamic_logging 2025-03-18 22:13:35 -07:00
Ishaan Jaff
c101fe9b5d
Merge pull request #9352 from BerriAI/litellm_arize_mar_18
[Bug Fix] Arize AI Logging Integration with LiteLLM
2025-03-18 22:12:46 -07:00
Ishaan Jaff
412ad0d64e test_arize_callback 2025-03-18 20:21:23 -07:00
Krrish Dholakia
a3d000baaa fix(test_base_routing_strategy.py): add unit testing for new base routing strategy test 2025-03-18 19:59:06 -07:00
Ishaan Jaff
19a7bfa6b5 test_arize_callback 2025-03-18 18:49:06 -07:00
Ishaan Jaff
00795f2bbf test arize logging 2025-03-18 18:40:39 -07:00
Ishaan Jaff
65083ca8da get_openai_client_cache_key 2025-03-18 18:35:50 -07:00
Ishaan Jaff
40418c7bd8 test_openai_client_reuse 2025-03-18 18:13:36 -07:00
Ishaan Jaff
d5150e000d test openai common utils 2025-03-18 18:08:24 -07:00
Krrish Dholakia
a34cc2031d fix(response_metadata.py): log the litellm_model_name
make it easier to track the model sent to the provider
2025-03-18 17:46:33 -07:00
Krrish Dholakia
8ed3483adb test(test_tpm_rpm_routing_v2.py): initial test, for asserting async pre call check works as expected 2025-03-18 17:36:55 -07:00
Ishaan Jaff
bdf77f6f4b fix ensure async client test 2025-03-18 17:29:10 -07:00
Ishaan Jaff
c010cdef59 test_dynamic_azure_params 2025-03-18 17:26:23 -07:00
Krrish Dholakia
39ac9e3eca fix(lowest_tpm_rpm_v2.py): fix updating limits 2025-03-18 17:10:17 -07:00
Ishaan Jaff
41d9cc14be test_async_dynamic_arize_config 2025-03-18 15:02:22 -07:00
Ishaan Jaff
3e0df0fc1e test_arize_set_attributes 2025-03-18 14:31:34 -07:00
Ishaan Jaff
959299c8ea
Merge pull request #9338 from nate-mar/arize-integration-fixes
Arize integration Fix
2025-03-18 14:28:25 -07:00
Ishaan Jaff
55ea2370ba Union[TranscriptionResponse, Coroutine[Any, Any, TranscriptionResponse]]: 2025-03-18 14:23:14 -07:00
Ishaan Jaff
6987a73e36 initialize_azure_sdk_client 2025-03-18 12:27:17 -07:00
Krrish Dholakia
00b338cb9c test: refactor testing to handle routing correctly 2025-03-18 12:24:12 -07:00
Krrish Dholakia
267084a1af test(test_get_llm_provider.py): cover scenario where xai not in model name 2025-03-18 11:04:59 -07:00
Krrish Dholakia
aeec703c4e test(test_get_llm_provider.py): Minimal repro for https://github.com/BerriAI/litellm/issues/9291 2025-03-18 10:35:50 -07:00
Ishaan Jaff
f2026ef907 fix - correctly re-use azure openai client 2025-03-18 09:51:28 -07:00
Nate Mar
9f9e555342 Update test_arize_ai.py 2025-03-18 04:04:44 -07:00