Commit graph

3588 commits

Author SHA1 Message Date
Krish Dholakia
65bee737c5
Merge branch 'main' into litellm_gemini_stream_tool_calling 2024-07-06 19:07:31 -07:00
Krrish Dholakia
1193ee8803 fix(presidio_pii_masking.py): fix presidio unset url check + add same check for langfuse 2024-07-06 17:50:55 -07:00
Krrish Dholakia
d57d3df1d6 fix(presidio_pii_masking.py): add support for setting 'http://' if unset by render env for presidio base url 2024-07-06 17:42:10 -07:00
Ishaan Jaff
25a0066123 ci/cd run again 2024-07-06 17:04:53 -07:00
Ishaan Jaff
d50ec47331 ci/cd run again 2024-07-06 15:56:17 -07:00
Ishaan Jaff
482913c2e9 test had "assert False" for some reason ? 2024-07-06 15:46:28 -07:00
Ishaan Jaff
d61cc598b0
Merge pull request #4576 from BerriAI/litellm_encrypt_decrypt_using_salt
[Refactor] Use helper function to encrypt/decrypt model credentials
2024-07-06 15:11:09 -07:00
Krish Dholakia
b3ef1ac18c
Merge branch 'main' into litellm_proxy_tts_pricing 2024-07-06 14:56:16 -07:00
Krrish Dholakia
27e9f96380 fix(main.py): fix stream_chunk_builder usage calc
Closes https://github.com/BerriAI/litellm/issues/4496
2024-07-06 14:52:59 -07:00
Ishaan Jaff
3fa64023ea test - test_init_clients_async_mode 2024-07-06 14:08:35 -07:00
Krrish Dholakia
faa88a1ab1 fix(vertex_httpx.py): support tool calling w/ streaming for vertex ai + gemini 2024-07-06 14:02:25 -07:00
Ishaan Jaff
e477b7e3da fix linting error 2024-07-06 11:27:58 -07:00
Krish Dholakia
ea9718a848
Merge branch 'main' into litellm_proxy_tts_pricing 2024-07-06 11:16:07 -07:00
Krrish Dholakia
3f83e8a8d4 fix(caching.py): fix async redis health check 2024-07-06 09:14:29 -07:00
Krrish Dholakia
407639cc7d fix(cost_calculator.py): support openai+azure tts calls 2024-07-05 20:58:08 -07:00
Ishaan Jaff
8958a9bf8c
Merge pull request #4565 from BerriAI/litellm_fix_nvidia_nim_param_mapping
[Fix] Add nvidia nim param mapping based on `model`
2024-07-05 19:55:57 -07:00
Krrish Dholakia
6090fd37fa fix(test_proxy_reject_logging.py): fix test 2024-07-05 19:09:37 -07:00
Krrish Dholakia
fd11f63f71 fix(utils.py): log failure to sync failure callbacks as well 2024-07-05 14:49:34 -07:00
Ishaan Jaff
e5c49548ea fix nvidia nim param mapping 2024-07-05 14:44:12 -07:00
Krrish Dholakia
b1b21b0340 fix(proxy/utils.py): support logging rejected requests to langfuse, etc. 2024-07-05 14:39:35 -07:00
Krrish Dholakia
d528b66db0 fix(proxy_server.py): fix callback check order 2024-07-05 14:06:33 -07:00
Krrish Dholakia
c425cba93a fix(vertex_httpx.py): fix supported vertex params 2024-07-04 21:17:52 -07:00
Ishaan Jaff
340f7317e8
Merge pull request #4549 from BerriAI/litellm_add_groq_whisper
[Feat] Add Groq/whisper-large-v3
2024-07-04 17:30:48 -07:00
Ishaan Jaff
8ffa690f33 test groq/whisper-large-v3 2024-07-04 16:45:45 -07:00
Krrish Dholakia
f2dabc65be fix(anthropic.py): fix anthropic tool calling + streaming
Fixes https://github.com/BerriAI/litellm/issues/4537
2024-07-04 16:30:24 -07:00
Krrish Dholakia
fd25117b67 fix(main.py): fix azure ai cohere tool calling 2024-07-04 11:46:14 -07:00
Krrish Dholakia
a8e181369d fix(cohere.py): fix message parsing to handle tool calling correctly 2024-07-04 11:13:07 -07:00
Krish Dholakia
3184640291
Merge pull request #4522 from andrewmjc/matchingToolMessageSpec
[Bug Fix] Use OpenAI Tool Response Spec When Converting To Gemini/VertexAI Tool Response
2024-07-04 08:03:38 -07:00
Krrish Dholakia
d66d35349f test(test_prompt_factory.py): fix test 2024-07-03 22:16:03 -07:00
Krrish Dholakia
19c982d0f9 fix: linting fixes 2024-07-03 21:55:00 -07:00
Krish Dholakia
5e47970eed
Merge branch 'main' into litellm_anthropic_tool_calling_streaming_fix 2024-07-03 20:43:51 -07:00
Krrish Dholakia
2e5a81f280 fix(utils.py): stream_options working across all providers 2024-07-03 20:40:46 -07:00
Krrish Dholakia
344268e053 fix(anthropic.py): support *real* anthropic tool calling + streaming
Parses each chunk and translates to openai format
2024-07-03 19:48:35 -07:00
Krrish Dholakia
ed5fc3d1f9 fix(utils.py): fix vertex anthropic streaming 2024-07-03 18:43:46 -07:00
Krish Dholakia
6c5c8bbb28
Revert "fix(vertex_anthropic.py): Vertex Anthropic tool calling - native params " 2024-07-03 17:55:37 -07:00
Krish Dholakia
318077edea
Merge pull request #4531 from BerriAI/litellm_vertex_anthropic_tools
fix(vertex_anthropic.py): Vertex Anthropic tool calling - native params
2024-07-03 17:25:32 -07:00
Krrish Dholakia
7007ace6c2 fix(vertex_anthropic.py): Updates the vertex anthropic endpoint to do tool calling with the anthropic api params 2024-07-03 15:28:31 -07:00
Ishaan Jaff
80dd14d59e test - default on/off guardrails 2024-07-03 14:50:13 -07:00
Krish Dholakia
944f22a089
Merge pull request #4499 from petermuller/main
Allow calling SageMaker endpoints from different regions
2024-07-03 13:09:21 -07:00
andrewmjc
95dc480204 unit test 2024-07-03 12:23:26 -06:00
Krrish Dholakia
d18dc2648c fix(replicate.py): correctly handly invalid replicate response 2024-07-03 10:09:46 -07:00
Krrish Dholakia
606d04b05b fix(_service_logging.py): only trigger otel if in service_callback
Fixes https://github.com/BerriAI/litellm/issues/4511
2024-07-03 09:48:38 -07:00
Krrish Dholakia
67433a04a2 test: fix test 2024-07-02 22:13:41 -07:00
Peter Muller
d8fc8252fa
Revert imports changes, update tests to match 2024-07-02 19:09:22 -07:00
Ishaan Jaff
3da8ce6a75 ci/cd run again 2024-07-02 18:39:53 -07:00
Krrish Dholakia
ac00639301 fix(azure.py): fix httpx call for dall e 3 2024-07-02 18:30:21 -07:00
Krish Dholakia
21d3a28e51
Merge branch 'main' into litellm_support_dynamic_rpm_limiting 2024-07-02 17:51:18 -07:00
Krrish Dholakia
4b17f2dfdb test: skip bad test 2024-07-02 17:46:50 -07:00
Krrish Dholakia
0894439118 test(test_router.py): fix test 2024-07-02 17:45:33 -07:00
Krish Dholakia
d38f01e956
Merge branch 'main' into litellm_fix_httpx_transport 2024-07-02 17:17:43 -07:00