Commit graph

1872 commits

Author SHA1 Message Date
Ishaan Jaff
341f88d191 fix supports vision 2024-07-11 12:59:42 -07:00
Krrish Dholakia
1ba3fcc3fb feat(utils.py): accept 'api_key' as param for validate_environment
Closes https://github.com/BerriAI/litellm/issues/4375
2024-07-11 12:02:23 -07:00
Krrish Dholakia
1019355527 fix(types/utils.py): fix streaming function name 2024-07-10 21:56:47 -07:00
Yulong Liu
feb42c91a6 remove print 2024-07-08 17:03:07 -07:00
Yulong Liu
cb025a7f26 Merge branch 'main' into empower-functions-v1 2024-07-08 17:01:15 -07:00
Krrish Dholakia
fe62e4e1c4 fix(proxy_cli.py): bump default azure api version 2024-07-08 16:28:22 -07:00
Krrish Dholakia
95739c3778 fix(utils.py): additional_drop_params support for embedding + image gen
Closes https://github.com/BerriAI/litellm/issues/4354
2024-07-08 15:25:47 -07:00
Krrish Dholakia
298505c47c fix(whisper---handle-openai/azure-vtt-response-format): Fixes https://github.com/BerriAI/litellm/issues/4595 2024-07-08 09:10:40 -07:00
Krrish Dholakia
bb905d7243 fix(utils.py): support 'drop_params' for 'parallel_tool_calls'
Closes https://github.com/BerriAI/litellm/issues/4584

 OpenAI-only param
2024-07-08 07:36:41 -07:00
Simon Sanchez Viloria
c041b75143 Added watsonx to stream wrapper __anext__ 2024-07-07 19:21:50 +02:00
Krrish Dholakia
86596c53e9 refactor(main.py): migrate vertex gemini calls to vertex_httpx
Completes migration to vertex_httpx
2024-07-06 20:08:52 -07:00
Krish Dholakia
8661da1980
Merge branch 'main' into litellm_fix_httpx_transport 2024-07-06 19:12:06 -07:00
Krish Dholakia
65bee737c5
Merge branch 'main' into litellm_gemini_stream_tool_calling 2024-07-06 19:07:31 -07:00
Krrish Dholakia
20e39d6acc fix(utils.py): cleanup 'additionalProperties=False' for tool calling with zod
Fixes issue with zod passing in additionalProperties=False, causing vertex ai / gemini calls to fail
2024-07-06 17:27:37 -07:00
Krrish Dholakia
faa88a1ab1 fix(vertex_httpx.py): support tool calling w/ streaming for vertex ai + gemini 2024-07-06 14:02:25 -07:00
Krrish Dholakia
85d723f5f8 fix(utils.py): fix openrouter exception handling 2024-07-06 12:36:05 -07:00
Krish Dholakia
f7ebb84488
Merge branch 'main' into litellm_tts_pricing 2024-07-06 11:02:59 -07:00
Krrish Dholakia
407639cc7d fix(cost_calculator.py): support openai+azure tts calls 2024-07-05 20:58:08 -07:00
Ishaan Jaff
8958a9bf8c
Merge pull request #4565 from BerriAI/litellm_fix_nvidia_nim_param_mapping
[Fix] Add nvidia nim param mapping based on `model`
2024-07-05 19:55:57 -07:00
Ishaan Jaff
e5c49548ea fix nvidia nim param mapping 2024-07-05 14:44:12 -07:00
Krrish Dholakia
b1b21b0340 fix(proxy/utils.py): support logging rejected requests to langfuse, etc. 2024-07-05 14:39:35 -07:00
Krrish Dholakia
017af34866 fix(utils.py): fix openrouter supported params
Fixes https://github.com/BerriAI/litellm/issues/4508
2024-07-05 12:06:20 -07:00
Krish Dholakia
0721e95b0b
Merge branch 'main' into feature/return-output-vector-size-in-modelinfo 2024-07-04 17:03:31 -07:00
Krrish Dholakia
879d1ae60e fix(utils.py): fix error string for exception raised 2024-07-04 15:52:46 -07:00
Krish Dholakia
18d8edc145
Merge pull request #4461 from t968914/litellm-fix-vertexaibeta
fix: Include vertex_ai_beta in vertex_ai param mapping/Do not use google auth project_id
2024-07-04 15:27:20 -07:00
Krrish Dholakia
2e5a81f280 fix(utils.py): stream_options working across all providers 2024-07-03 20:40:46 -07:00
Krrish Dholakia
8dbe0559dd fix(utils.py): stream_options fix 2024-07-03 19:57:34 -07:00
Krrish Dholakia
344268e053 fix(anthropic.py): support *real* anthropic tool calling + streaming
Parses each chunk and translates to openai format
2024-07-03 19:48:35 -07:00
Krrish Dholakia
ed5fc3d1f9 fix(utils.py): fix vertex anthropic streaming 2024-07-03 18:43:46 -07:00
Krrish Dholakia
3d61a316cb fix(router.py): bump azure default api version
Allows 'tool_choice' to be passed to azure
2024-07-03 12:00:00 -07:00
Krish Dholakia
d38f01e956
Merge branch 'main' into litellm_fix_httpx_transport 2024-07-02 17:17:43 -07:00
Krrish Dholakia
589c1c6280 refactor(azure.py): replaces the custom transport logic for just using our httpx client
Done to fix all the http/https proxy issues people are facing with proxy.
2024-07-02 15:32:53 -07:00
Tiger Yu
26630cd263
Merge branch 'main' into litellm-fix-vertexaibeta 2024-07-02 09:49:44 -07:00
Ishaan Jaff
fcf65d5215 fix exception provider not known 2024-07-01 21:05:37 -07:00
Krrish Dholakia
4c95782f74 fix(utils.py): fix openrouter tool calling params 2024-07-01 08:25:29 -07:00
Krrish Dholakia
5e521bd36e fix(utils.py): fix openrouter params
Fixes https://github.com/BerriAI/litellm/issues/4488
2024-07-01 08:24:06 -07:00
Indigo
d17816dd20
Fix usage of parameter-based credentials when using vertex_ai_beta route 2024-07-01 15:54:02 +10:00
Krish Dholakia
58d0330cd7
Merge pull request #4478 from BerriAI/litellm_support_response_schema_param_vertex_ai_old
feat(vertex_httpx.py): support the 'response_schema' param for older vertex ai models
2024-06-29 20:17:39 -07:00
Ishaan Jaff
46698ae01f fix param mapping for bedrock claude 2024-06-29 19:33:51 -07:00
Krrish Dholakia
7670c5bd13 fix(utils.py): add 'enforce_validation' param 2024-06-29 19:12:00 -07:00
Krrish Dholakia
69d06cfbcd fix(utils.py): fix passing additional param to post-call processing 2024-06-29 18:58:44 -07:00
Ishaan Jaff
19014dd931
Merge pull request #4477 from BerriAI/litellm_fix_exception_mapping
[Fix]  - Error str in OpenAI, Azure exception
2024-06-29 17:37:26 -07:00
Krrish Dholakia
b699d9a8b9 fix(utils.py): support json schema validation 2024-06-29 15:05:52 -07:00
Krrish Dholakia
05dfc63b88 feat(vertex_httpx.py): support the 'response_schema' param for older vertex ai models - pass as prompt (user-controlled)
if 'response_schema' is not supported for vertex model (e.g. gemini-1.5-flash) pass in prompt
2024-06-29 13:25:27 -07:00
Ishaan Jaff
a6bc878a2a fix - error str in OpenAI, Azure exception 2024-06-29 13:11:55 -07:00
Krrish Dholakia
5718d1e205 fix(utils.py): new helper function to check if provider/model supports 'response_schema' param 2024-06-29 12:40:29 -07:00
Krrish Dholakia
e73e9e12bc fix(vertex_httpx.py): support passing response_schema to gemini 2024-06-29 11:33:19 -07:00
Krrish Dholakia
831745e710 test(test_streaming.py): try-except replicate api instability 2024-06-28 22:19:44 -07:00
Krrish Dholakia
ca04244a0a fix(utils.py): correctly raise openrouter error 2024-06-28 21:50:21 -07:00
Krrish Dholakia
c151a1d244 fix(http_handler.py): raise more detailed http status errors 2024-06-28 15:12:38 -07:00