Commit graph

1532 commits

Author SHA1 Message Date
Krrish Dholakia
900d8ecbf0 feat(factory.py): enable 'user_continue_message' for interweaving user/assistant messages when provider requires it
allows bedrock to be used with autogen
2024-08-22 11:03:33 -07:00
Krrish Dholakia
8f306f8e41 fix(cohere_chat.py): support passing 'extra_headers'
Fixes https://github.com/BerriAI/litellm/issues/4709
2024-08-22 10:17:36 -07:00
Krrish Dholakia
2dd616bad0 fix(ollama_chat.py): fix passing assistant message with tool call param
Fixes https://github.com/BerriAI/litellm/issues/5319
2024-08-22 10:00:03 -07:00
Ishaan Jaff
e4fe5924a5 Merge pull request #5326 from BerriAI/litellm_Add_vertex_multimodal_embedding
[Feat] add vertex multimodal embedding support
2024-08-21 17:06:43 -07:00
Krish Dholakia
0d9e9ca061 Merge pull request #5253 from the-crypt-keeper/mistral-add-stop
Add the "stop" parameter to the mistral API interface
2024-08-21 15:40:54 -07:00
Krrish Dholakia
664c40a4c7 fix(vertex_httpx.py): fix json schema call to pass in response_mime_type=="application/json" 2024-08-21 15:24:04 -07:00
Ishaan Jaff
a0e14af1d3 feat add multimodal embeddings on vertex 2024-08-21 15:19:48 -07:00
Ishaan Jaff
0435101df4 add multi modal vtx embedding 2024-08-21 15:05:59 -07:00
Ishaan Jaff
be6eb52036 add initial support for multimodal_embedding vertex 2024-08-21 14:29:05 -07:00
Krrish Dholakia
07bd92b527 fix(vertex_httpx.py): Fix tool calling with empty param list
Fixes https://github.com/BerriAI/litellm/issues/5055
2024-08-21 09:03:34 -07:00
Ishaan Jaff
a34aeafdb5 Merge pull request #5018 from haadirakhangi/main
Qdrant Semantic Caching
2024-08-21 08:50:43 -07:00
Krrish Dholakia
5c1a5978f9 fix(azure.py): fix optional param elif statement 2024-08-20 12:24:51 -07:00
Krish Dholakia
b1e9017841 Merge pull request #5284 from BerriAI/litellm_fix_azure_api_version
feat(azure.py): support dynamic azure api versions
2024-08-20 11:46:55 -07:00
Krish Dholakia
969b724615 Merge pull request #5296 from BerriAI/litellm_azure_json_schema_support
feat(azure.py): support 'json_schema' for older models
2024-08-20 11:41:38 -07:00
Krish Dholakia
85c5d4f8c2 Merge branch 'main' into litellm_fix_azure_api_version 2024-08-20 11:40:53 -07:00
Krrish Dholakia
1e0b85dfc6 feat(ollama.py): support ollama /api/embed endpoint
Closes https://github.com/BerriAI/litellm/issues/5291
2024-08-20 09:10:08 -07:00
Krrish Dholakia
a2b1effa64 fix(factory.py): fix merging consecutive tool blocks for bedrock converse
Fixes https://github.com/BerriAI/litellm/issues/5277
2024-08-20 08:53:34 -07:00
Ishaan Jaff
c2e59047f1 fix test codestral api 2024-08-20 08:45:44 -07:00
Krrish Dholakia
d08479b52c feat(azure.py): support dynamic api versions
Closes https://github.com/BerriAI/litellm/issues/5228
2024-08-19 12:17:43 -07:00
Krrish Dholakia
a449661223 fix(ollama.py): fix ollama embeddings - pass optional params
Fixes https://github.com/BerriAI/litellm/issues/5267
2024-08-19 08:45:26 -07:00
Haadi Rakhangi
ba87dfdb60 added put method in http_handler 2024-08-19 21:10:18 +05:30
Krrish Dholakia
c0b7f56fc2 fix(ollama_chat.py): fix sync tool calling
Fixes https://github.com/BerriAI/litellm/issues/5245
2024-08-19 08:31:46 -07:00
Haadi Rakhangi
9df92923d8 implemented RestAPI and added support for cloud and local Qdrant clusters 2024-08-19 20:46:30 +05:30
Krrish Dholakia
afcebac8ed feat(azure.py): support 'json_schema' for older models
Converts the json schema input to a tool call, allows the call to still work on older azure models
2024-08-17 16:31:13 -07:00
Krrish Dholakia
5dc52aedc9 style(vertex_httpx.py): make vertex error string more helpful 2024-08-17 15:09:55 -07:00
Krish Dholakia
4db37fbf02 Merge pull request #5232 from Penagwin/fix_anthropic_tool_streaming_index
Fixes the `tool_use` indexes not being correctly mapped
2024-08-17 14:33:50 -07:00
Krish Dholakia
0916197c9d Merge pull request #5244 from BerriAI/litellm_better_error_logging_sentry
refactor: replace .error() with .exception() logging for better debugging on sentry
2024-08-16 19:16:20 -07:00
Mike
8b6879d243 Add the "stop" parameter to the mistral API interface, it is now supported 2024-08-16 23:29:22 +00:00
Ishaan Jaff
31e698e180 fix predictions image generation response 2024-08-16 15:06:12 -07:00
Krrish Dholakia
2874b94fb1 refactor: replace .error() with .exception() logging for better debugging on sentry 2024-08-16 09:22:47 -07:00
Ishaan Jaff
98c9191f84 pass trace through for bedrock guardrails 2024-08-16 09:10:56 -07:00
Paul Lang
391490bb41 Merge remote-tracking branch 'origin/main' into fix_anthropic_tool_streaming_index 2024-08-16 09:26:04 -04:00
Ishaan Jaff
f077c92218 allow index to not exist in sagemaker chunks 2024-08-15 19:45:59 -07:00
Ishaan Jaff
6d9121ea78 assume index is not always in stream chunk 2024-08-15 19:42:03 -07:00
Ishaan Jaff
e500e14655 feat add support for aws_region_name 2024-08-15 19:32:59 -07:00
Ishaan Jaff
1338b00a85 show bedrock, sagemaker creds in verbose mode 2024-08-15 19:10:11 -07:00
Ishaan Jaff
3407f20b31 fix sagemaker test 2024-08-15 18:23:41 -07:00
Ishaan Jaff
953a67ba4c refactor sagemaker to be async 2024-08-15 18:18:02 -07:00
Ishaan Jaff
6259d64cfd use BaseAWSLLM for bedrock getcredentials 2024-08-15 13:58:47 -07:00
Paul Lang
3574397576 Fixes the tool_use chunk mapping 2024-08-15 15:44:09 -04:00
Ishaan Jaff
d3bdfac7a2 Merge pull request #5210 from BerriAI/litellm_add_prompt_caching_support
[Feat] Add Anthropic API Prompt Caching Support
2024-08-14 17:43:01 -07:00
Ishaan Jaff
7fc2657a26 add test for large context in system message for anthropic 2024-08-14 17:03:10 -07:00
Krrish Dholakia
5591acba88 fix(factory.py): handle assistant null content 2024-08-14 15:44:38 -07:00
Ishaan Jaff
83ee2e21d8 pass cache_control in tool call 2024-08-14 15:18:11 -07:00
Ishaan Jaff
14bb0c670c test test_anthropic_api_prompt_caching_basic 2024-08-14 15:06:10 -07:00
Ishaan Jaff
41ce2ef904 add anthropic cache controls 2024-08-14 14:56:49 -07:00
Krrish Dholakia
2f47348d8e fix(factory.py): support assistant messages as a list of dictionaries - cohere messages api
Fixes https://github.com/BerriAI/litellm/pull/5121
2024-08-14 14:19:59 -07:00
Krish Dholakia
ac695e4af5 Merge pull request #5148 from fabceolin/main
Enable follow redirects in ollama_chat
2024-08-14 14:08:45 -07:00
Ishaan Jaff
8fd1bbb724 feat - anthropic api context caching v0 2024-08-14 13:08:03 -07:00
Krish Dholakia
7952ca8304 Merge pull request #5116 from thiswillbeyourgithub/fix_ollama_argument_order
fix: wrong order of arguments for ollama
2024-08-14 08:36:14 -07:00