Commit graph

1523 commits

Author SHA1 Message Date
Krrish Dholakia
664c40a4c7 fix(vertex_httpx.py): fix json schema call to pass in response_mime_type=="application/json" 2024-08-21 15:24:04 -07:00
Krrish Dholakia
07bd92b527 fix(vertex_httpx.py): Fix tool calling with empty param list
Fixes https://github.com/BerriAI/litellm/issues/5055
2024-08-21 09:03:34 -07:00
Ishaan Jaff
a34aeafdb5 Merge pull request #5018 from haadirakhangi/main
Qdrant Semantic Caching
2024-08-21 08:50:43 -07:00
Krrish Dholakia
5c1a5978f9 fix(azure.py): fix optional param elif statement 2024-08-20 12:24:51 -07:00
Krish Dholakia
b1e9017841 Merge pull request #5284 from BerriAI/litellm_fix_azure_api_version
feat(azure.py): support dynamic azure api versions
2024-08-20 11:46:55 -07:00
Krish Dholakia
969b724615 Merge pull request #5296 from BerriAI/litellm_azure_json_schema_support
feat(azure.py): support 'json_schema' for older models
2024-08-20 11:41:38 -07:00
Krish Dholakia
85c5d4f8c2 Merge branch 'main' into litellm_fix_azure_api_version 2024-08-20 11:40:53 -07:00
Krrish Dholakia
1e0b85dfc6 feat(ollama.py): support ollama /api/embed endpoint
Closes https://github.com/BerriAI/litellm/issues/5291
2024-08-20 09:10:08 -07:00
Krrish Dholakia
a2b1effa64 fix(factory.py): fix merging consecutive tool blocks for bedrock converse
Fixes https://github.com/BerriAI/litellm/issues/5277
2024-08-20 08:53:34 -07:00
Ishaan Jaff
c2e59047f1 fix test codestral api 2024-08-20 08:45:44 -07:00
Krrish Dholakia
d08479b52c feat(azure.py): support dynamic api versions
Closes https://github.com/BerriAI/litellm/issues/5228
2024-08-19 12:17:43 -07:00
Krrish Dholakia
a449661223 fix(ollama.py): fix ollama embeddings - pass optional params
Fixes https://github.com/BerriAI/litellm/issues/5267
2024-08-19 08:45:26 -07:00
Haadi Rakhangi
ba87dfdb60 added put method in http_handler 2024-08-19 21:10:18 +05:30
Krrish Dholakia
c0b7f56fc2 fix(ollama_chat.py): fix sync tool calling
Fixes https://github.com/BerriAI/litellm/issues/5245
2024-08-19 08:31:46 -07:00
Haadi Rakhangi
9df92923d8 implemented RestAPI and added support for cloud and local Qdrant clusters 2024-08-19 20:46:30 +05:30
Krrish Dholakia
afcebac8ed feat(azure.py): support 'json_schema' for older models
Converts the json schema input to a tool call, allows the call to still work on older azure models
2024-08-17 16:31:13 -07:00
Krrish Dholakia
5dc52aedc9 style(vertex_httpx.py): make vertex error string more helpful 2024-08-17 15:09:55 -07:00
Krish Dholakia
4db37fbf02 Merge pull request #5232 from Penagwin/fix_anthropic_tool_streaming_index
Fixes the `tool_use` indexes not being correctly mapped
2024-08-17 14:33:50 -07:00
Krish Dholakia
0916197c9d Merge pull request #5244 from BerriAI/litellm_better_error_logging_sentry
refactor: replace .error() with .exception() logging for better debugging on sentry
2024-08-16 19:16:20 -07:00
Ishaan Jaff
31e698e180 fix predictions image generation response 2024-08-16 15:06:12 -07:00
Krrish Dholakia
2874b94fb1 refactor: replace .error() with .exception() logging for better debugging on sentry 2024-08-16 09:22:47 -07:00
Ishaan Jaff
98c9191f84 pass trace through for bedrock guardrails 2024-08-16 09:10:56 -07:00
Paul Lang
391490bb41 Merge remote-tracking branch 'origin/main' into fix_anthropic_tool_streaming_index 2024-08-16 09:26:04 -04:00
Ishaan Jaff
f077c92218 allow index to not exist in sagemaker chunks 2024-08-15 19:45:59 -07:00
Ishaan Jaff
6d9121ea78 assume index is not always in stream chunk 2024-08-15 19:42:03 -07:00
Ishaan Jaff
e500e14655 feat add support for aws_region_name 2024-08-15 19:32:59 -07:00
Ishaan Jaff
1338b00a85 show bedrock, sagemaker creds in verbose mode 2024-08-15 19:10:11 -07:00
Ishaan Jaff
3407f20b31 fix sagemaker test 2024-08-15 18:23:41 -07:00
Ishaan Jaff
953a67ba4c refactor sagemaker to be async 2024-08-15 18:18:02 -07:00
Ishaan Jaff
6259d64cfd use BaseAWSLLM for bedrock getcredentials 2024-08-15 13:58:47 -07:00
Paul Lang
3574397576 Fixes the tool_use chunk mapping 2024-08-15 15:44:09 -04:00
Ishaan Jaff
d3bdfac7a2 Merge pull request #5210 from BerriAI/litellm_add_prompt_caching_support
[Feat] Add Anthropic API Prompt Caching Support
2024-08-14 17:43:01 -07:00
Ishaan Jaff
7fc2657a26 add test for large context in system message for anthropic 2024-08-14 17:03:10 -07:00
Krrish Dholakia
5591acba88 fix(factory.py): handle assistant null content 2024-08-14 15:44:38 -07:00
Ishaan Jaff
83ee2e21d8 pass cache_control in tool call 2024-08-14 15:18:11 -07:00
Ishaan Jaff
14bb0c670c test test_anthropic_api_prompt_caching_basic 2024-08-14 15:06:10 -07:00
Ishaan Jaff
41ce2ef904 add anthropic cache controls 2024-08-14 14:56:49 -07:00
Krrish Dholakia
2f47348d8e fix(factory.py): support assistant messages as a list of dictionaries - cohere messages api
Fixes https://github.com/BerriAI/litellm/pull/5121
2024-08-14 14:19:59 -07:00
Krish Dholakia
ac695e4af5 Merge pull request #5148 from fabceolin/main
Enable follow redirects in ollama_chat
2024-08-14 14:08:45 -07:00
Ishaan Jaff
8fd1bbb724 feat - anthropic api context caching v0 2024-08-14 13:08:03 -07:00
Krish Dholakia
7952ca8304 Merge pull request #5116 from thiswillbeyourgithub/fix_ollama_argument_order
fix: wrong order of arguments for ollama
2024-08-14 08:36:14 -07:00
Krish Dholakia
7187f30d3d Merge pull request #5189 from ArtyomZemlyak/patch-1
Fix not sended json_data_for_triton
2024-08-13 20:44:26 -07:00
Krrish Dholakia
76c48bf5d9 fix(bedrock_httpx.py): fix error code for not found provider/model combo to be 404 2024-08-13 20:36:12 -07:00
Artem Zemliak
3903fe2b10 Fix not sended json_data_for_triton 2024-08-14 09:57:48 +07:00
Krrish Dholakia
4a21554b4f fix(bedrock_httpx.py): raise bad request error if invalid bedrock model given 2024-08-13 19:27:06 -07:00
Krrish Dholakia
08a584035c fix(bedrock_httpx.py): handle empty stop string 2024-08-13 07:30:30 -07:00
Krrish Dholakia
8454cfb329 fix(bedrock_httpx.py): handle bedrock empty system message 2024-08-13 07:17:17 -07:00
Krrish Dholakia
f92060a90a fix(azure.py): return response headers acompletion + acompletion w/ streaming
Fixes https://github.com/BerriAI/litellm/issues/2440#issuecomment-2283259187
2024-08-12 11:29:49 -07:00
Krrish Dholakia
6ff21433da fix(openai.py): fix position of invalid_params param 2024-08-10 09:52:27 -07:00
Fabrício Ceolin
d75f6f74f3 Follow redirects 2024-08-10 12:12:55 -03:00