Commit graph

950 commits

Author SHA1 Message Date
Krish Dholakia
dc8f238449 Merge pull request #3657 from phact/patch-4
Another dictionary changed size during iteration error
2024-05-20 17:45:50 -07:00
Ishaan Jaff
28d1bde250 Merge pull request #3739 from BerriAI/litellm_add_imagen_support
[FEAT] Async VertexAI Image Generation
2024-05-20 14:14:43 -07:00
Ishaan Jaff
6fef49d1f6 fix vertex httpx client 2024-05-20 13:43:54 -07:00
Ishaan Jaff
99ba8d74a0 Merge pull request #3711 from hmcp22/add_gemini_base64_image_support
Adding decoding of base64 image data for gemini pro 1.5
2024-05-20 13:34:39 -07:00
Ishaan Jaff
883a9eb69a add parameter mapping with vertex ai 2024-05-20 13:28:20 -07:00
Ishaan Jaff
97dc366402 fix vertex ai import 2024-05-20 13:13:19 -07:00
Ishaan Jaff
9d12a570a5 fix self.async_handler 2024-05-20 13:11:10 -07:00
Ishaan Jaff
5e64e76594 fix python 3.8 2024-05-20 12:23:27 -07:00
Ishaan Jaff
c309c9d82c fix python 3.8 Tuple 2024-05-20 12:21:02 -07:00
Ishaan Jaff
d2bc2259cc fix add debug to vertex httpx image 2024-05-20 11:11:14 -07:00
Ishaan Jaff
1256159229 fix python 3.8 import 2024-05-20 11:03:28 -07:00
Ishaan Jaff
76a1444621 add ImageObject 2024-05-20 10:45:37 -07:00
Ishaan Jaff
884e2beed6 feat - working httpx requests vertex ai image gen 2024-05-20 09:51:15 -07:00
Krrish Dholakia
0016477d3b feat(proxy_server.py): new 'supported_openai_params' endpoint
get supported openai params for a given model
2024-05-20 08:39:50 -07:00
Krish Dholakia
4f2ac5f270 Merge pull request #3729 from BerriAI/litellm_vertex_history
fix(vertex_ai.py): support passing in result of tool call to vertex
2024-05-20 07:33:05 -07:00
Krrish Dholakia
81e35ba6c0 fix(vertex_ai.py): revert system instructions - unable to find supported vertex version 2024-05-20 06:30:11 -07:00
Krrish Dholakia
9e1a65c32a fix(vertex_ai.py): support passing system instructions to vertex ai 2024-05-20 06:18:19 -07:00
Krrish Dholakia
bb54839465 fix(vertex_ai.py): use chat_messages_with_history for async + streaming calls 2024-05-19 12:30:24 -07:00
Krrish Dholakia
50145b6ef3 fix(vertex_ai.py): passing all tests on 'test_amazing_vertex_completion.py 2024-05-19 12:22:21 -07:00
Krrish Dholakia
86ecb4638c fix(vertex_ai.py): support passing in result of tool call to vertex
Fixes https://github.com/BerriAI/litellm/issues/3709
2024-05-19 11:34:07 -07:00
Krrish Dholakia
7da925cada fix(utils.py): drop response_format if 'drop_params=True' for gpt-4 2024-05-18 13:02:48 -07:00
Krish Dholakia
60615f46c4 Merge branch 'main' into litellm_bedrock_anthropic_fix 2024-05-17 17:47:32 -07:00
Krrish Dholakia
b20f4f65b4 fix(bedrock_httpx.py): raise better timeout exception 2024-05-17 17:16:36 -07:00
Krrish Dholakia
56084d5ac1 fix(bedrock_httpx.py): support mapping for bedrock cohere command r text 2024-05-17 16:13:49 -07:00
hugo.lima
c671b44424 added decoding of base64 image data in _gemini_vision_convert_messages function 2024-05-17 16:46:56 +01:00
Krrish Dholakia
8405fee205 fix(anthropic.py): bump default anthropic api version for tool use 2024-05-17 00:41:11 -07:00
Krrish Dholakia
2e0c0a0cc3 fix(bedrock_httpx.py): fix bedrock logging 2024-05-16 23:53:54 -07:00
Krrish Dholakia
be8f2dd909 fix(bedrock_httpx.py): logging fixes 2024-05-16 23:20:51 -07:00
Krrish Dholakia
13e4196e3e fix(bedrock_httpx.py): add async support for bedrock amazon, meta, mistral models 2024-05-16 22:39:25 -07:00
Krrish Dholakia
8409b39f0d fix(bedrock_httpx.py): move bedrock ai21 calls to being async 2024-05-16 22:21:30 -07:00
Krrish Dholakia
118fc4ffac fix(bedrock_httpx.py): move anthropic bedrock calls to httpx
Fixing https://github.com/BerriAI/litellm/issues/2921
2024-05-16 21:51:55 -07:00
Krrish Dholakia
e41897808d fix(replicate.py): move replicate calls to being completely async
Closes https://github.com/BerriAI/litellm/issues/3128
2024-05-16 17:24:08 -07:00
Ishaan Jaff
4be6dd7a73 Merge pull request #3694 from BerriAI/litellm_allow_setting_anthropic_beta
[Feat] Support Anthropic `tools-2024-05-16` - Set Custom Anthropic Custom Headers
2024-05-16 15:48:26 -07:00
Ishaan Jaff
32815b06cb feat: Anthropic allow users to set anthropic-beta in headers 2024-05-16 14:40:31 -07:00
Ishaan Jaff
4437c67af8 fix - choices index for gemini/ provider 2024-05-16 13:52:46 -07:00
Sebastián Estévez
d4edf0f0ae Another dictionary changed size during iteration error
```
ImportError while loading conftest '/astra-assistants-api/tests/openai-sdk/conftest.py'.
conftest.py:13: in <module>
    from impl.astra_vector import CassandraClient
../../impl/astra_vector.py:45: in <module>
    from impl.services.inference_utils import get_embeddings
../../impl/services/inference_utils.py:5: in <module>
    import litellm
.cache/pypoetry/virtualenvs/astra-assistants-api-eiSmbCzm-py3.10/lib/python3.10/site-packages/litellm/__init__.py:678: in <module>
    from .main import *  # type: ignore
.cache/pypoetry/virtualenvs/astra-assistants-api-eiSmbCzm-py3.10/lib/python3.10/site-packages/litellm/main.py:73: in <module>
    from .llms.azure_text import AzureTextCompletion
.cache/pypoetry/virtualenvs/astra-assistants-api-eiSmbCzm-py3.10/lib/python3.10/site-packages/litellm/llms/azure_text.py:23: in <module>
    openai_text_completion_config = OpenAITextCompletionConfig()
.cache/pypoetry/virtualenvs/astra-assistants-api-eiSmbCzm-py3.10/lib/python3.10/site-packages/litellm/llms/openai.py:192: in __init__
    for key, value in locals_.items():
E   RuntimeError: dictionary changed size during iteration
```
2024-05-15 17:06:54 -04:00
Krrish Dholakia
4c88e917bd fix(huggingface_restapi.py): fix task extraction from model name 2024-05-15 07:28:19 -07:00
Krish Dholakia
c3b3eac783 Merge pull request #3554 from paneru-rajan/Issue-3544-fix-message
Fixes #3544 based on the data-type of message
2024-05-13 16:23:58 -07:00
Krrish Dholakia
96336cdd49 fix(openai.py): creat MistralConfig with response_format mapping for mistral api 2024-05-13 13:29:58 -07:00
Krrish Dholakia
3a356a6f56 fix(vertex_ai.py): support tool call list response async completion 2024-05-13 10:42:31 -07:00
Krish Dholakia
784ae85ba0 Merge branch 'main' into litellm_bedrock_command_r_support 2024-05-11 21:24:42 -07:00
Krrish Dholakia
9b10ba649f fix(anthropic.py): fix tool calling + streaming issue 2024-05-11 20:15:36 -07:00
Krrish Dholakia
cca89c2061 fix(anthropic_text.py): fix linting error 2024-05-11 20:01:50 -07:00
Krrish Dholakia
8592a73881 fix(bedrock_httpx.py): compatibility fix 2024-05-11 19:55:38 -07:00
Krrish Dholakia
2b1c22f088 fix(anthropic.py): compatibility fix 2024-05-11 19:51:29 -07:00
Krrish Dholakia
cfab989abf fix(anthropic.py): fix version compatibility 2024-05-11 19:46:26 -07:00
Krrish Dholakia
6018c8ab77 fix(anthropic.py): fix linting error 2024-05-11 19:42:14 -07:00
Krrish Dholakia
68596ced04 feat(bedrock_httpx.py): working bedrock command-r sync+async streaming 2024-05-11 19:39:51 -07:00
Krrish Dholakia
bd0c3a81cb fix(bedrock_httpx.py): working async bedrock command r calls 2024-05-11 16:45:20 -07:00
Krrish Dholakia
5185580e3d feat(bedrock_httpx.py): working cohere command r async calls 2024-05-11 15:04:38 -07:00