Commit graph

88 commits

Author SHA1 Message Date
Krrish Dholakia
945162253c fix(vertex_ai.py): handle nested content dictionary for assistant message
openai allows the assistant content message to also be a list of dictionaries, handle that
2024-05-24 22:47:47 -07:00
Krrish Dholakia
81e35ba6c0 fix(vertex_ai.py): revert system instructions - unable to find supported vertex version 2024-05-20 06:30:11 -07:00
Krrish Dholakia
9e1a65c32a fix(vertex_ai.py): support passing system instructions to vertex ai 2024-05-20 06:18:19 -07:00
Krrish Dholakia
bb54839465 fix(vertex_ai.py): use chat_messages_with_history for async + streaming calls 2024-05-19 12:30:24 -07:00
Krrish Dholakia
50145b6ef3 fix(vertex_ai.py): passing all tests on 'test_amazing_vertex_completion.py 2024-05-19 12:22:21 -07:00
Krrish Dholakia
86ecb4638c fix(vertex_ai.py): support passing in result of tool call to vertex
Fixes https://github.com/BerriAI/litellm/issues/3709
2024-05-19 11:34:07 -07:00
Krrish Dholakia
3a356a6f56 fix(vertex_ai.py): support tool call list response async completion 2024-05-13 10:42:31 -07:00
Krrish Dholakia
691c185ff8 feat(router.py): support region routing for bedrock, vertex ai, watsonx 2024-05-11 11:04:00 -07:00
Krrish Dholakia
e12fa09489 fix: fix linting 2024-05-10 20:23:33 -07:00
Krrish Dholakia
bed16d5495 fix(vertex_ai.py): fix list tool call responses
Closes https://github.com/BerriAI/litellm/issues/3147
2024-05-10 20:05:58 -07:00
Krrish Dholakia
5f93cae3ff feat(proxy_server.py): return litellm version in response headers 2024-05-08 16:00:08 -07:00
Krish Dholakia
7ed64709aa Merge branch 'main' into litellm_common_auth_params 2024-04-28 08:38:06 -07:00
Krrish Dholakia
33b5829e31 fix(vertex_ai.py): support safety settings for async streaming calls 2024-04-27 11:43:22 -07:00
Krrish Dholakia
ee68c0aaaa feat(utils.py): unify common auth params across azure/vertex_ai/bedrock/watsonx 2024-04-27 11:06:18 -07:00
pwm
de5791a72b add safety_settings parameters to Vertex vision async_completion function 2024-04-26 14:35:01 +08:00
Krrish Dholakia
30f5bbd0cc fix(vertex_ai.py): handle stream=false
also adds unit testing for vertex ai calls with langchain
2024-04-25 13:59:37 -07:00
Krish Dholakia
265f16456f Merge pull request #3267 from BerriAI/litellm_openai_streaming_fix
fix(utils.py): fix streaming to not return usage dict
2024-04-24 21:08:33 -07:00
Krrish Dholakia
5abfb695f2 fix(vertex_ai.py): raise explicit error when image url fails to download - prevents silent failure 2024-04-24 09:23:15 -07:00
Krrish Dholakia
b10f03706d fix(utils.py): fix streaming to not return usage dict
Fixes https://github.com/BerriAI/litellm/issues/3237
2024-04-24 08:06:07 -07:00
Krrish Dholakia
3b6d204314 fix(vertex_ai.py): fix streaming logic 2024-04-22 19:15:20 -07:00
Krrish Dholakia
adfad86dc5 fix(vertex_ai.py): remove ExtendedGenerationConfig usage 2024-04-22 18:23:21 -07:00
David Manouchehri
6c7e931165 improve(vertex_ai.py): Add frequency_penalty and presence_penalty. 2024-04-22 18:02:59 +00:00
David Manouchehri
aa5ee6a626 improve(vertex_ai.py): Switch to simpler dict type. 2024-04-22 17:00:37 +00:00
Krrish Dholakia
77cb75bf2d fix(vertex_ai.py): fix faulty async completion function call tool check 2024-04-17 16:30:28 -07:00
Krrish Dholakia
72d7c36c76 refactor(utils.py): make it clearer how vertex ai params are handled '
'
2024-04-17 16:20:56 -07:00
Krrish Dholakia
6d508468ef fix(vertex_ai.py): accept credentials as a json string 2024-04-16 17:34:25 -07:00
Krrish Dholakia
8c3c45fbb5 fix(vertex_ai_anthropic.py): set vertex_credentials for vertex ai anthropic calls
allows setting vertex credentials as a json string for vertex ai anthropic calls
2024-04-15 14:16:28 -07:00
Krrish Dholakia
7a829f805d fix(vertex_ai.py): check if 'response_mime_type' in generation config before passing it in 2024-04-11 23:10:59 -07:00
David Manouchehri
ad8d35a378 (feat) - Extreme dirty hack for response_mime_type in Vertex AI. 2024-04-12 00:03:31 +00:00
David Manouchehri
c6b866925f (feat) - Dirty hack to get response_mime_type working before it's released in the Python SDK. 2024-04-12 00:03:30 +00:00
David Manouchehri
cc71ca3166 (feat) - Add support for JSON mode in Vertex AI 2024-04-12 00:03:29 +00:00
Krrish Dholakia
57ea6a1c4f feat(gemini.py): support google-genai system instruction 2024-04-09 17:23:14 -07:00
Krrish Dholakia
859a2af3ed build: fix mypy build issues 2024-03-21 08:27:23 -07:00
Krrish Dholakia
7f4dd734c1 fix(vertex_ai.py): correctly parse optional params and pass vertex ai project 2024-03-06 14:00:50 -08:00
Krrish Dholakia
3b5d5b6117 refactor(vertex_ai.py): add more logging for the vertex_ai file 2024-03-01 08:33:26 -08:00
ishaan-jaff
f1f3c97a7c (test) vertex - detect mime type 2024-02-29 15:38:25 -08:00
ishaan-jaff
d9632ae48c (feat) add support for gemini base64 images 2024-02-29 14:42:20 -08:00
Krrish Dholakia
3aaa0fe98d refactor(vertex_ai.py): add more logging to show the vertex ai client init params 2024-02-27 18:35:15 -08:00
Krrish Dholakia
8f954fed24 test(test_custom_callback_input.py): assert async success called only once during vertex ai streaming 2024-02-26 09:18:46 -08:00
Krrish Dholakia
2e5a5f82a3 fix(vertex_ai.py): fix vertex ai function calling 2024-02-22 21:28:24 -08:00
Krish Dholakia
d1cd3073c3 Merge pull request #1969 from kan-bayashi/fix/support-multiple-tools-in-gemini
fix: fix the issues when using tools in gemini
2024-02-21 11:46:26 -08:00
Krish Dholakia
233aff5ba9 Merge pull request #1916 from RenaLu/main
Add support for Vertex AI custom models deployed on private endpoint
2024-02-15 22:47:36 -08:00
Rena Lu
b553b9c214 update request strings 2024-02-14 17:15:16 -05:00
Rena Lu
24b5c0e115 update request string 2024-02-14 22:11:55 +00:00
Krrish Dholakia
5d21da021f fix(vertex_ai.py): map finish reason 2024-02-14 11:42:13 -08:00
kan-bayashi
612246e6f4 fix if-else condition when function_call exits but empty 2024-02-14 17:38:00 +09:00
kan-bayashi
4ab21eff3a fix args=None case 2024-02-14 14:49:42 +09:00
Rena Lu
30453bd751 fix optional params 2024-02-13 20:50:26 +00:00
Rena Lu
d57f8dbf43 delete print 2024-02-13 18:49:56 +00:00
Rena Lu
d59a4b8cae update private async 2024-02-13 18:33:52 +00:00