Commit graph

90 commits

Author SHA1 Message Date
Rajan Paneru
2e25416c02 Table format fix and Typo
* Fixed marked down table formats because they were looking ugly in pycharm
* Typos Fixes.
2024-06-06 22:29:59 +09:30
Ishaan Jaff
f52bf5976b fix - vertex ai cache clients 2024-05-30 21:22:32 -07:00
Krrish Dholakia
281906ff33 fix(vertex_ai.py): handle nested content dictionary for assistant message
openai allows the assistant content message to also be a list of dictionaries, handle that
2024-05-24 22:47:47 -07:00
Krrish Dholakia
49b71c8118 fix(vertex_ai.py): revert system instructions - unable to find supported vertex version 2024-05-20 06:30:11 -07:00
Krrish Dholakia
45c46a84d0 fix(vertex_ai.py): support passing system instructions to vertex ai 2024-05-20 06:18:19 -07:00
Krrish Dholakia
65aacc0c1a fix(vertex_ai.py): use chat_messages_with_history for async + streaming calls 2024-05-19 12:30:24 -07:00
Krrish Dholakia
f9ab72841a fix(vertex_ai.py): passing all tests on 'test_amazing_vertex_completion.py 2024-05-19 12:22:21 -07:00
Krrish Dholakia
a2c66ed4fb fix(vertex_ai.py): support passing in result of tool call to vertex
Fixes https://github.com/BerriAI/litellm/issues/3709
2024-05-19 11:34:07 -07:00
Krrish Dholakia
04ae285001 fix(vertex_ai.py): support tool call list response async completion 2024-05-13 10:42:31 -07:00
Krrish Dholakia
6714854bb7 feat(router.py): support region routing for bedrock, vertex ai, watsonx 2024-05-11 11:04:00 -07:00
Krrish Dholakia
c12af219af fix: fix linting 2024-05-10 20:23:33 -07:00
Krrish Dholakia
94f3d361b0 fix(vertex_ai.py): fix list tool call responses
Closes https://github.com/BerriAI/litellm/issues/3147
2024-05-10 20:05:58 -07:00
Krrish Dholakia
6575143460 feat(proxy_server.py): return litellm version in response headers 2024-05-08 16:00:08 -07:00
Krish Dholakia
1841b74f49
Merge branch 'main' into litellm_common_auth_params 2024-04-28 08:38:06 -07:00
Krrish Dholakia
463b1aff24 fix(vertex_ai.py): support safety settings for async streaming calls 2024-04-27 11:43:22 -07:00
Krrish Dholakia
48f19cf839 feat(utils.py): unify common auth params across azure/vertex_ai/bedrock/watsonx 2024-04-27 11:06:18 -07:00
pwm
6fedcb873b add safety_settings parameters to Vertex vision async_completion function 2024-04-26 14:35:01 +08:00
Krrish Dholakia
5f8d88d363 fix(vertex_ai.py): handle stream=false
also adds unit testing for vertex ai calls with langchain
2024-04-25 13:59:37 -07:00
Krish Dholakia
435a4b5ed4
Merge pull request #3267 from BerriAI/litellm_openai_streaming_fix
fix(utils.py): fix streaming to not return usage dict
2024-04-24 21:08:33 -07:00
Krrish Dholakia
b918f58262 fix(vertex_ai.py): raise explicit error when image url fails to download - prevents silent failure 2024-04-24 09:23:15 -07:00
Krrish Dholakia
48c2c3d78a fix(utils.py): fix streaming to not return usage dict
Fixes https://github.com/BerriAI/litellm/issues/3237
2024-04-24 08:06:07 -07:00
Krrish Dholakia
ec2c70e362 fix(vertex_ai.py): fix streaming logic 2024-04-22 19:15:20 -07:00
Krrish Dholakia
0bb8a4434e fix(vertex_ai.py): remove ExtendedGenerationConfig usage 2024-04-22 18:23:21 -07:00
David Manouchehri
c643e04ada
improve(vertex_ai.py): Add frequency_penalty and presence_penalty. 2024-04-22 18:02:59 +00:00
David Manouchehri
1a7eec5786
improve(vertex_ai.py): Switch to simpler dict type. 2024-04-22 17:00:37 +00:00
Krrish Dholakia
c47b39c032 fix(vertex_ai.py): fix faulty async completion function call tool check 2024-04-17 16:30:28 -07:00
Krrish Dholakia
32d94feddd refactor(utils.py): make it clearer how vertex ai params are handled '
'
2024-04-17 16:20:56 -07:00
Krrish Dholakia
060ac995d6 fix(vertex_ai.py): accept credentials as a json string 2024-04-16 17:34:25 -07:00
Krrish Dholakia
1ec7118e1f fix(vertex_ai_anthropic.py): set vertex_credentials for vertex ai anthropic calls
allows setting vertex credentials as a json string for vertex ai anthropic calls
2024-04-15 14:16:28 -07:00
Krrish Dholakia
77d6b882b8 fix(vertex_ai.py): check if 'response_mime_type' in generation config before passing it in 2024-04-11 23:10:59 -07:00
David Manouchehri
05350037be
(feat) - Extreme dirty hack for response_mime_type in Vertex AI. 2024-04-12 00:03:31 +00:00
David Manouchehri
d08674bf2f
(feat) - Dirty hack to get response_mime_type working before it's released in the Python SDK. 2024-04-12 00:03:30 +00:00
David Manouchehri
649c3bb0dd
(feat) - Add support for JSON mode in Vertex AI 2024-04-12 00:03:29 +00:00
Krrish Dholakia
67b1ad622f feat(gemini.py): support google-genai system instruction 2024-04-09 17:23:14 -07:00
Krrish Dholakia
84a540f2d6 build: fix mypy build issues 2024-03-21 08:27:23 -07:00
Krrish Dholakia
cdb960eb34 fix(vertex_ai.py): correctly parse optional params and pass vertex ai project 2024-03-06 14:00:50 -08:00
Krrish Dholakia
2fac06de08 refactor(vertex_ai.py): add more logging for the vertex_ai file 2024-03-01 08:33:26 -08:00
ishaan-jaff
8d76df6a5e (test) vertex - detect mime type 2024-02-29 15:38:25 -08:00
ishaan-jaff
8a96aa4ef0 (feat) add support for gemini base64 images 2024-02-29 14:42:20 -08:00
Krrish Dholakia
6352c8869c refactor(vertex_ai.py): add more logging to show the vertex ai client init params 2024-02-27 18:35:15 -08:00
Krrish Dholakia
e48fff47dd test(test_custom_callback_input.py): assert async success called only once during vertex ai streaming 2024-02-26 09:18:46 -08:00
Krrish Dholakia
9d17a0789f fix(vertex_ai.py): fix vertex ai function calling 2024-02-22 21:28:24 -08:00
Krish Dholakia
851473b71a
Merge pull request #1969 from kan-bayashi/fix/support-multiple-tools-in-gemini
fix: fix the issues when using tools in gemini
2024-02-21 11:46:26 -08:00
Krish Dholakia
9b60ef9a3c
Merge pull request #1916 from RenaLu/main
Add support for Vertex AI custom models deployed on private endpoint
2024-02-15 22:47:36 -08:00
Rena Lu
02c58a9760 update request strings 2024-02-14 17:15:16 -05:00
Rena Lu
8c39a631d3 update request string 2024-02-14 22:11:55 +00:00
Krrish Dholakia
fe1fe70c64 fix(vertex_ai.py): map finish reason 2024-02-14 11:42:13 -08:00
kan-bayashi
90775910e2 fix if-else condition when function_call exits but empty 2024-02-14 17:38:00 +09:00
kan-bayashi
917525ee43 fix args=None case 2024-02-14 14:49:42 +09:00
Rena Lu
ce7ce3b719 fix optional params 2024-02-13 20:50:26 +00:00