Commit graph

81 commits

Author SHA1 Message Date
Krrish Dholakia
6714854bb7 feat(router.py): support region routing for bedrock, vertex ai, watsonx 2024-05-11 11:04:00 -07:00
Krrish Dholakia
c12af219af fix: fix linting 2024-05-10 20:23:33 -07:00
Krrish Dholakia
94f3d361b0 fix(vertex_ai.py): fix list tool call responses
Closes https://github.com/BerriAI/litellm/issues/3147
2024-05-10 20:05:58 -07:00
Krrish Dholakia
6575143460 feat(proxy_server.py): return litellm version in response headers 2024-05-08 16:00:08 -07:00
Krish Dholakia
1841b74f49
Merge branch 'main' into litellm_common_auth_params 2024-04-28 08:38:06 -07:00
Krrish Dholakia
463b1aff24 fix(vertex_ai.py): support safety settings for async streaming calls 2024-04-27 11:43:22 -07:00
Krrish Dholakia
48f19cf839 feat(utils.py): unify common auth params across azure/vertex_ai/bedrock/watsonx 2024-04-27 11:06:18 -07:00
pwm
6fedcb873b add safety_settings parameters to Vertex vision async_completion function 2024-04-26 14:35:01 +08:00
Krrish Dholakia
5f8d88d363 fix(vertex_ai.py): handle stream=false
also adds unit testing for vertex ai calls with langchain
2024-04-25 13:59:37 -07:00
Krish Dholakia
435a4b5ed4
Merge pull request #3267 from BerriAI/litellm_openai_streaming_fix
fix(utils.py): fix streaming to not return usage dict
2024-04-24 21:08:33 -07:00
Krrish Dholakia
b918f58262 fix(vertex_ai.py): raise explicit error when image url fails to download - prevents silent failure 2024-04-24 09:23:15 -07:00
Krrish Dholakia
48c2c3d78a fix(utils.py): fix streaming to not return usage dict
Fixes https://github.com/BerriAI/litellm/issues/3237
2024-04-24 08:06:07 -07:00
Krrish Dholakia
ec2c70e362 fix(vertex_ai.py): fix streaming logic 2024-04-22 19:15:20 -07:00
Krrish Dholakia
0bb8a4434e fix(vertex_ai.py): remove ExtendedGenerationConfig usage 2024-04-22 18:23:21 -07:00
David Manouchehri
c643e04ada
improve(vertex_ai.py): Add frequency_penalty and presence_penalty. 2024-04-22 18:02:59 +00:00
David Manouchehri
1a7eec5786
improve(vertex_ai.py): Switch to simpler dict type. 2024-04-22 17:00:37 +00:00
Krrish Dholakia
c47b39c032 fix(vertex_ai.py): fix faulty async completion function call tool check 2024-04-17 16:30:28 -07:00
Krrish Dholakia
32d94feddd refactor(utils.py): make it clearer how vertex ai params are handled '
'
2024-04-17 16:20:56 -07:00
Krrish Dholakia
060ac995d6 fix(vertex_ai.py): accept credentials as a json string 2024-04-16 17:34:25 -07:00
Krrish Dholakia
1ec7118e1f fix(vertex_ai_anthropic.py): set vertex_credentials for vertex ai anthropic calls
allows setting vertex credentials as a json string for vertex ai anthropic calls
2024-04-15 14:16:28 -07:00
Krrish Dholakia
77d6b882b8 fix(vertex_ai.py): check if 'response_mime_type' in generation config before passing it in 2024-04-11 23:10:59 -07:00
David Manouchehri
05350037be
(feat) - Extreme dirty hack for response_mime_type in Vertex AI. 2024-04-12 00:03:31 +00:00
David Manouchehri
d08674bf2f
(feat) - Dirty hack to get response_mime_type working before it's released in the Python SDK. 2024-04-12 00:03:30 +00:00
David Manouchehri
649c3bb0dd
(feat) - Add support for JSON mode in Vertex AI 2024-04-12 00:03:29 +00:00
Krrish Dholakia
67b1ad622f feat(gemini.py): support google-genai system instruction 2024-04-09 17:23:14 -07:00
Krrish Dholakia
84a540f2d6 build: fix mypy build issues 2024-03-21 08:27:23 -07:00
Krrish Dholakia
cdb960eb34 fix(vertex_ai.py): correctly parse optional params and pass vertex ai project 2024-03-06 14:00:50 -08:00
Krrish Dholakia
2fac06de08 refactor(vertex_ai.py): add more logging for the vertex_ai file 2024-03-01 08:33:26 -08:00
ishaan-jaff
8d76df6a5e (test) vertex - detect mime type 2024-02-29 15:38:25 -08:00
ishaan-jaff
8a96aa4ef0 (feat) add support for gemini base64 images 2024-02-29 14:42:20 -08:00
Krrish Dholakia
6352c8869c refactor(vertex_ai.py): add more logging to show the vertex ai client init params 2024-02-27 18:35:15 -08:00
Krrish Dholakia
e48fff47dd test(test_custom_callback_input.py): assert async success called only once during vertex ai streaming 2024-02-26 09:18:46 -08:00
Krrish Dholakia
9d17a0789f fix(vertex_ai.py): fix vertex ai function calling 2024-02-22 21:28:24 -08:00
Krish Dholakia
851473b71a
Merge pull request #1969 from kan-bayashi/fix/support-multiple-tools-in-gemini
fix: fix the issues when using tools in gemini
2024-02-21 11:46:26 -08:00
Krish Dholakia
9b60ef9a3c
Merge pull request #1916 from RenaLu/main
Add support for Vertex AI custom models deployed on private endpoint
2024-02-15 22:47:36 -08:00
Rena Lu
02c58a9760 update request strings 2024-02-14 17:15:16 -05:00
Rena Lu
8c39a631d3 update request string 2024-02-14 22:11:55 +00:00
Krrish Dholakia
fe1fe70c64 fix(vertex_ai.py): map finish reason 2024-02-14 11:42:13 -08:00
kan-bayashi
90775910e2 fix if-else condition when function_call exits but empty 2024-02-14 17:38:00 +09:00
kan-bayashi
917525ee43 fix args=None case 2024-02-14 14:49:42 +09:00
Rena Lu
ce7ce3b719 fix optional params 2024-02-13 20:50:26 +00:00
Rena Lu
3fc0d8fda9 delete print 2024-02-13 18:49:56 +00:00
Rena Lu
e011f8022a update private async 2024-02-13 18:33:52 +00:00
Rena Lu
60c0bec7b3 refactor to separate private mode with custom mode 2024-02-12 18:20:48 -05:00
Rena Lu
6833f37986 remove prints 2024-02-09 16:25:29 -05:00
Rena Lu
0e8a0aefd5 add vertex ai private endpoint support 2024-02-09 16:19:26 -05:00
Krrish Dholakia
0ffdf57dec fix(vertex_ai.py): add async embedding support for vertex ai 2024-02-03 10:35:17 -08:00
Krrish Dholakia
d9ba8668f4 feat(vertex_ai.py): vertex ai gecko text embedding support 2024-02-03 09:48:29 -08:00
Krrish Dholakia
0072d796f6 fix(vertex_ai.py): fix params 2024-02-01 18:09:49 -08:00
Krrish Dholakia
0f9e793daf feat(vertex_ai.py): add support for custom models via vertex ai model garden 2024-02-01 17:47:34 -08:00