Commit graph

51 commits

Author SHA1 Message Date
Krrish Dholakia
3aaa0fe98d refactor(vertex_ai.py): add more logging to show the vertex ai client init params 2024-02-27 18:35:15 -08:00
Krrish Dholakia
8f954fed24 test(test_custom_callback_input.py): assert async success called only once during vertex ai streaming 2024-02-26 09:18:46 -08:00
Krrish Dholakia
2e5a5f82a3 fix(vertex_ai.py): fix vertex ai function calling 2024-02-22 21:28:24 -08:00
Krish Dholakia
d1cd3073c3 Merge pull request #1969 from kan-bayashi/fix/support-multiple-tools-in-gemini
fix: fix the issues when using tools in gemini
2024-02-21 11:46:26 -08:00
Krish Dholakia
233aff5ba9 Merge pull request #1916 from RenaLu/main
Add support for Vertex AI custom models deployed on private endpoint
2024-02-15 22:47:36 -08:00
Rena Lu
b553b9c214 update request strings 2024-02-14 17:15:16 -05:00
Rena Lu
24b5c0e115 update request string 2024-02-14 22:11:55 +00:00
Krrish Dholakia
5d21da021f fix(vertex_ai.py): map finish reason 2024-02-14 11:42:13 -08:00
kan-bayashi
612246e6f4 fix if-else condition when function_call exits but empty 2024-02-14 17:38:00 +09:00
kan-bayashi
4ab21eff3a fix args=None case 2024-02-14 14:49:42 +09:00
Rena Lu
30453bd751 fix optional params 2024-02-13 20:50:26 +00:00
Rena Lu
d57f8dbf43 delete print 2024-02-13 18:49:56 +00:00
Rena Lu
d59a4b8cae update private async 2024-02-13 18:33:52 +00:00
Rena Lu
2444f823eb refactor to separate private mode with custom mode 2024-02-12 18:20:48 -05:00
Rena Lu
81adef1261 remove prints 2024-02-09 16:25:29 -05:00
Rena Lu
ea29baf3b8 add vertex ai private endpoint support 2024-02-09 16:19:26 -05:00
Krrish Dholakia
7e2c7259e6 fix(vertex_ai.py): add async embedding support for vertex ai 2024-02-03 10:35:17 -08:00
Krrish Dholakia
3f23b18dad feat(vertex_ai.py): vertex ai gecko text embedding support 2024-02-03 09:48:29 -08:00
Krrish Dholakia
14f816a781 fix(vertex_ai.py): fix params 2024-02-01 18:09:49 -08:00
Krrish Dholakia
07b60b63cd feat(vertex_ai.py): add support for custom models via vertex ai model garden 2024-02-01 17:47:34 -08:00
Eslam karim gaber
afbcd9d78e imports 2024-01-28 23:14:06 +02:00
Eslam karim gaber
173e32bfa9 Change quota project to the correct project being used for the call
if not set it will use the default project in the ADC to set that quota project which is usually different 
https://github.com/googleapis/python-aiplatform/issues/2557#issuecomment-1709284744
2024-01-28 19:55:01 +02:00
Krrish Dholakia
f7e8bdbb32 fix(vertex_ai.py): raise exception if vertex ai missing required dependendencies 2024-01-16 16:23:29 -08:00
ishaan-jaff
224d38ba48 (fix) vertex ai - use usage from response 2023-12-29 16:30:25 +05:30
Krrish Dholakia
5a48dac83f fix(vertex_ai.py): support function calling for gemini 2023-12-28 19:07:04 +05:30
Krrish Dholakia
79978c44ba refactor: add black formatting 2023-12-25 14:11:20 +05:30
Graham Neubig
23b7a8a5ac Update the request_str 2023-12-21 09:58:06 -05:00
Graham Neubig
b630528ef3 Make vertex_chat work with generate_content 2023-12-20 15:32:44 -05:00
Graham Neubig
c6b803ffaa Add a default for safety settings in vertex AI 2023-12-20 13:12:50 -05:00
Graham Neubig
efb4af930b Add partial support of vertexai safety settings 2023-12-19 22:26:55 -05:00
ishaan-jaff
a97aa37d84 (fix) vertexai - gemini 2023-12-16 22:15:41 +05:30
ishaan-jaff
5a5ab37560 (feat) add async, async+stream for gemini 2023-12-16 18:58:12 +05:30
ishaan-jaff
ea91cd7b83 (fix) use litellm.vertex_vision_models 2023-12-16 18:39:40 +05:30
ishaan-jaff
03b55820a1 (feat) add vertex ai gemini-pro-vision 2023-12-16 18:31:03 +05:30
Krrish Dholakia
c673a23769 fix(vertex_ai.py): add exception mapping for acompletion calls 2023-12-13 16:35:50 -08:00
Krrish Dholakia
13a7f2dd58 fix(vertex_ai.py): add support for real async streaming + completion calls 2023-12-13 11:53:55 -08:00
Krrish Dholakia
f51d4ab26d fix(vertex_ai.py): support optional params + enable async calls for gemini 2023-12-13 11:01:23 -08:00
Krrish Dholakia
43b160d70d feat(vertex_ai.py): adds support for gemini-pro on vertex ai 2023-12-13 10:26:30 -08:00
ishaan-jaff
4bcddec2ce (feat) pass vertex_ai/ as custom_llm_provider 2023-12-13 19:02:24 +03:00
ishaan-jaff
bfaf504271 (feat) vertex ai - better debugging 2023-12-07 09:38:37 -08:00
Krrish Dholakia
78d13ea6eb fix(vertex_ai.py): fix exception mapping for vertex ai 2023-11-23 17:35:33 -08:00
ishaan-jaff
7bc28f3b1c (fix) pydantic errors with response.time 2023-11-20 18:28:19 -08:00
Krrish Dholakia
9c7cc84eb0 fix(openai.py): supporting openai client sdk for handling sync + async calls (incl. for openai-compatible apis) 2023-11-16 10:35:03 -08:00
Krrish Dholakia
9b582b2c85 fix(main.py): keep client consistent across calls + exponential backoff retry on ratelimit errors 2023-11-14 16:26:05 -08:00
Krrish Dholakia
4b74ddcb17 refactor: fixing linting issues 2023-11-11 18:52:28 -08:00
ishaan-jaff
fbd5117a6d (fix) vertex ai streaming 2023-11-03 12:54:36 -07:00
ishaan-jaff
66e934b0ad (feat) use usage class for vertex ai 2023-10-27 09:38:37 -07:00
Krrish Dholakia
98c25b08cd fix(vertex_ai.py): fix output parsing 2023-10-24 12:08:22 -07:00
Krrish Dholakia
5e83c34913 fix(vertex_ai.py): parse out text response from response object 2023-10-24 08:53:22 -07:00
Krrish Dholakia
cc0e4f4f9f fix: fix value error if model returns empty completion 2023-10-10 10:11:40 -07:00