Commit graph

128 commits

Author SHA1 Message Date
Krrish Dholakia
86596c53e9 refactor(main.py): migrate vertex gemini calls to vertex_httpx
Completes migration to vertex_httpx
2024-07-06 20:08:52 -07:00
Krrish Dholakia
c425cba93a fix(vertex_httpx.py): fix supported vertex params 2024-07-04 21:17:52 -07:00
Krrish Dholakia
a8e181369d fix(cohere.py): fix message parsing to handle tool calling correctly 2024-07-04 11:13:07 -07:00
Krish Dholakia
3184640291
Merge pull request #4522 from andrewmjc/matchingToolMessageSpec
[Bug Fix] Use OpenAI Tool Response Spec When Converting To Gemini/VertexAI Tool Response
2024-07-04 08:03:38 -07:00
Krrish Dholakia
19c982d0f9 fix: linting fixes 2024-07-03 21:55:00 -07:00
Krish Dholakia
5e47970eed
Merge branch 'main' into litellm_anthropic_tool_calling_streaming_fix 2024-07-03 20:43:51 -07:00
Krrish Dholakia
ed5fc3d1f9 fix(utils.py): fix vertex anthropic streaming 2024-07-03 18:43:46 -07:00
Krish Dholakia
6c5c8bbb28
Revert "fix(vertex_anthropic.py): Vertex Anthropic tool calling - native params " 2024-07-03 17:55:37 -07:00
Krrish Dholakia
7007ace6c2 fix(vertex_anthropic.py): Updates the vertex anthropic endpoint to do tool calling with the anthropic api params 2024-07-03 15:28:31 -07:00
andrewmjc
95dc480204 unit test 2024-07-03 12:23:26 -06:00
Krrish Dholakia
5df940c54d test(test_amazing_vertex_completion.py): reduce vertex tests - quota exhaustion 2024-06-29 19:58:01 -07:00
Krrish Dholakia
3f9859e638 fix(utils.py): add 'enforce_validation' param 2024-06-29 19:57:41 -07:00
Krrish Dholakia
4b1e85f54e fix(vertex_ai_anthropic.py): support pre-filling "{" for json mode 2024-06-29 18:54:10 -07:00
Krrish Dholakia
b699d9a8b9 fix(utils.py): support json schema validation 2024-06-29 15:05:52 -07:00
Krrish Dholakia
05dfc63b88 feat(vertex_httpx.py): support the 'response_schema' param for older vertex ai models - pass as prompt (user-controlled)
if 'response_schema' is not supported for vertex model (e.g. gemini-1.5-flash) pass in prompt
2024-06-29 13:25:27 -07:00
Krrish Dholakia
e73e9e12bc fix(vertex_httpx.py): support passing response_schema to gemini 2024-06-29 11:33:19 -07:00
Krrish Dholakia
4f32f283a3 fix(vertex_httpx.py): fix streaming for cloudflare proxy calls 2024-06-29 09:09:56 -07:00
Ishaan Jaff
7264113c25 vertex testing 2024-06-26 18:08:54 -07:00
Krrish Dholakia
8e6e5a6d37 fix(vertex_httpx.py): Return empty model response for content filter violations 2024-06-24 19:22:20 -07:00
Krrish Dholakia
97d33324df test: trigger new build 2024-06-20 21:42:42 -07:00
Krrish Dholakia
dfd5882c31 fix(vertex_httpx.py): allow passing extra headers
Closes https://github.com/BerriAI/litellm/pull/4327
2024-06-20 21:14:44 -07:00
Krrish Dholakia
d3a3146155 fix(vertex_httpx.py): support setting custom api base for vertex ai calls
Closes https://github.com/BerriAI/litellm/issues/4317
2024-06-20 16:33:37 -07:00
Krrish Dholakia
8da3e5ad66 test(test_amazing_vertex_completion.py): fix test 2024-06-19 19:25:45 -07:00
Krrish Dholakia
4c5f077bd3 fix(vertex_ai.py): check if message length > 0 before merging 2024-06-19 18:47:43 -07:00
Krrish Dholakia
933c3c845e fix(vertex_httpx.py): fix supports system message check for vertex_ai_beta
Fixes https://github.com/BerriAI/litellm/issues/4283
2024-06-19 13:17:22 -07:00
Krish Dholakia
0c2c02ba8d
Merge pull request #4266 from BerriAI/litellm_gemini_image_url
Support 'image url' to vertex ai / google ai studio gemini models
2024-06-18 20:39:25 -07:00
Krrish Dholakia
3546ab39d3 test: cleanup tests 2024-06-18 19:07:31 -07:00
Krrish Dholakia
f41c443abb fix(vertex_httpx.py): re-raise vertex content policy violation error
Fixes https://github.com/BerriAI/litellm/issues/4270
2024-06-18 19:00:35 -07:00
Krrish Dholakia
ae9f1a0e52 test: cleanup tests 2024-06-18 11:01:00 -07:00
Krrish Dholakia
3f7252c422 fix(support-passing-image-url-to-gemini-via-vertex-ai): Closes https://github.com/BerriAI/litellm/issues/4262 2024-06-18 10:55:58 -07:00
Krrish Dholakia
df753a8ab2 fix(cost_calculator.py): fix time import 2024-06-17 20:27:18 -07:00
Krrish Dholakia
9c4e6d85ed test: reduce vertex test to avoid exhausting limits 2024-06-12 22:32:45 -07:00
Ishaan Jaff
4bf33ef267 (ci/cd) run again 2024-06-12 22:26:15 -07:00
Ishaan Jaff
45aa59c017 fix vertex test 2024-06-12 22:22:16 -07:00
Krrish Dholakia
9213f69f60 test(test_amazing_vertex_completion.py): reduce vertex tests to avoid exhausting quota 2024-06-12 22:08:43 -07:00
Krrish Dholakia
42f326a164 fix(vertex_httpx.py): support json schema 2024-06-12 21:46:43 -07:00
Krish Dholakia
05e21441a6
Merge branch 'main' into litellm_vertex_completion_httpx 2024-06-12 21:19:22 -07:00
Krrish Dholakia
c426d75e91 fix(vertex_httpx.py): add function calling support to httpx route 2024-06-12 21:11:00 -07:00
Krrish Dholakia
995631bd39 fix(vertex_httpx.py): support async completion calls 2024-06-12 20:15:03 -07:00
Krrish Dholakia
3b913443fe feat(vertex_httpx.py): Moving to call vertex ai via httpx (instead of their sdk). Allows us to support all their api updates. 2024-06-12 16:47:00 -07:00
Ishaan Jaff
37d14a5e8c test_vertexai_embedding_embedding_latest 2024-06-12 11:00:27 -07:00
Ishaan Jaff
8dffc8620c test test_vertexai_embedding_embedding_latest 2024-06-12 10:13:48 -07:00
Ishaan Jaff
b9f50d83c4 test - support vertex ai ertexai_embedding_embedding 2024-06-12 09:32:32 -07:00
Ishaan Jaff
3af2d7846e add text-embedding-004 2024-06-12 08:31:37 -07:00
Krrish Dholakia
5f99938cb8 test(test_amazing_vertex_completion.py): add retries for 'Content has no parts.' error in vertex test 2024-06-03 14:06:36 -07:00
Krrish Dholakia
281906ff33 fix(vertex_ai.py): handle nested content dictionary for assistant message
openai allows the assistant content message to also be a list of dictionaries, handle that
2024-05-24 22:47:47 -07:00
Krrish Dholakia
45c46a84d0 fix(vertex_ai.py): support passing system instructions to vertex ai 2024-05-20 06:18:19 -07:00
Krrish Dholakia
65aacc0c1a fix(vertex_ai.py): use chat_messages_with_history for async + streaming calls 2024-05-19 12:30:24 -07:00
Krrish Dholakia
f9ab72841a fix(vertex_ai.py): passing all tests on 'test_amazing_vertex_completion.py 2024-05-19 12:22:21 -07:00
Krrish Dholakia
a2c66ed4fb fix(vertex_ai.py): support passing in result of tool call to vertex
Fixes https://github.com/BerriAI/litellm/issues/3709
2024-05-19 11:34:07 -07:00