Commit graph

153 commits

Author SHA1 Message Date
Krrish Dholakia
664c40a4c7 fix(vertex_httpx.py): fix json schema call to pass in response_mime_type=="application/json" 2024-08-21 15:24:04 -07:00
Krish Dholakia
0916197c9d Merge pull request #5244 from BerriAI/litellm_better_error_logging_sentry
refactor: replace .error() with .exception() logging for better debugging on sentry
2024-08-16 19:16:20 -07:00
Ishaan Jaff
5790275de5 skip InternalServerError on vertex test 2024-08-16 14:51:51 -07:00
Krrish Dholakia
2874b94fb1 refactor: replace .error() with .exception() logging for better debugging on sentry 2024-08-16 09:22:47 -07:00
Ishaan Jaff
ee39f65baa add tests to make sure correct vertex ai route is used 2024-08-08 11:28:19 -07:00
Krrish Dholakia
4707861ee4 test(test_amazing_vertex_completion.py): fix test for json schema validation in openai schema 2024-08-07 18:39:20 -07:00
Krrish Dholakia
831dc1b886 feat: Translate openai 'response_format' json_schema to 'response_schema' for vertex ai + google ai studio
Closes https://github.com/BerriAI/litellm/issues/5074
2024-08-06 19:06:14 -07:00
Krrish Dholakia
1527f2bd80 feat(vertex_httpx.py): Support gemini 'response_schema' param
Fixes https://github.com/BerriAI/litellm/pull/3366#issuecomment-2269183338
2024-08-05 07:56:44 -07:00
Krrish Dholakia
2121738137 fix(vertex_ai_partner.py): add /chat/completion codestral support
Closes https://github.com/BerriAI/litellm/issues/4984
2024-08-01 16:12:05 -07:00
Krrish Dholakia
77e5cb89ed fix(google.py): fix cost tracking for vertex ai mistral models 2024-08-01 15:22:32 -07:00
Ishaan Jaff
ccc296b312 fix test_completion_function_plus_pdf 2024-07-31 13:53:06 -07:00
Krrish Dholakia
802e39b606 fix(utils.py): fix cost tracking for vertex ai partner models 2024-07-30 14:20:52 -07:00
Krrish Dholakia
a6b053f535 feat(databricks.py): support vertex mistral cost tracking 2024-07-27 20:22:35 -07:00
Krrish Dholakia
ce7257ec5e feat(vertex_ai_partner.py): initial working commit for calling vertex ai mistral
Closes https://github.com/BerriAI/litellm/issues/4874
2024-07-27 12:54:14 -07:00
Krrish Dholakia
6a4001c4f4 fix(vertex_ai_llama3.py): Fix llama3 streaming issue
Closes https://github.com/BerriAI/litellm/issues/4885
2024-07-25 22:30:55 -07:00
Krrish Dholakia
d3ff21181c fix(litellm_cost_calc/google.py): support meta llama vertex ai cost tracking 2024-07-25 22:12:07 -07:00
Krrish Dholakia
778afcee31 feat(vertex_ai_llama.py): vertex ai llama3.1 api support
Initial working commit for vertex ai llama 3.1 api support
2024-07-23 17:07:30 -07:00
Krish Dholakia
2c6482b6e1 Merge branch 'main' into litellm_anthropic_response_schema_support 2024-07-18 20:40:16 -07:00
Ishaan Jaff
60295729b9 fix test amazing vertex medlm 2024-07-18 18:16:00 -07:00
Krrish Dholakia
aac912d3f8 feat(vertex_ai_anthropic.py): support response_schema for vertex ai anthropic calls
allows passing response_schema for anthropic calls. supports schema validation.
2024-07-18 16:57:38 -07:00
Krrish Dholakia
783555a693 fix(factory.py): allow converting pdf url to base64 2024-07-15 21:11:53 -07:00
Krrish Dholakia
58ed852a25 fix(vertex_httpx.py): return grounding metadata 2024-07-15 19:43:37 -07:00
Krrish Dholakia
015d1a4fd9 fix(vertex_httpx.py): google search grounding fix 2024-07-14 08:06:17 -07:00
Krrish Dholakia
f98c819d4b fix(vertex_httpx.py): fix gtool handling 2024-07-09 08:01:49 -07:00
Krrish Dholakia
71ad281c0a feat(vertex_httpx.py): add support for gemini 'grounding'
Adds support for https://cloud.google.com/vertex-ai/generative-ai/docs/model-reference/grounding#rest
2024-07-08 21:37:07 -07:00
Krrish Dholakia
f10e0e096e test(test_amazing_vertex_completion.py): pass pdf as base64 to vertex ai 2024-07-08 10:01:47 -07:00
Krrish Dholakia
d0862697b8 fix(vertex_httpx.py): fix supported vertex params 2024-07-04 21:17:52 -07:00
Krrish Dholakia
cceb7b59db fix(cohere.py): fix message parsing to handle tool calling correctly 2024-07-04 11:13:07 -07:00
Krish Dholakia
750b10bd03 Merge pull request #4522 from andrewmjc/matchingToolMessageSpec
[Bug Fix] Use OpenAI Tool Response Spec When Converting To Gemini/VertexAI Tool Response
2024-07-04 08:03:38 -07:00
Krrish Dholakia
dca952f117 fix: linting fixes 2024-07-03 21:55:00 -07:00
Krish Dholakia
06c6c65d2a Merge branch 'main' into litellm_anthropic_tool_calling_streaming_fix 2024-07-03 20:43:51 -07:00
Krrish Dholakia
4a6471e075 fix(utils.py): fix vertex anthropic streaming 2024-07-03 18:43:46 -07:00
Krish Dholakia
4e1b247c1d Revert "fix(vertex_anthropic.py): Vertex Anthropic tool calling - native params " 2024-07-03 17:55:37 -07:00
Krrish Dholakia
46800ba20a fix(vertex_anthropic.py): Updates the vertex anthropic endpoint to do tool calling with the anthropic api params 2024-07-03 15:28:31 -07:00
andrewmjc
4fc03fbb70 unit test 2024-07-03 12:23:26 -06:00
Krrish Dholakia
c7555b360f test(test_amazing_vertex_completion.py): reduce vertex tests - quota exhaustion 2024-06-29 19:58:01 -07:00
Krrish Dholakia
b30daadeed fix(utils.py): add 'enforce_validation' param 2024-06-29 19:57:41 -07:00
Krrish Dholakia
39833762cf fix(vertex_ai_anthropic.py): support pre-filling "{" for json mode 2024-06-29 18:54:10 -07:00
Krrish Dholakia
8ba78aae77 fix(utils.py): support json schema validation 2024-06-29 15:05:52 -07:00
Krrish Dholakia
ad6625ae47 feat(vertex_httpx.py): support the 'response_schema' param for older vertex ai models - pass as prompt (user-controlled)
if 'response_schema' is not supported for vertex model (e.g. gemini-1.5-flash) pass in prompt
2024-06-29 13:25:27 -07:00
Krrish Dholakia
d9177f189e fix(vertex_httpx.py): support passing response_schema to gemini 2024-06-29 11:33:19 -07:00
Krrish Dholakia
510826c457 fix(vertex_httpx.py): fix streaming for cloudflare proxy calls 2024-06-29 09:09:56 -07:00
Ishaan Jaff
21314e817a vertex testing 2024-06-26 18:08:54 -07:00
Krrish Dholakia
cdf56dd320 fix(vertex_httpx.py): Return empty model response for content filter violations 2024-06-24 19:22:20 -07:00
Krrish Dholakia
7d0278d6da test: trigger new build 2024-06-20 21:42:42 -07:00
Krrish Dholakia
c88c3002a4 fix(vertex_httpx.py): allow passing extra headers
Closes https://github.com/BerriAI/litellm/pull/4327
2024-06-20 21:14:44 -07:00
Krrish Dholakia
1f87f45709 fix(vertex_httpx.py): support setting custom api base for vertex ai calls
Closes https://github.com/BerriAI/litellm/issues/4317
2024-06-20 16:33:37 -07:00
Krrish Dholakia
7e26d3f011 test(test_amazing_vertex_completion.py): fix test 2024-06-19 19:25:45 -07:00
Krrish Dholakia
e352f954b0 fix(vertex_ai.py): check if message length > 0 before merging 2024-06-19 18:47:43 -07:00
Krrish Dholakia
0a96865c48 fix(vertex_httpx.py): fix supports system message check for vertex_ai_beta
Fixes https://github.com/BerriAI/litellm/issues/4283
2024-06-19 13:17:22 -07:00