Commit graph

90 commits

Author SHA1 Message Date
Krish Dholakia
c503ff435e
Merge pull request #5368 from BerriAI/litellm_vertex_function_support
feat(vertex_httpx.py): support 'functions' param for gemini google ai studio + vertex ai
2024-08-26 22:11:42 -07:00
Ishaan Jaff
3d11b21726 add fine tuned vertex model support 2024-08-26 13:10:04 -07:00
Krrish Dholakia
bea6fb2375 fix(vertex_httpx.py): use special param 2024-08-26 13:08:28 -07:00
Krrish Dholakia
d13d2e8a62 feat(vertex_httpx.py): support functions param for gemini google ai studio + vertex ai
Closes https://github.com/BerriAI/litellm/issues/5344
2024-08-26 10:59:01 -07:00
Krrish Dholakia
4e9f66bc7e fix(vertex_httpx.py): return project id, if given 2024-08-26 09:14:04 -07:00
Krrish Dholakia
4d29c1fb69 fix(vertex_httpx.py): use dynamic project id 2024-08-24 23:34:20 -07:00
Krish Dholakia
f27abe0462
Merge branch 'main' into litellm_vertex_migration 2024-08-24 18:24:19 -07:00
Ishaan Jaff
3228125215 feat use identity_pool for vertex 2024-08-24 10:51:46 -07:00
Ishaan Jaff
dd524a4f50
Merge pull request #5326 from BerriAI/litellm_Add_vertex_multimodal_embedding
[Feat] add vertex multimodal embedding support
2024-08-21 17:06:43 -07:00
Krrish Dholakia
d995fff7a2 fix(vertex_httpx.py): fix json schema call to pass in response_mime_type=="application/json" 2024-08-21 15:24:04 -07:00
Ishaan Jaff
0e9efb3669 feat add multimodal embeddings on vertex 2024-08-21 15:19:48 -07:00
Ishaan Jaff
35781ab8d5 add multi modal vtx embedding 2024-08-21 15:05:59 -07:00
Ishaan Jaff
7e3dc83c0d add initial support for multimodal_embedding vertex 2024-08-21 14:29:05 -07:00
Krrish Dholakia
8812da04e3 fix(vertex_httpx.py): Fix tool calling with empty param list
Fixes https://github.com/BerriAI/litellm/issues/5055
2024-08-21 09:03:34 -07:00
Krrish Dholakia
db54b66457 style(vertex_httpx.py): make vertex error string more helpful 2024-08-17 15:09:55 -07:00
Ishaan Jaff
5d1fcc545b fix predictions image generation response 2024-08-16 15:06:12 -07:00
Krrish Dholakia
d471f7e840 feat(vertex_httpx.py): return vertex grounding, citation, and safety results 2024-08-09 08:54:55 -07:00
Ishaan Jaff
d237e625ca use v1beta1 when using cached_content 2024-08-08 11:09:31 -07:00
Ishaan Jaff
e17e959c62 image gen catch when predictions not in json response 2024-08-07 18:50:26 -07:00
Krrish Dholakia
5dfde2ee0b feat: Translate openai 'response_format' json_schema to 'response_schema' for vertex ai + google ai studio
Closes https://github.com/BerriAI/litellm/issues/5074
2024-08-06 19:06:14 -07:00
Krrish Dholakia
aab09f5b86 feat(vertex_httpx.py): Support gemini 'response_schema' param
Fixes https://github.com/BerriAI/litellm/pull/3366#issuecomment-2269183338
2024-08-05 07:56:44 -07:00
Krrish Dholakia
641192e049 fix(vertex_httpx.py): fix linting error 2024-08-03 12:53:46 -07:00
Ishaan Jaff
2a6756ab5b add better debugging statements for vertex logging 2024-08-01 13:34:59 -07:00
Moch. Ainun Najib
4e9e6a972b fix: support vertex path 2024-08-01 07:36:53 +07:00
Krrish Dholakia
1ac42d8464 fix: utils.py
fix supported openai params
2024-07-27 22:03:40 -07:00
Krish Dholakia
b854d2100c
Merge branch 'main' into litellm_vertex_migration 2024-07-27 20:25:12 -07:00
Krrish Dholakia
a264d1ca8c feat(vertex_httpx.py): support logging citation metadata
Closes https://github.com/BerriAI/litellm/issues/3230
2024-07-26 20:54:59 -07:00
Krrish Dholakia
fe7f78fbf6 feat(vertex_httpx.py): support logging vertex ai safety results to langfuse
Closes https://github.com/BerriAI/litellm/issues/3230
2024-07-26 20:50:43 -07:00
Krrish Dholakia
83ef52e180 feat(vertex_ai_llama.py): vertex ai llama3.1 api support
Initial working commit for vertex ai llama 3.1 api support
2024-07-23 17:07:30 -07:00
Krrish Dholakia
2f65c950fe fix(vertex_httpx.py): Change non-blocking vertex error to warning
Fixes https://github.com/BerriAI/litellm/issues/4825
2024-07-22 14:00:33 -07:00
Krrish Dholakia
023f10cf1c fix(vertex_httpx.py): return grounding metadata 2024-07-15 19:43:37 -07:00
Krrish Dholakia
82ca7af6df fix(vertex_httpx.py): google search grounding fix 2024-07-14 08:06:17 -07:00
Krish Dholakia
f0b8c0e7fb
Merge pull request #4588 from Manouchehri/vertex-seed-2973
feat(vertex_httpx.py): Add seed parameter
2024-07-11 22:02:13 -07:00
Krrish Dholakia
a1986fab60 fix(vertex_httpx.py): add sync vertex image gen support
Fixes https://github.com/BerriAI/litellm/issues/4623
2024-07-09 13:33:54 -07:00
Krrish Dholakia
a784f7d8df fix(vertex_httpx.py): fix gtool handling 2024-07-09 08:01:49 -07:00
Krrish Dholakia
7541478459 feat(vertex_httpx.py): add support for gemini 'grounding'
Adds support for https://cloud.google.com/vertex-ai/generative-ai/docs/model-reference/grounding#rest
2024-07-08 21:37:07 -07:00
David Manouchehri
0a740ee846
feat(vertex_httpx.py): Add undocumented seed parameter. 2024-07-07 23:32:04 +00:00
Krrish Dholakia
86596c53e9 refactor(main.py): migrate vertex gemini calls to vertex_httpx
Completes migration to vertex_httpx
2024-07-06 20:08:52 -07:00
Krrish Dholakia
faa88a1ab1 fix(vertex_httpx.py): support tool calling w/ streaming for vertex ai + gemini 2024-07-06 14:02:25 -07:00
Krrish Dholakia
7618ec43b3 fix(proxy_server.py): support langfuse logging for rejected requests on /v1/chat/completions 2024-07-05 13:07:09 -07:00
Krrish Dholakia
015a398713 fix(vertex_httpx.py): fix assumptions on usagemetadata 2024-07-05 11:01:51 -07:00
Krrish Dholakia
c425cba93a fix(vertex_httpx.py): fix supported vertex params 2024-07-04 21:17:52 -07:00
Krish Dholakia
18d8edc145
Merge pull request #4461 from t968914/litellm-fix-vertexaibeta
fix: Include vertex_ai_beta in vertex_ai param mapping/Do not use google auth project_id
2024-07-04 15:27:20 -07:00
Krish Dholakia
6c5c8bbb28
Revert "fix(vertex_anthropic.py): Vertex Anthropic tool calling - native params " 2024-07-03 17:55:37 -07:00
Krrish Dholakia
7007ace6c2 fix(vertex_anthropic.py): Updates the vertex anthropic endpoint to do tool calling with the anthropic api params 2024-07-03 15:28:31 -07:00
Tiger Yu
26630cd263
Merge branch 'main' into litellm-fix-vertexaibeta 2024-07-02 09:49:44 -07:00
David Manouchehri
5572494801
feat(vertex_httpx.py): Support cachedContent. 2024-07-01 16:59:35 +00:00
Krrish Dholakia
dc0218d34c build(pyproject.toml): remove ijson dep. add jsonschema dep. 2024-06-29 19:24:00 -07:00
Krrish Dholakia
05dfc63b88 feat(vertex_httpx.py): support the 'response_schema' param for older vertex ai models - pass as prompt (user-controlled)
if 'response_schema' is not supported for vertex model (e.g. gemini-1.5-flash) pass in prompt
2024-06-29 13:25:27 -07:00
Krrish Dholakia
e73e9e12bc fix(vertex_httpx.py): support passing response_schema to gemini 2024-06-29 11:33:19 -07:00