Commit graph

104 commits

Author SHA1 Message Date
Krrish Dholakia
7de77ab677 fix(init.py): fix imports 2024-06-15 11:31:09 -07:00
Krrish Dholakia
9d7f5d503c refactor(utils.py): refactor Logging to it's own class. Cut down utils.py to <10k lines.
Easier debugging

 Reference: https://github.com/BerriAI/litellm/issues/4206
2024-06-15 10:57:20 -07:00
Krish Dholakia
50c74fce49 Merge branch 'main' into litellm_vertex_completion_httpx 2024-06-12 21:19:22 -07:00
Krrish Dholakia
29169b3039 feat(vertex_httpx.py): Moving to call vertex ai via httpx (instead of their sdk). Allows us to support all their api updates. 2024-06-12 16:47:00 -07:00
Ishaan Jaff
ccfc988d71 vertex embeddings optional_params 2024-06-12 10:56:36 -07:00
Ishaan Jaff
910188df8d feat - support vertex text input 2024-06-12 10:11:44 -07:00
Ishaan Jaff
e4b36d71cf feat - support vertex ai dimensions 2024-06-12 09:29:51 -07:00
nick-rackauckas
f8ffaa7fc8 Fix 2024-06-06 16:57:42 -07:00
nick-rackauckas
e205381ba0 Remove unused function 2024-06-06 16:30:23 -07:00
nick-rackauckas
b4eba4bddd Fix to work with all supported Gemini file types 2024-06-06 16:15:01 -07:00
Ishaan Jaff
b9bf4bd16e Merge pull request #4039 from themrzmaster/main
fix tool usage null content using vertexai
2024-06-06 12:41:25 -07:00
Krrish Dholakia
3c1d4179c2 fix(vertex_ai.py): support video + pdf for vertex ai 2024-06-06 08:06:20 -07:00
lucca
6453c0ab83 improve 2024-06-06 11:15:56 -03:00
lucca
8ba4c407b8 fix function calling 2024-06-06 11:09:35 -03:00
Rajan Paneru
a050d98e51 Table format fix and Typo
* Fixed marked down table formats because they were looking ugly in pycharm
* Typos Fixes.
2024-06-06 22:29:59 +09:30
Ishaan Jaff
d4d9b098b1 fix - vertex ai cache clients 2024-05-30 21:22:32 -07:00
Krrish Dholakia
945162253c fix(vertex_ai.py): handle nested content dictionary for assistant message
openai allows the assistant content message to also be a list of dictionaries, handle that
2024-05-24 22:47:47 -07:00
Krrish Dholakia
81e35ba6c0 fix(vertex_ai.py): revert system instructions - unable to find supported vertex version 2024-05-20 06:30:11 -07:00
Krrish Dholakia
9e1a65c32a fix(vertex_ai.py): support passing system instructions to vertex ai 2024-05-20 06:18:19 -07:00
Krrish Dholakia
bb54839465 fix(vertex_ai.py): use chat_messages_with_history for async + streaming calls 2024-05-19 12:30:24 -07:00
Krrish Dholakia
50145b6ef3 fix(vertex_ai.py): passing all tests on 'test_amazing_vertex_completion.py 2024-05-19 12:22:21 -07:00
Krrish Dholakia
86ecb4638c fix(vertex_ai.py): support passing in result of tool call to vertex
Fixes https://github.com/BerriAI/litellm/issues/3709
2024-05-19 11:34:07 -07:00
Krrish Dholakia
3a356a6f56 fix(vertex_ai.py): support tool call list response async completion 2024-05-13 10:42:31 -07:00
Krrish Dholakia
691c185ff8 feat(router.py): support region routing for bedrock, vertex ai, watsonx 2024-05-11 11:04:00 -07:00
Krrish Dholakia
e12fa09489 fix: fix linting 2024-05-10 20:23:33 -07:00
Krrish Dholakia
bed16d5495 fix(vertex_ai.py): fix list tool call responses
Closes https://github.com/BerriAI/litellm/issues/3147
2024-05-10 20:05:58 -07:00
Krrish Dholakia
5f93cae3ff feat(proxy_server.py): return litellm version in response headers 2024-05-08 16:00:08 -07:00
Krish Dholakia
7ed64709aa Merge branch 'main' into litellm_common_auth_params 2024-04-28 08:38:06 -07:00
Krrish Dholakia
33b5829e31 fix(vertex_ai.py): support safety settings for async streaming calls 2024-04-27 11:43:22 -07:00
Krrish Dholakia
ee68c0aaaa feat(utils.py): unify common auth params across azure/vertex_ai/bedrock/watsonx 2024-04-27 11:06:18 -07:00
pwm
de5791a72b add safety_settings parameters to Vertex vision async_completion function 2024-04-26 14:35:01 +08:00
Krrish Dholakia
30f5bbd0cc fix(vertex_ai.py): handle stream=false
also adds unit testing for vertex ai calls with langchain
2024-04-25 13:59:37 -07:00
Krish Dholakia
265f16456f Merge pull request #3267 from BerriAI/litellm_openai_streaming_fix
fix(utils.py): fix streaming to not return usage dict
2024-04-24 21:08:33 -07:00
Krrish Dholakia
5abfb695f2 fix(vertex_ai.py): raise explicit error when image url fails to download - prevents silent failure 2024-04-24 09:23:15 -07:00
Krrish Dholakia
b10f03706d fix(utils.py): fix streaming to not return usage dict
Fixes https://github.com/BerriAI/litellm/issues/3237
2024-04-24 08:06:07 -07:00
Krrish Dholakia
3b6d204314 fix(vertex_ai.py): fix streaming logic 2024-04-22 19:15:20 -07:00
Krrish Dholakia
adfad86dc5 fix(vertex_ai.py): remove ExtendedGenerationConfig usage 2024-04-22 18:23:21 -07:00
David Manouchehri
6c7e931165 improve(vertex_ai.py): Add frequency_penalty and presence_penalty. 2024-04-22 18:02:59 +00:00
David Manouchehri
aa5ee6a626 improve(vertex_ai.py): Switch to simpler dict type. 2024-04-22 17:00:37 +00:00
Krrish Dholakia
77cb75bf2d fix(vertex_ai.py): fix faulty async completion function call tool check 2024-04-17 16:30:28 -07:00
Krrish Dholakia
72d7c36c76 refactor(utils.py): make it clearer how vertex ai params are handled '
'
2024-04-17 16:20:56 -07:00
Krrish Dholakia
6d508468ef fix(vertex_ai.py): accept credentials as a json string 2024-04-16 17:34:25 -07:00
Krrish Dholakia
8c3c45fbb5 fix(vertex_ai_anthropic.py): set vertex_credentials for vertex ai anthropic calls
allows setting vertex credentials as a json string for vertex ai anthropic calls
2024-04-15 14:16:28 -07:00
Krrish Dholakia
7a829f805d fix(vertex_ai.py): check if 'response_mime_type' in generation config before passing it in 2024-04-11 23:10:59 -07:00
David Manouchehri
ad8d35a378 (feat) - Extreme dirty hack for response_mime_type in Vertex AI. 2024-04-12 00:03:31 +00:00
David Manouchehri
c6b866925f (feat) - Dirty hack to get response_mime_type working before it's released in the Python SDK. 2024-04-12 00:03:30 +00:00
David Manouchehri
cc71ca3166 (feat) - Add support for JSON mode in Vertex AI 2024-04-12 00:03:29 +00:00
Krrish Dholakia
57ea6a1c4f feat(gemini.py): support google-genai system instruction 2024-04-09 17:23:14 -07:00
Krrish Dholakia
859a2af3ed build: fix mypy build issues 2024-03-21 08:27:23 -07:00
Krrish Dholakia
7f4dd734c1 fix(vertex_ai.py): correctly parse optional params and pass vertex ai project 2024-03-06 14:00:50 -08:00