Krish Dholakia
e12bd3e548
Minor LiteLLM Fixes and Improvements ( #5456 )
...
* fix(utils.py): support 'drop_params' for embedding requests
Fixes https://github.com/BerriAI/litellm/issues/5444
* feat(vertex_ai_non_gemini.py): support function param in messages
* test: skip test - model end of life
* fix(vertex_ai_non_gemini.py): fix gemini history parsing
2024-08-31 17:58:10 -07:00
Ishaan Jaff
99bb817b7f
fix test_vertexai_embedding_embedding_latest_input_type
2024-08-30 15:57:44 -07:00
Ishaan Jaff
ea12519b98
fix map input_type to task_type for vertex ai
2024-08-30 12:09:07 -07:00
Ishaan Jaff
0866deea97
Merge pull request #5439 from BerriAI/litellm_use_correct_ai21_pricing
...
[Fix] Use correct Vertex AI AI21 Cost tracking
2024-08-30 10:49:42 -07:00
Ishaan Jaff
10771e3bde
add test for test_vertexai_multimodal_embedding_text_input
2024-08-30 09:19:48 -07:00
Ishaan Jaff
40d40e87fb
add tests to check ai21 models cost is calculated correct
2024-08-30 07:30:16 -07:00
Krish Dholakia
20fcd8ebdf
fix(google_ai_studio): working context caching ( #5421 )
...
* fix(google_ai_studio): working context caching
* feat(vertex_ai_context_caching.py): support async cache check calls
* fix(vertex_and_google_ai_studio_gemini.py): fix setting headers
* fix(vertex_ai_parter_models): fix import
* fix(vertex_and_google_ai_studio_gemini.py): fix input
* test(test_amazing_vertex_completion.py): fix test
2024-08-29 07:00:30 -07:00
Krrish Dholakia
fff9828801
test(test_amazing_vertex_completion.py): fix test
2024-08-28 21:12:39 -07:00
Krish Dholakia
0e0db9a5af
Merge branch 'main' into litellm_main_staging
2024-08-28 18:05:27 -07:00
Ishaan Jaff
06385e7b4f
fix vertex ai test
2024-08-28 15:30:39 -07:00
Ishaan Jaff
1f4ddd2937
fix failing vertex test
2024-08-28 14:46:57 -07:00
Krrish Dholakia
055f8a511f
test(test_amazing_vertex_completion.py): update test to not pick experimental gemini models
2024-08-28 14:28:06 -07:00
Krish Dholakia
996c028127
Merge pull request #5393 from BerriAI/litellm_gemini_embedding_support
...
feat(vertex_ai_and_google_ai_studio): Support Google AI Studio Embedding Endpoint
2024-08-28 13:46:28 -07:00
Ishaan Jaff
e7cdf35f2d
mark vertex tests as flaky
2024-08-28 08:32:33 -07:00
Ishaan Jaff
45366a260c
mark test as flaky
2024-08-28 08:24:04 -07:00
Krrish Dholakia
de5617ce66
feat(vertex_ai_and_google_ai_studio): Support Google AI Studio Embeddings endpoint
...
Closes https://github.com/BerriAI/litellm/issues/5385
2024-08-27 16:53:11 -07:00
Ishaan Jaff
2436dfbbc0
add mock test for ai21
2024-08-27 14:42:13 -07:00
Ishaan Jaff
c634c3c5b7
add test for test_partner_models_httpx_ai21
2024-08-27 13:36:47 -07:00
Krrish Dholakia
fe6ba2d025
fix: fix imports
2024-08-26 22:19:01 -07:00
Krrish Dholakia
b277086cf7
feat(vertex_ai_context_caching.py): check gemini cache, if key already exists
2024-08-26 22:19:01 -07:00
Krrish Dholakia
074e30fa10
feat(vertex_ai_context_caching.py): support making context caching calls to vertex ai in a normal chat completion call (anthropic caching format)
...
Closes https://github.com/BerriAI/litellm/issues/5213
2024-08-26 22:19:01 -07:00
Ishaan Jaff
1b9a476b98
add test for test_completion_fine_tuned_model
2024-08-26 13:26:56 -07:00
Krish Dholakia
bc2a96b2a5
Merge branch 'main' into litellm_vertex_migration
2024-08-24 18:24:19 -07:00
Ishaan Jaff
e45ec0ef46
fix test_vertexai_multimodal_embedding use magicMock requests
2024-08-22 09:56:24 -07:00
Krrish Dholakia
e117a041ff
test: fix test
2024-08-21 22:30:41 -07:00
Krrish Dholakia
8c56ce0a1f
test(test_amazing_vertex_completion.py): handle vertex api instability
2024-08-21 17:09:17 -07:00
Ishaan Jaff
e4fe5924a5
Merge pull request #5326 from BerriAI/litellm_Add_vertex_multimodal_embedding
...
[Feat] add vertex multimodal embedding support
2024-08-21 17:06:43 -07:00
Ishaan Jaff
1d627aa325
fix test test_vertexai_multimodal_embedding
2024-08-21 15:25:13 -07:00
Krrish Dholakia
664c40a4c7
fix(vertex_httpx.py): fix json schema call to pass in response_mime_type=="application/json"
2024-08-21 15:24:04 -07:00
Ishaan Jaff
a0e14af1d3
feat add multimodal embeddings on vertex
2024-08-21 15:19:48 -07:00
Ishaan Jaff
0435101df4
add multi modal vtx embedding
2024-08-21 15:05:59 -07:00
Krish Dholakia
0916197c9d
Merge pull request #5244 from BerriAI/litellm_better_error_logging_sentry
...
refactor: replace .error() with .exception() logging for better debugging on sentry
2024-08-16 19:16:20 -07:00
Ishaan Jaff
5790275de5
skip InternalServerError on vertex test
2024-08-16 14:51:51 -07:00
Krrish Dholakia
2874b94fb1
refactor: replace .error() with .exception() logging for better debugging on sentry
2024-08-16 09:22:47 -07:00
Ishaan Jaff
ee39f65baa
add tests to make sure correct vertex ai route is used
2024-08-08 11:28:19 -07:00
Krrish Dholakia
4707861ee4
test(test_amazing_vertex_completion.py): fix test for json schema validation in openai schema
2024-08-07 18:39:20 -07:00
Krrish Dholakia
831dc1b886
feat: Translate openai 'response_format' json_schema to 'response_schema' for vertex ai + google ai studio
...
Closes https://github.com/BerriAI/litellm/issues/5074
2024-08-06 19:06:14 -07:00
Krrish Dholakia
1527f2bd80
feat(vertex_httpx.py): Support gemini 'response_schema' param
...
Fixes https://github.com/BerriAI/litellm/pull/3366#issuecomment-2269183338
2024-08-05 07:56:44 -07:00
Krrish Dholakia
2121738137
fix(vertex_ai_partner.py): add /chat/completion codestral support
...
Closes https://github.com/BerriAI/litellm/issues/4984
2024-08-01 16:12:05 -07:00
Krrish Dholakia
77e5cb89ed
fix(google.py): fix cost tracking for vertex ai mistral models
2024-08-01 15:22:32 -07:00
Ishaan Jaff
ccc296b312
fix test_completion_function_plus_pdf
2024-07-31 13:53:06 -07:00
Krrish Dholakia
802e39b606
fix(utils.py): fix cost tracking for vertex ai partner models
2024-07-30 14:20:52 -07:00
Krish Dholakia
0525fb75f3
Merge branch 'main' into litellm_vertex_migration
2024-07-27 20:25:12 -07:00
Krrish Dholakia
a6b053f535
feat(databricks.py): support vertex mistral cost tracking
2024-07-27 20:22:35 -07:00
Krrish Dholakia
ce7257ec5e
feat(vertex_ai_partner.py): initial working commit for calling vertex ai mistral
...
Closes https://github.com/BerriAI/litellm/issues/4874
2024-07-27 12:54:14 -07:00
Krrish Dholakia
6a4001c4f4
fix(vertex_ai_llama3.py): Fix llama3 streaming issue
...
Closes https://github.com/BerriAI/litellm/issues/4885
2024-07-25 22:30:55 -07:00
Krrish Dholakia
d3ff21181c
fix(litellm_cost_calc/google.py): support meta llama vertex ai cost tracking
2024-07-25 22:12:07 -07:00
Krrish Dholakia
778afcee31
feat(vertex_ai_llama.py): vertex ai llama3.1 api support
...
Initial working commit for vertex ai llama 3.1 api support
2024-07-23 17:07:30 -07:00
Krish Dholakia
2c6482b6e1
Merge branch 'main' into litellm_anthropic_response_schema_support
2024-07-18 20:40:16 -07:00
Ishaan Jaff
60295729b9
fix test amazing vertex medlm
2024-07-18 18:16:00 -07:00
