Commit graph

1096 commits

Author SHA1 Message Date
Krish Dholakia
996c028127 Merge pull request #5393 from BerriAI/litellm_gemini_embedding_support
feat(vertex_ai_and_google_ai_studio): Support Google AI Studio Embedding Endpoint
2024-08-28 13:46:28 -07:00
Krrish Dholakia
cf5768cd0c test(test_embeddings.py): fix test 2024-08-28 07:51:00 -07:00
Krrish Dholakia
7a9f1798ff fix(main.py): simplify to just use /batchEmbedContent 2024-08-27 21:46:05 -07:00
Krrish Dholakia
57330d2d0d feat(batch_embed_content_transformation.py): support google ai studio /batchEmbedContent endpoint
Allows for multiple strings to be given for embedding
2024-08-27 19:23:50 -07:00
Krrish Dholakia
6a483a1908 fix(embeddings_handler.py): initial working commit for google ai studio text embeddings /embedContent endpoint 2024-08-27 18:14:56 -07:00
Krrish Dholakia
882ae8ac2c fix: initial commit 2024-08-27 17:35:56 -07:00
Krrish Dholakia
de5617ce66 feat(vertex_ai_and_google_ai_studio): Support Google AI Studio Embeddings endpoint
Closes https://github.com/BerriAI/litellm/issues/5385
2024-08-27 16:53:11 -07:00
Ishaan Jaff
5f61539e90 refactor partner models to include ai21 2024-08-27 13:35:22 -07:00
Krish Dholakia
34eb1206c6 Merge pull request #5358 from BerriAI/litellm_fix_retry_after
fix retry after - cooldown individual models based on their specific 'retry-after' header
2024-08-27 11:50:14 -07:00
Krrish Dholakia
074e30fa10 feat(vertex_ai_context_caching.py): support making context caching calls to vertex ai in a normal chat completion call (anthropic caching format)
Closes https://github.com/BerriAI/litellm/issues/5213
2024-08-26 22:19:01 -07:00
Krish Dholakia
6ff17f1acd Merge pull request #5368 from BerriAI/litellm_vertex_function_support
feat(vertex_httpx.py): support 'functions' param for gemini google ai studio + vertex ai
2024-08-26 22:11:42 -07:00
Krish Dholakia
a33b3b2f24 Merge pull request #5376 from BerriAI/litellm_sagemaker_streaming_fix
fix(sagemaker.py): support streaming for messages api
2024-08-26 21:36:10 -07:00
Ishaan Jaff
ffb752d878 fix entrypoint 2024-08-26 20:32:23 -07:00
Krrish Dholakia
b989762bb0 fix(sagemaker.py): support streaming for messages api
Fixes https://github.com/BerriAI/litellm/issues/5372
2024-08-26 15:08:08 -07:00
Ishaan Jaff
5c1ebb6ac2 use common folder for cohere 2024-08-26 14:28:50 -07:00
Ishaan Jaff
2481d6007b refactor cohere to be in a folder 2024-08-26 14:16:25 -07:00
Krrish Dholakia
8df5b25b31 fix(main.py): fix linting errors 2024-08-26 11:44:37 -07:00
Krish Dholakia
bc2a96b2a5 Merge branch 'main' into litellm_vertex_migration 2024-08-24 18:24:19 -07:00
Krrish Dholakia
79bfdb83cc fix(main.py): cover openai /v1/completions endpoint 2024-08-24 13:25:17 -07:00
Krrish Dholakia
ea2077be22 test(test_router.py): add test to ensure error is correctly re-raised 2024-08-24 10:08:14 -07:00
Krish Dholakia
5eba49c112 Merge pull request #5343 from BerriAI/litellm_sagemaker_chat
feat(sagemaker.py): add sagemaker messages api support
2024-08-23 21:00:00 -07:00
Ishaan Jaff
d0c369477b add mock testing for vertex tts 2024-08-23 18:18:37 -07:00
Ishaan Jaff
39efd58b1e docs on using vertex tts 2024-08-23 17:57:49 -07:00
Ishaan Jaff
01f766bf89 fix linting 2024-08-23 16:05:31 -07:00
Ishaan Jaff
4e9a44f8d3 fix linting errors 2024-08-23 15:44:31 -07:00
Krrish Dholakia
f7aa787fe6 feat(sagemaker.py): add sagemaker messages api support
Closes https://github.com/BerriAI/litellm/issues/2641

 Closes https://github.com/BerriAI/litellm/pull/5178
2024-08-23 10:31:35 -07:00
Krish Dholakia
11cbf60e4f Merge branch 'main' into litellm_azure_batch_apis 2024-08-22 19:07:54 -07:00
Ishaan Jaff
2864d16fa1 Merge branch 'main' into litellm_allow_using_azure_ad_token_auth 2024-08-22 18:21:24 -07:00
Krrish Dholakia
b7f42c96a4 feat(azure.py): support health checking azure deployments
Fixes https://github.com/BerriAI/litellm/issues/5279
2024-08-22 16:11:14 -07:00
Ishaan Jaff
b16752f0bc add new litellm params for client_id, tenant_id etc 2024-08-22 11:37:30 -07:00
Ishaan Jaff
525d152d85 use azure_ad_token_provider to init clients 2024-08-22 11:03:49 -07:00
Krrish Dholakia
900d8ecbf0 feat(factory.py): enable 'user_continue_message' for interweaving user/assistant messages when provider requires it
allows bedrock to be used with autogen
2024-08-22 11:03:33 -07:00
Krrish Dholakia
8f306f8e41 fix(cohere_chat.py): support passing 'extra_headers'
Fixes https://github.com/BerriAI/litellm/issues/4709
2024-08-22 10:17:36 -07:00
Krrish Dholakia
2dd616bad0 fix(ollama_chat.py): fix passing assistant message with tool call param
Fixes https://github.com/BerriAI/litellm/issues/5319
2024-08-22 10:00:03 -07:00
Ishaan Jaff
0435101df4 add multi modal vtx embedding 2024-08-21 15:05:59 -07:00
Ishaan Jaff
be6eb52036 add initial support for multimodal_embedding vertex 2024-08-21 14:29:05 -07:00
Krish Dholakia
85c5d4f8c2 Merge branch 'main' into litellm_fix_azure_api_version 2024-08-20 11:40:53 -07:00
Krrish Dholakia
bc0710a3e6 fix(main.py): response_format typing for acompletion
Fixes https://github.com/BerriAI/litellm/issues/5239
2024-08-20 08:14:14 -07:00
Krrish Dholakia
d08479b52c feat(azure.py): support dynamic api versions
Closes https://github.com/BerriAI/litellm/issues/5228
2024-08-19 12:17:43 -07:00
Krish Dholakia
0916197c9d Merge pull request #5244 from BerriAI/litellm_better_error_logging_sentry
refactor: replace .error() with .exception() logging for better debugging on sentry
2024-08-16 19:16:20 -07:00
Krrish Dholakia
9efe9982f5 fix(health_check.py): return 'missing mode' error message, if error with health check, and mode is missing 2024-08-16 17:24:29 -07:00
Krrish Dholakia
2874b94fb1 refactor: replace .error() with .exception() logging for better debugging on sentry 2024-08-16 09:22:47 -07:00
Ishaan Jaff
953a67ba4c refactor sagemaker to be async 2024-08-15 18:18:02 -07:00
Krrish Dholakia
3026e69926 fix(utils.py): support calling openai models via azure_ai/ 2024-08-14 13:41:04 -07:00
Krrish Dholakia
3fd02a1587 fix(main.py): safely fail stream_chunk_builder calls 2024-08-10 10:22:26 -07:00
Krrish Dholakia
5357bd7799 docs(main.py): clarify 'num_retries' usage 2024-08-09 16:57:06 -07:00
Krrish Dholakia
abda7e37ec fix(utils.py): set max_retries = num_retries, if given 2024-08-09 16:54:54 -07:00
Ishaan Jaff
0561c06bcf fix cohere / cohere_chat when timeout is None 2024-08-09 12:10:02 -07:00
Krish Dholakia
ab487f0cf9 Merge pull request #5079 from BerriAI/litellm_add_pydantic_model_support
feat(utils.py): support passing response_format as pydantic model
2024-08-07 14:43:05 -07:00
Krish Dholakia
78d72acc44 Merge branch 'main' into litellm_anthropic_streaming_tool_call_fix 2024-08-07 14:33:30 -07:00