Krish Dholakia
e474c3665a
Bedrock Embeddings refactor + model support ( #5462 )
...
* refactor(bedrock): initial commit to refactor bedrock to a folder
Improve code readability + maintainability
* refactor: more refactor work
* fix: fix imports
* feat(bedrock/embeddings.py): support translating embedding into amazon embedding formats
* fix: fix linting errors
* test: skip test on end of life model
* fix(cohere/embed.py): fix linting error
* fix(cohere/embed.py): fix typing
* fix(cohere/embed.py): fix post-call logging for cohere embedding call
* test(test_embeddings.py): fix error message assertion in test
2024-09-01 13:29:58 -07:00
Krish Dholakia
aa9f1896c6
anthropic prompt caching cost tracking ( #5453 )
...
* fix(utils.py): support 'drop_params' for embedding requests
Fixes https://github.com/BerriAI/litellm/issues/5444
* feat(anthropic/cost_calculation.py): Support calculating cost for prompt caching on anthropic
* feat(types/utils.py): allows us to migrate to openai's equivalent, once that comes out
* fix: fix linting errors
* test: mark flaky test
2024-08-31 14:50:12 -07:00
Ishaan Jaff
6aaa7a75cd
add cerebras api
2024-08-31 08:35:23 -07:00
Ishaan Jaff
2202a02aef
Merge pull request #5455 from BerriAI/litellm_vtx_add_input_type_mapping
...
[Feat] Vertex embeddings - map `input_type` to `text_type`
2024-08-30 17:03:04 -07:00
Ishaan Jaff
ea12519b98
fix map input_type to task_type for vertex ai
2024-08-30 12:09:07 -07:00
Ishaan Jaff
c40e564779
fix dir structure for tts
2024-08-30 11:44:23 -07:00
Ishaan Jaff
85b376adcc
Merge pull request #5449 from BerriAI/litellm_Fix_vertex_multimodal
...
[Fix-Proxy] Allow running /health checks on vertex multimodal embedding requests
2024-08-30 10:21:42 -07:00
Ishaan Jaff
10771e3bde
add test for test_vertexai_multimodal_embedding_text_input
2024-08-30 09:19:48 -07:00
Krish Dholakia
321b0961b5
fix: Minor LiteLLM Fixes + Improvements (29/08/2024) ( #5436 )
...
* fix(model_checks.py): support returning wildcard models on `/v1/models`
Fixes https://github.com/BerriAI/litellm/issues/4903
* fix(bedrock_httpx.py): support calling bedrock via api_base
Closes https://github.com/BerriAI/litellm/pull/4587
* fix(litellm_logging.py): only leave last 4 char of gemini key unmasked
Fixes https://github.com/BerriAI/litellm/issues/5433
* feat(router.py): support setting 'weight' param for models on router
Closes https://github.com/BerriAI/litellm/issues/5410
* test(test_bedrock_completion.py): add unit test for custom api base
* fix(model_checks.py): handle no "/" in model
2024-08-29 22:40:25 -07:00
Ishaan Jaff
da43356242
Merge pull request #5431 from BerriAI/litellm_Add_fireworks_ai_health_check
...
[Fix-Proxy] /health check for provider wildcard models (fireworks/*)
2024-08-29 14:25:05 -07:00
Ishaan Jaff
b1a5b94211
add support for fireworks ai health check
2024-08-29 09:29:16 -07:00
Krish Dholakia
996c028127
Merge pull request #5393 from BerriAI/litellm_gemini_embedding_support
...
feat(vertex_ai_and_google_ai_studio): Support Google AI Studio Embedding Endpoint
2024-08-28 13:46:28 -07:00
Krrish Dholakia
cf5768cd0c
test(test_embeddings.py): fix test
2024-08-28 07:51:00 -07:00
Krrish Dholakia
7a9f1798ff
fix(main.py): simplify to just use /batchEmbedContent
2024-08-27 21:46:05 -07:00
Krrish Dholakia
57330d2d0d
feat(batch_embed_content_transformation.py): support google ai studio /batchEmbedContent endpoint
...
Allows for multiple strings to be given for embedding
2024-08-27 19:23:50 -07:00
Krrish Dholakia
6a483a1908
fix(embeddings_handler.py): initial working commit for google ai studio text embeddings /embedContent endpoint
2024-08-27 18:14:56 -07:00
Krrish Dholakia
882ae8ac2c
fix: initial commit
2024-08-27 17:35:56 -07:00
Krrish Dholakia
de5617ce66
feat(vertex_ai_and_google_ai_studio): Support Google AI Studio Embeddings endpoint
...
Closes https://github.com/BerriAI/litellm/issues/5385
2024-08-27 16:53:11 -07:00
Ishaan Jaff
5f61539e90
refactor partner models to include ai21
2024-08-27 13:35:22 -07:00
Krish Dholakia
34eb1206c6
Merge pull request #5358 from BerriAI/litellm_fix_retry_after
...
fix retry after - cooldown individual models based on their specific 'retry-after' header
2024-08-27 11:50:14 -07:00
Krrish Dholakia
074e30fa10
feat(vertex_ai_context_caching.py): support making context caching calls to vertex ai in a normal chat completion call (anthropic caching format)
...
Closes https://github.com/BerriAI/litellm/issues/5213
2024-08-26 22:19:01 -07:00
Krish Dholakia
6ff17f1acd
Merge pull request #5368 from BerriAI/litellm_vertex_function_support
...
feat(vertex_httpx.py): support 'functions' param for gemini google ai studio + vertex ai
2024-08-26 22:11:42 -07:00
Krish Dholakia
a33b3b2f24
Merge pull request #5376 from BerriAI/litellm_sagemaker_streaming_fix
...
fix(sagemaker.py): support streaming for messages api
2024-08-26 21:36:10 -07:00
Ishaan Jaff
ffb752d878
fix entrypoint
2024-08-26 20:32:23 -07:00
Krrish Dholakia
b989762bb0
fix(sagemaker.py): support streaming for messages api
...
Fixes https://github.com/BerriAI/litellm/issues/5372
2024-08-26 15:08:08 -07:00
Ishaan Jaff
5c1ebb6ac2
use common folder for cohere
2024-08-26 14:28:50 -07:00
Ishaan Jaff
2481d6007b
refactor cohere to be in a folder
2024-08-26 14:16:25 -07:00
Krrish Dholakia
8df5b25b31
fix(main.py): fix linting errors
2024-08-26 11:44:37 -07:00
Krish Dholakia
bc2a96b2a5
Merge branch 'main' into litellm_vertex_migration
2024-08-24 18:24:19 -07:00
Krrish Dholakia
79bfdb83cc
fix(main.py): cover openai /v1/completions endpoint
2024-08-24 13:25:17 -07:00
Krrish Dholakia
ea2077be22
test(test_router.py): add test to ensure error is correctly re-raised
2024-08-24 10:08:14 -07:00
Krish Dholakia
5eba49c112
Merge pull request #5343 from BerriAI/litellm_sagemaker_chat
...
feat(sagemaker.py): add sagemaker messages api support
2024-08-23 21:00:00 -07:00
Ishaan Jaff
d0c369477b
add mock testing for vertex tts
2024-08-23 18:18:37 -07:00
Ishaan Jaff
39efd58b1e
docs on using vertex tts
2024-08-23 17:57:49 -07:00
Ishaan Jaff
01f766bf89
fix linting
2024-08-23 16:05:31 -07:00
Ishaan Jaff
4e9a44f8d3
fix linting errors
2024-08-23 15:44:31 -07:00
Krrish Dholakia
f7aa787fe6
feat(sagemaker.py): add sagemaker messages api support
...
Closes https://github.com/BerriAI/litellm/issues/2641
Closes https://github.com/BerriAI/litellm/pull/5178
2024-08-23 10:31:35 -07:00
Krish Dholakia
11cbf60e4f
Merge branch 'main' into litellm_azure_batch_apis
2024-08-22 19:07:54 -07:00
Ishaan Jaff
2864d16fa1
Merge branch 'main' into litellm_allow_using_azure_ad_token_auth
2024-08-22 18:21:24 -07:00
Krrish Dholakia
b7f42c96a4
feat(azure.py): support health checking azure deployments
...
Fixes https://github.com/BerriAI/litellm/issues/5279
2024-08-22 16:11:14 -07:00
Ishaan Jaff
b16752f0bc
add new litellm params for client_id, tenant_id etc
2024-08-22 11:37:30 -07:00
Ishaan Jaff
525d152d85
use azure_ad_token_provider to init clients
2024-08-22 11:03:49 -07:00
Krrish Dholakia
900d8ecbf0
feat(factory.py): enable 'user_continue_message' for interweaving user/assistant messages when provider requires it
...
allows bedrock to be used with autogen
2024-08-22 11:03:33 -07:00
Krrish Dholakia
8f306f8e41
fix(cohere_chat.py): support passing 'extra_headers'
...
Fixes https://github.com/BerriAI/litellm/issues/4709
2024-08-22 10:17:36 -07:00
Krrish Dholakia
2dd616bad0
fix(ollama_chat.py): fix passing assistant message with tool call param
...
Fixes https://github.com/BerriAI/litellm/issues/5319
2024-08-22 10:00:03 -07:00
Ishaan Jaff
0435101df4
add multi modal vtx embedding
2024-08-21 15:05:59 -07:00
Ishaan Jaff
be6eb52036
add initial support for multimodal_embedding vertex
2024-08-21 14:29:05 -07:00
Krish Dholakia
85c5d4f8c2
Merge branch 'main' into litellm_fix_azure_api_version
2024-08-20 11:40:53 -07:00
Krrish Dholakia
bc0710a3e6
fix(main.py): response_format typing for acompletion
...
Fixes https://github.com/BerriAI/litellm/issues/5239
2024-08-20 08:14:14 -07:00
Krrish Dholakia
d08479b52c
feat(azure.py): support dynamic api versions
...
Closes https://github.com/BerriAI/litellm/issues/5228
2024-08-19 12:17:43 -07:00
