phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-27 11:43:54 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
21478 commits 2497 branches 897 tags 550 MiB
Commit graph

2223 commits

Author SHA1 Message Date
Ishaan Jaff
cb6a0f0237 add cerebras config 2024-08-31 08:34:46 -07:00
Ishaan Jaff
3a72197e77
Merge pull request #5455 from BerriAI/litellm_vtx_add_input_type_mapping 
[Feat] Vertex embeddings - map `input_type` to `text_type`
 2024-08-30 17:03:04 -07:00
Ishaan Jaff
541033ec7e add VertexAITextEmbeddingConfig 2024-08-30 12:53:43 -07:00
Ishaan Jaff
518aa639fa fix map input_type to task_type for vertex ai 2024-08-30 12:09:07 -07:00
Ishaan Jaff
570a5a2825 fix dir structure for tts 2024-08-30 11:44:23 -07:00
Ishaan Jaff
1bd2b2fc92
Merge pull request #5449 from BerriAI/litellm_Fix_vertex_multimodal 
[Fix-Proxy] Allow running /health checks on vertex multimodal embedding requests
 2024-08-30 10:21:42 -07:00
Ishaan Jaff
a6273a29fe add test for test_vertexai_multimodal_embedding_text_input 2024-08-30 09:19:48 -07:00
Krish Dholakia
dd7b008161
fix: Minor LiteLLM Fixes + Improvements (29/08/2024) (#5436) 
* fix(model_checks.py): support returning wildcard models on `/v1/models`

Fixes https://github.com/BerriAI/litellm/issues/4903

* fix(bedrock_httpx.py): support calling bedrock via api_base

Closes https://github.com/BerriAI/litellm/pull/4587

* fix(litellm_logging.py): only leave last 4 char of gemini key unmasked

Fixes https://github.com/BerriAI/litellm/issues/5433

* feat(router.py): support setting 'weight' param for models on router

Closes https://github.com/BerriAI/litellm/issues/5410

* test(test_bedrock_completion.py): add unit test for custom api base

* fix(model_checks.py): handle no "/" in model
 2024-08-29 22:40:25 -07:00
David Manouchehri
19db80ffeb
(bedrock): Add new cross-region inference support for Bedrock. 2024-08-29 17:49:16 +00:00
Krish Dholakia
559a6ad826
fix(google_ai_studio): working context caching (#5421) 
* fix(google_ai_studio): working context caching

* feat(vertex_ai_context_caching.py): support async cache check calls

* fix(vertex_and_google_ai_studio_gemini.py): fix setting headers

* fix(vertex_ai_parter_models): fix import

* fix(vertex_and_google_ai_studio_gemini.py): fix input

* test(test_amazing_vertex_completion.py): fix test
 2024-08-29 07:00:30 -07:00
Krrish Dholakia
dd9c5d10bd fix(vertex_ai_partner_models.py): fix vertex import 2024-08-28 18:08:33 -07:00
Krish Dholakia
a857f4a8ee
Merge branch 'main' into litellm_main_staging 2024-08-28 18:05:27 -07:00
Krish Dholakia
d928220ed2
Merge pull request #5393 from BerriAI/litellm_gemini_embedding_support 
feat(vertex_ai_and_google_ai_studio): Support Google AI Studio Embedding Endpoint
 2024-08-28 13:46:28 -07:00
Ishaan Jaff
58506dbade update validate_vertex_input 2024-08-28 12:52:26 -07:00
Ishaan Jaff
6d11b392f8 add ssml input on vertex tts 2024-08-28 12:17:53 -07:00
Krrish Dholakia
e1db58b8e5 fix(main.py): simplify to just use /batchEmbedContent 2024-08-27 21:46:05 -07:00
Krrish Dholakia
a6ce27ca29 feat(batch_embed_content_transformation.py): support google ai studio /batchEmbedContent endpoint 
Allows for multiple strings to be given for embedding
 2024-08-27 19:23:50 -07:00
Krrish Dholakia
bb42146ffe feat(embeddings_handler.py): support async gemini embeddings 2024-08-27 18:31:57 -07:00
Ishaan Jaff
647504b462 add test for rerank on custom api base 2024-08-27 18:25:51 -07:00
Krrish Dholakia
5b29ddd2a6 fix(embeddings_handler.py): initial working commit for google ai studio text embeddings /embedContent endpoint 2024-08-27 18:14:56 -07:00
Krrish Dholakia
77e6da78a1 fix: initial commit 2024-08-27 17:35:56 -07:00
Ishaan Jaff
06529f19df
Merge pull request #5392 from BerriAI/litellm_add_native_cohere_rerank 
[Feat] Add cohere rerank and together ai rerank
 2024-08-27 17:29:37 -07:00
Ishaan Jaff
37ed201c50 fix install on 3.8 2024-08-27 17:09:16 -07:00
Krrish Dholakia
5b06ea136c fix(openai.py): fix error re-raising 2024-08-27 17:06:25 -07:00
Ishaan Jaff
b3892b871d add async support for rerank 2024-08-27 17:02:48 -07:00
Krrish Dholakia
d29a7087f1 feat(vertex_ai_and_google_ai_studio): Support Google AI Studio Embeddings endpoint 
Closes https://github.com/BerriAI/litellm/issues/5385
 2024-08-27 16:53:11 -07:00
Ishaan Jaff
f33dfe0b95 add rerank params 2024-08-27 16:45:39 -07:00
Ishaan Jaff
dc42ad0021 add tg ai rerank support 2024-08-27 16:25:54 -07:00
Krrish Dholakia
6431af0678 fix(bedrock_httpx.py): support 'Auth' header as extra_header 
Fixes https://github.com/BerriAI/litellm/issues/5389#issuecomment-2313677977
 2024-08-27 16:08:54 -07:00
Krrish Dholakia
1b2f73c220 fix(azure_text.py): fix streaming parsing 2024-08-27 15:52:55 -07:00
Ishaan Jaff
6ab8cbc105
Merge pull request #5391 from BerriAI/litellm_add_ai21_support 
[Feat] Add Vertex  AI21 support
 2024-08-27 15:06:26 -07:00
Ishaan Jaff
33a3a01949 add mock test for ai21 2024-08-27 14:42:13 -07:00
Krrish Dholakia
b91e5d3887 fix(openai.py): fix post call error logging for aembedding calls 2024-08-27 14:26:06 -07:00
Krrish Dholakia
d43441ae5d fix(anthropic.py): support setting cache control headers, automatically 
Don't require user to manually pass in 'extra_headers' for anthropic cache control usage
 2024-08-27 13:57:03 -07:00
Krrish Dholakia
63adb3f940 fix(azure.py): fix raw response dump 2024-08-27 13:44:38 -07:00
Ishaan Jaff
11c175a215 refactor partner models to include ai21 2024-08-27 13:35:22 -07:00
Krrish Dholakia
18731cf42b fix: fix linting errors 2024-08-27 12:14:23 -07:00
Krish Dholakia
415abc86c6
Merge pull request #5358 from BerriAI/litellm_fix_retry_after 
fix retry after - cooldown individual models based on their specific 'retry-after' header
 2024-08-27 11:50:14 -07:00
Krrish Dholakia
18b67a455e test: fix test 2024-08-27 10:46:57 -07:00
Krrish Dholakia
bf81b484c6 fix(sagemaker.py): fix streaming logic 2024-08-27 08:10:47 -07:00
Krrish Dholakia
2cf149fbad perf(sagemaker.py): asyncify hf prompt template check 
leads to 189% improvement in RPS @ 100 users
 2024-08-27 07:37:06 -07:00
miraclebakelaser
97f714d2b0 fix(factory.py): handle missing 'content' in cohere assistant messages 
Update cohere_messages_pt_v2 function to check for 'content' existence
 2024-08-27 19:38:37 +09:00
Krish Dholakia
08bd4788dc
Merge branch 'main' into litellm_gemini_context_caching 2024-08-26 22:22:17 -07:00
Krrish Dholakia
5aad9d2db7 fix: fix imports 2024-08-26 22:19:01 -07:00
Krrish Dholakia
4868a6cf55 fix: fix unbound var 2024-08-26 22:19:01 -07:00
Krrish Dholakia
0eea01dae9 feat(vertex_ai_context_caching.py): check gemini cache, if key already exists 2024-08-26 22:19:01 -07:00
Krrish Dholakia
b0cc1df2d6 feat(vertex_ai_context_caching.py): support making context caching calls to vertex ai in a normal chat completion call (anthropic caching format) 
Closes https://github.com/BerriAI/litellm/issues/5213
 2024-08-26 22:19:01 -07:00
Krish Dholakia
c503ff435e
Merge pull request #5368 from BerriAI/litellm_vertex_function_support 
feat(vertex_httpx.py): support 'functions' param for gemini google ai studio + vertex ai
 2024-08-26 22:11:42 -07:00
Krish Dholakia
3a6412c9c3
Merge pull request #5376 from BerriAI/litellm_sagemaker_streaming_fix 
fix(sagemaker.py): support streaming for messages api
 2024-08-26 21:36:10 -07:00
Krrish Dholakia
75bb9ff7fe fix: fix imports 2024-08-26 21:36:04 -07:00