Ishaan Jaff
cedeb10a08
fix - linting error
2024-05-31 21:24:14 -07:00
Ishaan Jaff
6feeff1f31
feat - cache openai clients
2024-05-31 21:22:06 -07:00
Krish Dholakia
8f87da4b20
Merge pull request #3939 from pharindoko/main
...
fix(bedrock): convert botocore credentials when role is assumed
2024-05-31 18:46:15 -07:00
Krish Dholakia
fbeb9d7ea7
Merge pull request #3935 from BerriAI/litellm_cache_vertex_clients
...
[Fix] Cache Vertex AI clients - Perf improvement
2024-05-31 18:44:10 -07:00
Krish Dholakia
08bae3185a
Merge pull request #3936 from BerriAI/litellm_assistants_api_proxy
...
feat(proxy_server.py): add assistants api endpoints to proxy server
2024-05-31 18:43:22 -07:00
Krrish Dholakia
93c3635b64
fix: fix streaming with httpx client
...
prevent overwriting streams in parallel streaming calls
2024-05-31 10:55:18 -07:00
uid10804
928efe2d87
refactor(bedrock_httpx): change botocore reference
2024-05-31 16:57:28 +02:00
David Manouchehri
0ed01f430d
fix(bedrock_httpx.py): Fix OIDC support.
2024-05-31 12:44:52 +00:00
David Manouchehri
c301d0c5ca
feat (bedrock_httpx.py): Add OIDC support for Amazon Bedrock with httpx.
2024-05-31 12:44:50 +00:00
uid10804
2f130b39c0
fix: add botocore credentials extraction and conversion
...
The code changes in `bedrock_httpx.py` add functionality to extract and convert AWS STS credentials to session credentials using botocore. This fixes later error in add_auth request when token needs to be assigned.
2024-05-31 12:02:34 +02:00
Krrish Dholakia
e2b34165e7
feat(proxy_server.py): add assistants api endpoints to proxy server
2024-05-30 22:44:43 -07:00
Ishaan Jaff
f52bf5976b
fix - vertex ai cache clients
2024-05-30 21:22:32 -07:00
Krish Dholakia
d3a247bf20
Merge pull request #3928 from BerriAI/litellm_audio_speech_endpoint
...
feat(main.py): support openai tts endpoint
2024-05-30 17:30:42 -07:00
Krrish Dholakia
93166cdabf
fix(openai.py): fix openai response for /audio/speech endpoint
2024-05-30 16:41:06 -07:00
Krrish Dholakia
a67cbf47f6
feat(main.py): support openai tts endpoint
...
Closes https://github.com/BerriAI/litellm/issues/3094
2024-05-30 14:28:28 -07:00
KX
d3921a3d28
fix: add missing seed parameter to ollama input
...
Current ollama interfacing does not allow for seed, which is supported in https://github.com/ollama/ollama/blob/main/docs/api.md#parameters and https://github.com/ollama/ollama/blob/main/docs/modelfile.md#valid-parameters-and-values
This resolves that by adding in handling of seed parameter.
2024-05-31 01:47:56 +08:00
Krrish Dholakia
da56201e80
fix(main.py): pass api key and api base to openai.py for audio transcription call
2024-05-29 21:29:01 -07:00
Krrish Dholakia
3d32b00821
fix(openai.py): only allow 'user' as optional param if openai model
2024-05-29 15:15:02 -07:00
Ishaan Jaff
99e506525c
Revert "Added support for Triton chat completion using trtlllm generate endpo…"
2024-05-29 13:42:49 -07:00
Ishaan Jaff
e8c1e87ac9
Merge pull request #3895 from giritatavarty-8451/litellm_triton_chatcompletion_support
...
Added support for Triton chat completion using trtlllm generate endpo…
2024-05-29 12:50:31 -07:00
Ishaan Jaff
6e9cc26ca1
Merge pull request #3888 from BerriAI/litellm_add_files_proxy
...
[Feat] LiteLLM Proxy Add `POST /v1/files` and `GET /v1/files`
2024-05-28 22:36:33 -07:00
Ishaan Jaff
ca8163bbba
feat - add afile_content, file_content
2024-05-28 20:58:22 -07:00
Ishaan Jaff
6bf6059b3e
Merge pull request #3882 from BerriAI/litellm_add_batches_sdk
...
[BETA-Feature] Add OpenAI `v1/batches` Support on LiteLLM SDK
2024-05-28 19:38:12 -07:00
Krish Dholakia
b5c89a249a
Merge pull request #3883 from BerriAI/litellm_anthropic_parallel_streaming_fix
...
fix(anthropic.py): fix parallel streaming on anthropic.py
2024-05-28 17:21:57 -07:00
Ishaan Jaff
6688215c18
feat - add aretrieve_batch
2024-05-28 17:12:41 -07:00
Ishaan Jaff
1ef7cd923c
feat - add acreate_batch
2024-05-28 17:03:29 -07:00
Ishaan Jaff
758ed9e923
feat - add litellm.acreate_file
2024-05-28 16:47:27 -07:00
Krrish Dholakia
324bf027f5
fix(anthropic.py): fix parallel streaming on anthropic.py
...
prevent parallel requests from cancelling each other
Fixes https://github.com/BerriAI/litellm/issues/3881
2024-05-28 16:29:09 -07:00
Ishaan Jaff
38285e53c3
working create_batch
2024-05-28 15:45:23 -07:00
Ishaan Jaff
d5dbf084ed
feat - import batches in __init__
2024-05-28 15:35:11 -07:00
Giri Tatavarty
a58dc68418
Added support for Triton chat completion using trtlllm generate endpoint and custom infer endpoint
2024-05-28 07:54:11 -07:00
frob
17f49a4015
Merge branch 'BerriAI:main' into ollama-image-handling
2024-05-28 09:18:36 +02:00
Krrish Dholakia
322a8218c0
fix(openai.py): fix deepinfra config optional param
2024-05-27 18:36:34 -07:00
Krrish Dholakia
f0f853b941
fix(utils.py): support deepinfra optional params
...
Fixes https://github.com/BerriAI/litellm/issues/3855
2024-05-27 09:16:56 -07:00
frob
a75b09974e
Merge branch 'BerriAI:main' into ollama-image-handling
2024-05-27 17:42:30 +02:00
Krrish Dholakia
d2e14ca833
fix(bedrock_httpx.py): fix bedrock ptu model id str encoding
...
Fixes https://github.com/BerriAI/litellm/issues/3805
2024-05-25 10:54:01 -07:00
Krrish Dholakia
8c92508934
fix(bedrock_httpx.py): support 'modelId' param for bedrock ptu's
...
Fixes https://github.com/BerriAI/litellm/issues/3805
2024-05-24 22:55:55 -07:00
Krrish Dholakia
281906ff33
fix(vertex_ai.py): handle nested content dictionary for assistant message
...
openai allows the assistant content message to also be a list of dictionaries, handle that
2024-05-24 22:47:47 -07:00
Ishaan Jaff
799c63bf8e
(ci/cd) run again
2024-05-24 21:27:29 -07:00
Krish Dholakia
d25ed9c4d3
Merge pull request #3828 from BerriAI/litellm_outage_alerting
...
fix(slack_alerting.py): support region based outage alerting
2024-05-24 19:13:17 -07:00
Krrish Dholakia
e8df9c4041
fix(factory.py): fix linting error
2024-05-24 19:12:09 -07:00
Krrish Dholakia
9698fc77fd
docs(input.md): add clarifai supported input params to docs
2024-05-24 08:57:50 -07:00
Krrish Dholakia
f04e4b921b
feat(ui/model_dashboard.tsx): add databricks models via admin ui
2024-05-23 20:28:54 -07:00
Krish Dholakia
c14584722e
Merge pull request #3808 from BerriAI/litellm_databricks_api
...
feat(databricks.py): adds databricks support - completion, async, streaming
2024-05-23 19:23:19 -07:00
Krrish Dholakia
43353c28b3
feat(databricks.py): add embedding model support
2024-05-23 18:22:03 -07:00
Krrish Dholakia
d2229dcd21
feat(databricks.py): adds databricks support - completion, async, streaming
...
Closes https://github.com/BerriAI/litellm/issues/2160
2024-05-23 16:29:46 -07:00
Miguel Escriva
43dc97a331
fix(factory.py): Ollama vision fix.
...
Add convert_to_ollama_image function to handle image conversion.
2024-05-23 11:11:20 +02:00
frob
9d4b7c17a6
Merge branch 'BerriAI:main' into ollama-image-handling
2024-05-22 14:08:39 +02:00
Krrish Dholakia
f3d29a6b4a
feat(anthropic.py): support anthropic 'tool_choice' param
...
Closes https://github.com/BerriAI/litellm/issues/3752
2024-05-21 17:50:44 -07:00
BeatrixCohere
ecd6037e15
Add request source
2024-05-21 10:12:57 +01:00
