Krrish Dholakia
bb905d7243
fix(utils.py): support 'drop_params' for 'parallel_tool_calls'
...
Closes https://github.com/BerriAI/litellm/issues/4584
OpenAI-only param
2024-07-08 07:36:41 -07:00
Ishaan Jaff
4033302656
feat - return headers for openai audio transcriptions
2024-07-01 20:27:27 -07:00
Ishaan Jaff
04a975d486
feat - add response_headers in litellm_logging_obj
2024-07-01 17:25:15 -07:00
Ishaan Jaff
140f7fe254
return azure response headers
2024-07-01 17:09:06 -07:00
Ishaan Jaff
4b7feb3261
feat - return response headers for async openai requests
2024-07-01 17:01:42 -07:00
Krrish Dholakia
d10912beeb
fix(main.py): pass in openrouter as custom provider for openai client call
...
Fixes https://github.com/BerriAI/litellm/issues/4414
2024-06-28 21:26:42 -07:00
Ishaan Jaff
b7bca0af6c
fix - reuse client initialized on proxy config
2024-06-26 16:16:58 -07:00
Ishaan Jaff
eb8a9b2654
fix - /moderation don't require a model
2024-06-21 16:00:43 -07:00
Krrish Dholakia
9cc104eb03
fix(main.py): route openai calls to /completion when text_completion is True
2024-06-19 12:37:05 -07:00
Krrish Dholakia
5ad095ad9d
fix(openai.py): deepinfra function calling - drop_params support for unsupported tool choice value
2024-06-18 16:19:57 -07:00
Ishaan Jaff
e128dc4e1f
feat - add azure ai studio models on litellm ui
2024-06-12 20:28:16 -07:00
Ishaan Jaff
7eeef7ec1f
feat - add mistral embedding config
2024-06-12 15:00:00 -07:00
Krrish Dholakia
650ea6d0c3
feat(assistants/main.py): support arun_thread_stream
2024-06-04 16:47:51 -07:00
Krrish Dholakia
f3d78532f9
feat(assistants/main.py): add assistants api streaming support
2024-06-04 16:30:35 -07:00
Krrish Dholakia
7163bce37b
feat(assistants/main.py): Closes https://github.com/BerriAI/litellm/issues/3993
2024-06-03 18:47:05 -07:00
Krrish Dholakia
93c9ea160d
fix(openai.py): fix client caching logic
2024-06-01 16:45:56 -07:00
Ishaan Jaff
47dd52c566
fix used hashed api key
2024-06-01 09:24:16 -07:00
Ishaan Jaff
47337c172e
fix - in memory client cache
2024-06-01 08:58:22 -07:00
Ishaan Jaff
1c16904566
fix cache openai client for embeddings, text, speech
2024-05-31 21:35:03 -07:00
Ishaan Jaff
cedeb10a08
fix - linting error
2024-05-31 21:24:14 -07:00
Ishaan Jaff
6feeff1f31
feat - cache openai clients
2024-05-31 21:22:06 -07:00
Krish Dholakia
08bae3185a
Merge pull request #3936 from BerriAI/litellm_assistants_api_proxy
...
feat(proxy_server.py): add assistants api endpoints to proxy server
2024-05-31 18:43:22 -07:00
Krrish Dholakia
e2b34165e7
feat(proxy_server.py): add assistants api endpoints to proxy server
2024-05-30 22:44:43 -07:00
Krrish Dholakia
93166cdabf
fix(openai.py): fix openai response for /audio/speech endpoint
2024-05-30 16:41:06 -07:00
Krrish Dholakia
a67cbf47f6
feat(main.py): support openai tts endpoint
...
Closes https://github.com/BerriAI/litellm/issues/3094
2024-05-30 14:28:28 -07:00
Krrish Dholakia
da56201e80
fix(main.py): pass api key and api base to openai.py for audio transcription call
2024-05-29 21:29:01 -07:00
Krrish Dholakia
3d32b00821
fix(openai.py): only allow 'user' as optional param if openai model
2024-05-29 15:15:02 -07:00
Ishaan Jaff
ca8163bbba
feat - add afile_content, file_content
2024-05-28 20:58:22 -07:00
Ishaan Jaff
6688215c18
feat - add aretrieve_batch
2024-05-28 17:12:41 -07:00
Ishaan Jaff
1ef7cd923c
feat - add acreate_batch
2024-05-28 17:03:29 -07:00
Ishaan Jaff
758ed9e923
feat - add litellm.acreate_file
2024-05-28 16:47:27 -07:00
Ishaan Jaff
38285e53c3
working create_batch
2024-05-28 15:45:23 -07:00
Ishaan Jaff
d5dbf084ed
feat - import batches in __init__
2024-05-28 15:35:11 -07:00
Krrish Dholakia
322a8218c0
fix(openai.py): fix deepinfra config optional param
2024-05-27 18:36:34 -07:00
Krrish Dholakia
f0f853b941
fix(utils.py): support deepinfra optional params
...
Fixes https://github.com/BerriAI/litellm/issues/3855
2024-05-27 09:16:56 -07:00
Krrish Dholakia
43353c28b3
feat(databricks.py): add embedding model support
2024-05-23 18:22:03 -07:00
Krrish Dholakia
d2229dcd21
feat(databricks.py): adds databricks support - completion, async, streaming
...
Closes https://github.com/BerriAI/litellm/issues/2160
2024-05-23 16:29:46 -07:00
Krish Dholakia
d69ad99e76
Merge pull request #3657 from phact/patch-4
...
Another dictionary changed size during iteration error
2024-05-20 17:45:50 -07:00
Krrish Dholakia
25df95ab10
feat(proxy_server.py): new 'supported_openai_params' endpoint
...
get supported openai params for a given model
2024-05-20 08:39:50 -07:00
Krrish Dholakia
12942c39db
fix(utils.py): drop response_format if 'drop_params=True' for gpt-4
2024-05-18 13:02:48 -07:00
Sebastián Estévez
9b7465a222
Another dictionary changed size during iteration error
...
```
ImportError while loading conftest '/astra-assistants-api/tests/openai-sdk/conftest.py'.
conftest.py:13: in <module>
from impl.astra_vector import CassandraClient
../../impl/astra_vector.py:45: in <module>
from impl.services.inference_utils import get_embeddings
../../impl/services/inference_utils.py:5: in <module>
import litellm
.cache/pypoetry/virtualenvs/astra-assistants-api-eiSmbCzm-py3.10/lib/python3.10/site-packages/litellm/__init__.py:678: in <module>
from .main import * # type: ignore
.cache/pypoetry/virtualenvs/astra-assistants-api-eiSmbCzm-py3.10/lib/python3.10/site-packages/litellm/main.py:73: in <module>
from .llms.azure_text import AzureTextCompletion
.cache/pypoetry/virtualenvs/astra-assistants-api-eiSmbCzm-py3.10/lib/python3.10/site-packages/litellm/llms/azure_text.py:23: in <module>
openai_text_completion_config = OpenAITextCompletionConfig()
.cache/pypoetry/virtualenvs/astra-assistants-api-eiSmbCzm-py3.10/lib/python3.10/site-packages/litellm/llms/openai.py:192: in __init__
for key, value in locals_.items():
E RuntimeError: dictionary changed size during iteration
```
2024-05-15 17:06:54 -04:00
Krrish Dholakia
20456968e9
fix(openai.py): creat MistralConfig with response_format mapping for mistral api
2024-05-13 13:29:58 -07:00
Ishaan Jaff
66053f14ae
stream_options for text-completionopenai
2024-05-09 08:37:40 -07:00
Ishaan Jaff
1042051602
support stream_options for chat completion models
2024-05-08 21:52:25 -07:00
Krrish Dholakia
6575143460
feat(proxy_server.py): return litellm version in response headers
2024-05-08 16:00:08 -07:00
Krrish Dholakia
1195bf296b
fix(openai.py): fix typing import for python 3.8
2024-05-04 21:49:30 -07:00
Krrish Dholakia
f2bf6411d8
fix(openai.py): fix linting error
2024-05-04 21:48:42 -07:00
Krrish Dholakia
8fe6c9b401
feat(assistants/main.py): support litellm.get_assistants() and litellm.get_messages()
2024-05-04 21:30:28 -07:00
Krrish Dholakia
cad01fb586
feat(assistants/main.py): support 'litellm.get_threads'
2024-05-04 21:14:03 -07:00
Krrish Dholakia
b7796c7487
feat(assistants/main.py): add 'add_message' endpoint
2024-05-04 19:56:11 -07:00
