litellm-mirror/litellm/llms
yishiyiyuan 5faa493d35 🐞 fix: djl vllm support
support vllm response format on sagemaker, which only return one choice.
2024-04-03 11:00:51 +08:00
..
custom_httpx feat(proxy/utils.py): enable updating db in a separate server 2024-03-27 16:02:36 -07:00
huggingface_llms_metadata add hf tgi and conversational models 2023-09-27 15:56:45 -07:00
prompt_templates docs: Update references to Ollama repository url 2024-03-31 19:35:37 +02:00
tokenizers fix(openai.py): return logprobs for text completion calls 2024-04-02 14:05:56 -07:00
__init__.py add linting 2023-08-18 11:05:05 -07:00
ai21.py refactor: add black formatting 2023-12-25 14:11:20 +05:30
aleph_alpha.py docs(configs.md): add load balancing to proxy config docs 2024-03-05 07:39:40 -08:00
anthropic.py fix(factory.py): parse list in xml tool calling response (anthropic) 2024-03-29 11:51:26 -07:00
anthropic_text.py (fix) claude-instant-1 test 2024-03-04 21:39:12 -08:00
azure.py fix(main.py): support max retries for transcription calls 2024-04-01 18:37:53 -07:00
azure_text.py fix(openai.py): return logprobs for text completion calls 2024-04-02 14:05:56 -07:00
base.py build(pyproject.toml): drop certifi dependency (unused) 2024-01-10 08:09:03 +05:30
baseten.py refactor: add black formatting 2023-12-25 14:11:20 +05:30
bedrock.py Add sync iterator 2024-04-02 20:14:37 +08:00
cloudflare.py (feat) cloudflare - add optional params 2023-12-29 11:50:09 +05:30
cohere.py fix(cohere.py): return usage as a pydantic object not dict 2024-03-15 10:00:22 -07:00
cohere_chat.py (feat) support tool_calling on cohere command-r 2024-03-12 14:24:48 -07:00
gemini.py build: fix mypy build issues 2024-03-21 08:27:23 -07:00
huggingface_restapi.py fix(huggingface_restapi.py): fix hf streaming issue 2024-03-04 21:16:41 -08:00
maritalk.py refactor: add black formatting 2023-12-25 14:11:20 +05:30
nlp_cloud.py refactor: add black formatting 2023-12-25 14:11:20 +05:30
ollama.py docs: Update references to Ollama repository url 2024-03-31 19:35:37 +02:00
ollama_chat.py docs: Update references to Ollama repository url 2024-03-31 19:35:37 +02:00
oobabooga.py fix: fix linting issues 2023-12-27 12:21:31 +05:30
openai.py fix(openai.py): switch to using openai sdk for text completion calls 2024-04-02 15:08:12 -07:00
openrouter.py refactor: add black formatting 2023-12-25 14:11:20 +05:30
palm.py build: fix mypy build issues 2024-03-21 08:27:23 -07:00
petals.py refactor: add black formatting 2023-12-25 14:11:20 +05:30
replicate.py fix(replicate.py): handle model endpoint 2024-03-05 19:06:24 -08:00
sagemaker.py 🐞 fix: djl vllm support 2024-04-03 11:00:51 +08:00
together_ai.py fix(utils.py): route together ai calls to openai client 2024-02-03 19:22:48 -08:00
vertex_ai.py build: fix mypy build issues 2024-03-21 08:27:23 -07:00
vllm.py refactor: add black formatting 2023-12-25 14:11:20 +05:30