Commit graph

599 commits

Author SHA1 Message Date
Krrish Dholakia
f0a5e0ffe9 fix(bedrock.py): working image calls to claude 3 2024-03-04 18:12:47 -08:00
Krrish Dholakia
dad65ca602 fix(bedrock.py): support anthropic messages api on bedrock (claude-3) 2024-03-04 17:15:47 -08:00
Krrish Dholakia
6c486c2461 fix(bedrock.py): add claude 3 support 2024-03-04 17:15:47 -08:00
Krrish Dholakia
85afc91f08 fix(factory.py): fix prompt mapping 2024-03-04 17:15:47 -08:00
Krrish Dholakia
174cb268d6 refactor(anthropic.py): fix linting error 2024-03-04 13:58:43 -08:00
Krrish Dholakia
4f5f6ec812 test(test_completion.py): add testing for anthropic vision calling 2024-03-04 13:34:49 -08:00
Krrish Dholakia
fb694128e9 fix(factory.py): support anthropic vision calling 2024-03-04 13:08:25 -08:00
Krrish Dholakia
83d527f047 fix(test_completion.py): testing for anthropic function calling 2024-03-04 11:31:56 -08:00
Krrish Dholakia
1e2154317c feat(anthropic.py): adds tool calling support 2024-03-04 10:42:28 -08:00
Krrish Dholakia
fed3f98582 fix(anthropic.py): support anthropic system prompt 2024-03-04 10:11:29 -08:00
Krrish Dholakia
a1ce24c5f0 fix(huggingface_restapi.py): fix huggingface streaming error raising 2024-03-04 09:32:41 -08:00
Ishaan Jaff
561e7ff453 Merge pull request #2315 from BerriAI/litellm_add_claude_3
[FEAT]- add claude 3
2024-03-04 09:23:13 -08:00
ishaan-jaff
4a4c4e3466 (test) claude fixes 2024-03-04 08:20:26 -08:00
ishaan-jaff
1defd7b50f (feat) claude-3 test fixes 2024-03-04 07:53:06 -08:00
ishaan-jaff
26eea94404 (feat) - add claude 3 2024-03-04 07:13:08 -08:00
Tim Xia
593d4084c4 Fix message template based on transformers chat_template docs 2024-03-02 22:27:42 -05:00
Tim Xia
30887760e6 change to snake case 'cause of aws docs 2024-03-02 00:07:21 -05:00
Tim Xia
fe3d7577dc follow camelcase convention 2024-03-01 23:58:03 -05:00
Tim Xia
78a93e40ed Add AmazonMistralConfig 2024-03-01 23:14:00 -05:00
Tim Xia
6f389097d2 add support for bedrock mistral models 2024-03-01 22:45:54 -05:00
Krrish Dholakia
3b5d5b6117 refactor(vertex_ai.py): add more logging for the vertex_ai file 2024-03-01 08:33:26 -08:00
Krrish Dholakia
56869b4121 refactor(openai.py): more logging around failed openai calls 2024-02-29 19:30:40 -08:00
Krrish Dholakia
cc79ba0222 fix(ollama_chat.py): map tool call to assistant for ollama calls 2024-02-29 19:11:35 -08:00
ishaan-jaff
f1f3c97a7c (test) vertex - detect mime type 2024-02-29 15:38:25 -08:00
ishaan-jaff
d9632ae48c (feat) add support for gemini base64 images 2024-02-29 14:42:20 -08:00
Krrish Dholakia
3aaa0fe98d refactor(vertex_ai.py): add more logging to show the vertex ai client init params 2024-02-27 18:35:15 -08:00
Krish Dholakia
1f7bfc2e90 Merge pull request #2201 from Lunik/fix/ollama-vision
🐛 fix: Ollama vision models call arguments (like : llava)
2024-02-27 07:18:01 -08:00
Krrish Dholakia
8f954fed24 test(test_custom_callback_input.py): assert async success called only once during vertex ai streaming 2024-02-26 09:18:46 -08:00
Lunik
a1be265052 🐛 fix: Ollama vision models call arguments (like : llava)
Signed-off-by: Lunik <lunik@tiwabbit.fr>
2024-02-26 17:52:55 +01:00
ishaan-jaff
1ff241e4b3 (fix) use api_base in health checks 2024-02-24 18:39:20 -08:00
Krrish Dholakia
ed72005f52 fix(huggingface_restapi.py): return initial hf error 2024-02-24 10:46:59 -08:00
Krrish Dholakia
2e5a5f82a3 fix(vertex_ai.py): fix vertex ai function calling 2024-02-22 21:28:24 -08:00
Krrish Dholakia
723b0db085 test(gemini.py): handle async streaming exceptions 2024-02-21 22:33:20 -08:00
Krish Dholakia
d1cd3073c3 Merge pull request #1969 from kan-bayashi/fix/support-multiple-tools-in-gemini
fix: fix the issues when using tools in gemini
2024-02-21 11:46:26 -08:00
Krish Dholakia
ccebddeddb Merge pull request #2103 from BerriAI/litellm_fix_async_sagemaker
fix(sagemaker.py): fix async sagemaker calls
2024-02-20 19:44:27 -08:00
Krrish Dholakia
abb88e50eb fix(sagemaker.py): fix async sagemaker calls
https://github.com/BerriAI/litellm/issues/2086
2024-02-20 17:20:01 -08:00
Krrish Dholakia
13b35db8d7 fix(gemini.py): implement custom streamer 2024-02-20 17:10:51 -08:00
Krrish Dholakia
11c12e7381 fix(gemini.py): fix async streaming + add native async completions 2024-02-19 22:41:36 -08:00
Krish Dholakia
8e0040c09d Merge branch 'main' into litellm_llamaguard_custom_categories 2024-02-17 21:36:40 -08:00
Krrish Dholakia
f52b3c5f84 feat(llama_guard.py): allow user to define custom unsafe content categories 2024-02-17 17:42:47 -08:00
Krish Dholakia
75e6455c4b Merge pull request #2013 from afbarbaro/litellm_gemini_safety_settings
Add safety_settings parameter to gemini generate_content calls
2024-02-17 16:47:29 -08:00
Krrish Dholakia
67cd9b1c63 feat(llama_guard.py): add llama guard support for content moderation + new async_moderation_hook endpoint 2024-02-16 18:45:25 -08:00
Krrish Dholakia
2a5a14d612 fix(utils.py): support image gen logging to langfuse 2024-02-16 16:12:52 -08:00
Krrish Dholakia
9c2cce56f7 fix(huggingface_restapi.py): return streamed response correctly 2024-02-16 13:25:13 -08:00
Andres Barbaro
e39ef5a633 Add safety_settings parameter to gemini generate_content calls 2024-02-16 12:22:18 -06:00
Krish Dholakia
3c0fc3ea3c Merge branch 'main' into litellm_moderations_improvements 2024-02-15 23:08:25 -08:00
Krish Dholakia
233aff5ba9 Merge pull request #1916 from RenaLu/main
Add support for Vertex AI custom models deployed on private endpoint
2024-02-15 22:47:36 -08:00
Krrish Dholakia
e5a444f69a fix(huggingface_restapi.py): fix hf streaming to raise exceptions 2024-02-15 21:25:12 -08:00
Krrish Dholakia
781512ce58 fix(huggingface_restapi.py): catch streaming errors 2024-02-15 20:55:21 -08:00
Krrish Dholakia
f82a335118 fix(test_streaming.py): handle hf tgi zephyr not loading for streaming issue 2024-02-15 19:24:02 -08:00