Commit graph

459 commits

Author SHA1 Message Date
Krish Dholakia
7ed64709aa Merge branch 'main' into litellm_common_auth_params 2024-04-28 08:38:06 -07:00
Ishaan Jaff
48d590c428 Merge pull request #3330 from BerriAI/litellm_rdct_msgs
[Feat] Redact Logging Messages/Response content on Logging Providers with `litellm.turn_off_message_logging=True`
2024-04-27 11:25:09 -07:00
Krrish Dholakia
ee68c0aaaa feat(utils.py): unify common auth params across azure/vertex_ai/bedrock/watsonx 2024-04-27 11:06:18 -07:00
Ishaan Jaff
57aa9875a8 feat - turn_off_message_logging 2024-04-27 10:01:09 -07:00
Krish Dholakia
b7beab2e39 Merge pull request #3270 from simonsanvil/feature/watsonx-integration
(feat) add IBM watsonx.ai as an llm provider
2024-04-27 05:48:34 -07:00
Krrish Dholakia
ca4918b9a7 fix(router.py): support verify_ssl flag
Fixes https://github.com/BerriAI/litellm/issues/3162#issuecomment-2075273807
2024-04-26 15:38:01 -07:00
Simon Sanchez Viloria
572cbef43b feat - watsonx refractoring, removed dependency, and added support for embedding calls 2024-04-23 12:01:13 +02:00
Simon Sanchez Viloria
9b3a1b3f35 Added support for IBM watsonx.ai models 2024-04-20 20:06:46 +02:00
Ishaan Jaff
c5b077a02e fix - allow users to opt into langfuse default tags 2024-04-19 16:01:27 -07:00
Krrish Dholakia
9dc0871023 fix(ollama_chat.py): accept api key as a param for ollama calls
allows user to call hosted ollama endpoint using bearer token for auth
2024-04-19 13:02:13 -07:00
Ishaan Jaff
1d96a54c34 fix - support base 64 image conversion for all gemini model 2024-04-15 18:18:55 -07:00
Krrish Dholakia
866259f95f feat(prometheus_services.py): monitor health of proxy adjacent services (redis / postgres / etc.) 2024-04-13 18:15:02 -07:00
Krrish Dholakia
d3ffb22773 fix(proxy_server.py): allow 'upperbound_key_generate' params to be set via 'os.environ/' 2024-04-09 07:48:29 -07:00
Krrish Dholakia
aa4acaf06b fix(llm_guard.py): enable request-specific llm guard flag 2024-04-08 21:15:33 -07:00
Krrish Dholakia
fd67dc7556 fix(utils.py): fix import 2024-04-06 18:37:38 -07:00
Krrish Dholakia
179cede5a4 fix(utils.py): fix circular import 2024-04-06 18:29:51 -07:00
Krrish Dholakia
0dad78b53c feat(proxy/utils.py): return api base for request hanging alerts 2024-04-06 15:58:53 -07:00
Ishaan Jaff
f65828db26 Merge pull request #2861 from BerriAI/litellm_add_azure_command_r_plust
[FEAT] add azure command-r-plus
2024-04-05 15:13:35 -07:00
Ishaan Jaff
c74d43fcbc fix support azure/mistral models 2024-04-05 09:32:39 -07:00
Krrish Dholakia
a8d0aace83 fix(vertex_ai_anthropic.py): support streaming, async completion, async streaming for vertex ai anthropic 2024-04-05 09:27:48 -07:00
Krish Dholakia
5ea9946925 Merge pull request #2665 from BerriAI/litellm_claude_vertex_ai
[WIP] feat(vertex_ai_anthropic.py): Add support for claude 3 on vertex ai
2024-04-05 07:06:04 -07:00
Krrish Dholakia
bd7040969b feat(vertex_ai_anthropic.py): add claude 3 on vertex ai support - working .completions call
.completions() call works
2024-04-02 22:07:39 -07:00
RaGe
d7f4d38414 (fix) add vertex_language_models to model_list 2024-04-02 20:02:46 -04:00
RaGe
a0ad1267d5 (fix) restore missing comma 2024-04-02 20:02:28 -04:00
Krrish Dholakia
aa5f88ec45 fix(proxy_server.py): allow user to set in-memory + redis ttl
addresses - https://github.com/BerriAI/litellm/issues/2700
2024-04-01 19:13:23 -07:00
Krrish Dholakia
49e2624240 fix(proxy_server.py): enforce end user budgets with 'litellm.max_end_user_budget' param 2024-03-29 17:14:40 -07:00
Krrish Dholakia
f3a56c5af2 fix(llm_guard.py): working llm-guard 'key-specific' mode 2024-03-26 17:47:20 -07:00
Krrish Dholakia
7bc76ddbc3 feat(llm_guard.py): enable key-specific llm guard check 2024-03-26 17:21:51 -07:00
Krrish Dholakia
c667e437b9 fix(utils.py): allow user to disable streaming logging
fixes event loop issue for litellm.disable_streaming_logging
2024-03-25 14:28:46 -07:00
Krrish Dholakia
bad2327b88 fix(utils.py): fix aws secret manager + support key_management_settings
fixes the aws secret manager implementation and allows the user to set which keys they want to check thr
ough it
2024-03-16 16:47:50 -07:00
Krrish Dholakia
0783a3f247 feat(utils.py): add native fireworks ai support
addresses - https://github.com/BerriAI/litellm/issues/777, https://github.com/BerriAI/litellm/issues/2486
2024-03-15 09:09:59 -07:00
Krrish Dholakia
1e1190745f fix(utils.py): move to using litellm.modify_params to enable max output token trimming fix 2024-03-14 12:17:56 -07:00
Ishaan Jaff
15591d0978 Merge pull request #2474 from BerriAI/litellm_support_command_r
[New-Model] Cohere/command-r
2024-03-12 11:11:56 -07:00
ishaan-jaff
5e5f9f1a3e (feat) use model json to get cohere_models 2024-03-12 10:53:26 -07:00
ishaan-jaff
98864b7ed9 (feat) v0 support command-r 2024-03-12 10:26:58 -07:00
ishaan-jaff
c5ebbd1868 (feat) support azure/gpt-instruct models 2024-03-12 09:30:15 -07:00
Krrish Dholakia
744fe7232d fix(utils.py): add support for anthropic params in get_supported_openai_params 2024-03-08 23:06:40 -08:00
Krrish Dholakia
69ca9cf0fa fix(utils.py): return function name for ollama_chat function calls 2024-03-08 08:01:10 -08:00
Krish Dholakia
d53257b7f7 Merge branch 'main' into litellm_claude_3_bedrock_access 2024-03-05 07:10:45 -08:00
Krrish Dholakia
b042a28b91 fix(init.py): expose 'get_model_params' function 2024-03-04 21:22:09 -08:00
Krrish Dholakia
6c486c2461 fix(bedrock.py): add claude 3 support 2024-03-04 17:15:47 -08:00
ishaan-jaff
91ce6d25b1 (feat) maintain support to Anthropic text completion 2024-03-04 11:13:14 -08:00
Ishaan Jaff
fc34999168 Merge pull request #2290 from ti3x/bedrock_mistral
Add support for Bedrock Mistral models
2024-03-04 08:42:47 -08:00
ishaan-jaff
ad496aac10 (docs) setting soft budgets 2024-03-02 13:05:00 -08:00
Tim Xia
78a93e40ed Add AmazonMistralConfig 2024-03-01 23:14:00 -05:00
ishaan-jaff
86d1aabf22 (test) supports_function_calling 2024-02-28 17:36:15 -08:00
Krrish Dholakia
7fac7c47c6 fix(proxy_server.py): enable default new user params 2024-02-23 16:39:50 -08:00
ishaan-jaff
c6bfcabccd (feat) add groq ai 2024-02-23 10:40:46 -08:00
Krrish Dholakia
d00773c2b1 feat(proxy_server.py): enable admin to set banned keywords on proxy 2024-02-22 18:30:42 -08:00
Krrish Dholakia
d1dd8854c2 feat(proxy_server.py): add support for blocked user lists (enterprise-only) 2024-02-22 17:51:31 -08:00