Commit graph

437 commits

Author SHA1 Message Date
RaGe
c16833e73c (fix) add vertex_language_models to model_list 2024-04-02 20:02:46 -04:00
RaGe
a250aedf71 (fix) restore missing comma 2024-04-02 20:02:28 -04:00
Krrish Dholakia
203e2776f8 fix(proxy_server.py): allow user to set in-memory + redis ttl
addresses - https://github.com/BerriAI/litellm/issues/2700
2024-04-01 19:13:23 -07:00
Krrish Dholakia
5280fc809f fix(proxy_server.py): enforce end user budgets with 'litellm.max_end_user_budget' param 2024-03-29 17:14:40 -07:00
Krrish Dholakia
6d418a2920 fix(llm_guard.py): working llm-guard 'key-specific' mode 2024-03-26 17:47:20 -07:00
Krrish Dholakia
e10eb8f6fe feat(llm_guard.py): enable key-specific llm guard check 2024-03-26 17:21:51 -07:00
Krrish Dholakia
f153889738 fix(utils.py): allow user to disable streaming logging
fixes event loop issue for litellm.disable_streaming_logging
2024-03-25 14:28:46 -07:00
Krrish Dholakia
bc66ef9d5c fix(utils.py): fix aws secret manager + support key_management_settings
fixes the aws secret manager implementation and allows the user to set which keys they want to check thr
ough it
2024-03-16 16:47:50 -07:00
Krrish Dholakia
9909f44015 feat(utils.py): add native fireworks ai support
addresses - https://github.com/BerriAI/litellm/issues/777, https://github.com/BerriAI/litellm/issues/2486
2024-03-15 09:09:59 -07:00
Krrish Dholakia
a634424fb2 fix(utils.py): move to using litellm.modify_params to enable max output token trimming fix 2024-03-14 12:17:56 -07:00
Ishaan Jaff
5172fb1de9
Merge pull request #2474 from BerriAI/litellm_support_command_r
[New-Model] Cohere/command-r
2024-03-12 11:11:56 -07:00
ishaan-jaff
777cf094e5 (feat) use model json to get cohere_models 2024-03-12 10:53:26 -07:00
ishaan-jaff
042a71cdc7 (feat) v0 support command-r 2024-03-12 10:26:58 -07:00
ishaan-jaff
b193b01f40 (feat) support azure/gpt-instruct models 2024-03-12 09:30:15 -07:00
Krrish Dholakia
daa371ade9 fix(utils.py): add support for anthropic params in get_supported_openai_params 2024-03-08 23:06:40 -08:00
Krrish Dholakia
0e7b30bec9 fix(utils.py): return function name for ollama_chat function calls 2024-03-08 08:01:10 -08:00
Krish Dholakia
5b3459d759
Merge branch 'main' into litellm_claude_3_bedrock_access 2024-03-05 07:10:45 -08:00
Krrish Dholakia
f277b204a3 fix(init.py): expose 'get_model_params' function 2024-03-04 21:22:09 -08:00
Krrish Dholakia
0ac652a771 fix(bedrock.py): add claude 3 support 2024-03-04 17:15:47 -08:00
ishaan-jaff
9094be7fbd (feat) maintain support to Anthropic text completion 2024-03-04 11:13:14 -08:00
Ishaan Jaff
84415ef7b5
Merge pull request #2290 from ti3x/bedrock_mistral
Add support for Bedrock Mistral models
2024-03-04 08:42:47 -08:00
ishaan-jaff
fd9f8b7010 (docs) setting soft budgets 2024-03-02 13:05:00 -08:00
Tim Xia
b4dc7f0f17 Add AmazonMistralConfig 2024-03-01 23:14:00 -05:00
ishaan-jaff
56d20cd073 (test) supports_function_calling 2024-02-28 17:36:15 -08:00
Krrish Dholakia
0806aa8da1 fix(proxy_server.py): enable default new user params 2024-02-23 16:39:50 -08:00
ishaan-jaff
e80fcc2762 (feat) add groq ai 2024-02-23 10:40:46 -08:00
Krrish Dholakia
acae98fd50 feat(proxy_server.py): enable admin to set banned keywords on proxy 2024-02-22 18:30:42 -08:00
Krrish Dholakia
028f455ad0 feat(proxy_server.py): add support for blocked user lists (enterprise-only) 2024-02-22 17:51:31 -08:00
Krrish Dholakia
72bcd5a4af fix(presidio_pii_masking.py): enable user to pass their own ad hoc recognizers to presidio 2024-02-20 15:19:31 -08:00
Krish Dholakia
b41cdf598b
Merge branch 'main' into litellm_google_text_moderation 2024-02-17 22:10:26 -08:00
Krrish Dholakia
ddf0911c46 feat(google_text_moderation.py): allow user to use google text moderation for content mod on proxy 2024-02-17 18:36:29 -08:00
Krrish Dholakia
074d93cc97 feat(llama_guard.py): allow user to define custom unsafe content categories 2024-02-17 17:42:47 -08:00
Krrish Dholakia
2a4a6995ac feat(llama_guard.py): add llama guard support for content moderation + new async_moderation_hook endpoint 2024-02-16 18:45:25 -08:00
ishaan-jaff
3e90acb750 (feat) support headers for generic API logger 2024-02-15 13:50:01 -08:00
Krrish Dholakia
fe1fe70c64 fix(vertex_ai.py): map finish reason 2024-02-14 11:42:13 -08:00
Krrish Dholakia
f68b656040 feat(presidio_pii_masking.py): enable output parsing for pii masking 2024-02-13 21:36:57 -08:00
ishaan-jaff
047b2f9b1a (Feat) support max_user_budget 2024-02-06 15:13:59 -08:00
ishaan-jaff
a712596d46 (feat) upperbound_key_generate_params 2024-02-05 22:38:47 -08:00
Krrish Dholakia
c49c88c8e5 fix(utils.py): route together ai calls to openai client
together ai is now openai-compatible

n
2024-02-03 19:22:48 -08:00
Krish Dholakia
6408af11b6
Merge pull request #1799 from BerriAI/litellm_bedrock_stable_diffusion_support
feat(bedrock.py): add stable diffusion image generation support
2024-02-03 12:59:00 -08:00
Krrish Dholakia
36416360c4 feat(bedrock.py): add stable diffusion image generation support 2024-02-03 12:08:38 -08:00
Krrish Dholakia
d9ba8668f4 feat(vertex_ai.py): vertex ai gecko text embedding support 2024-02-03 09:48:29 -08:00
Krish Dholakia
9a3fa243b8
Merge branch 'main' into litellm_team_id_support 2024-02-01 21:40:22 -08:00
ishaan-jaff
87709ef77f (fix) bug with LITELLM_LOCAL_MODEL_COST_MAP 2024-02-01 21:11:05 -08:00
Krrish Dholakia
a301d8aa4b feat(utils.py): support dynamic langfuse params and team settings on proxy 2024-02-01 21:08:24 -08:00
ishaan-jaff
f8e8c1f900 (fix) import verbose_logger 2024-02-01 20:25:16 -08:00
Krrish Dholakia
ec427ae322 fix(__init__.py): allow model_cost_map to be loaded locally 2024-02-01 18:00:30 -08:00
ishaan-jaff
72b9e539c8 (feat) proxy set default_key_generate_params 2024-01-29 14:29:54 -08:00
Krrish Dholakia
159e54d8be feat(proxy_server.py): support global budget and resets 2024-01-24 14:27:13 -08:00
Krrish Dholakia
fd4d65adcd fix(__init__.py): enable logging.debug to true if set verbose is true 2024-01-23 07:32:30 -08:00