phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-26 03:04:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
21569 commits 2484 branches 894 tags 536 MiB
Commit graph

699 commits

Author SHA1 Message Date
Ishaan Jaff
462da5a778 fix - support base 64 image conversion for all gemini model 2024-04-15 18:18:55 -07:00
Krrish Dholakia
4e81acf2c6 feat(prometheus_services.py): monitor health of proxy adjacent services (redis / postgres / etc.) 2024-04-13 18:15:02 -07:00
Krrish Dholakia
df62f931e7 fix(proxy_server.py): allow 'upperbound_key_generate' params to be set via 'os.environ/' 2024-04-09 07:48:29 -07:00
Krrish Dholakia
b6cd200676 fix(llm_guard.py): enable request-specific llm guard flag 2024-04-08 21:15:33 -07:00
Krrish Dholakia
460546956d fix(utils.py): fix import 2024-04-06 18:37:38 -07:00
Krrish Dholakia
a410981972 fix(utils.py): fix circular import 2024-04-06 18:29:51 -07:00
Krrish Dholakia
6110d32b1c feat(proxy/utils.py): return api base for request hanging alerts 2024-04-06 15:58:53 -07:00
Ishaan Jaff
2174b240d8
Merge pull request #2861 from BerriAI/litellm_add_azure_command_r_plust 
[FEAT] add azure command-r-plus
 2024-04-05 15:13:35 -07:00
Ishaan Jaff
5ce80d82d3 fix support azure/mistral models 2024-04-05 09:32:39 -07:00
Krrish Dholakia
f0c4ff6e60 fix(vertex_ai_anthropic.py): support streaming, async completion, async streaming for vertex ai anthropic 2024-04-05 09:27:48 -07:00
Krish Dholakia
eb34306099
Merge pull request #2665 from BerriAI/litellm_claude_vertex_ai 
[WIP] feat(vertex_ai_anthropic.py): Add support for claude 3 on vertex ai
 2024-04-05 07:06:04 -07:00
Krrish Dholakia
1d341970ba feat(vertex_ai_anthropic.py): add claude 3 on vertex ai support - working .completions call 
.completions() call works
 2024-04-02 22:07:39 -07:00
RaGe
c16833e73c (fix) add vertex_language_models to model_list 2024-04-02 20:02:46 -04:00
RaGe
a250aedf71 (fix) restore missing comma 2024-04-02 20:02:28 -04:00
Krrish Dholakia
203e2776f8 fix(proxy_server.py): allow user to set in-memory + redis ttl 
addresses - https://github.com/BerriAI/litellm/issues/2700
 2024-04-01 19:13:23 -07:00
Krrish Dholakia
5280fc809f fix(proxy_server.py): enforce end user budgets with 'litellm.max_end_user_budget' param 2024-03-29 17:14:40 -07:00
Krrish Dholakia
6d418a2920 fix(llm_guard.py): working llm-guard 'key-specific' mode 2024-03-26 17:47:20 -07:00
Krrish Dholakia
e10eb8f6fe feat(llm_guard.py): enable key-specific llm guard check 2024-03-26 17:21:51 -07:00
Krrish Dholakia
f153889738 fix(utils.py): allow user to disable streaming logging 
fixes event loop issue for litellm.disable_streaming_logging
 2024-03-25 14:28:46 -07:00
Krrish Dholakia
bc66ef9d5c fix(utils.py): fix aws secret manager + support key_management_settings 
fixes the aws secret manager implementation and allows the user to set which keys they want to check thr
ough it
 2024-03-16 16:47:50 -07:00
Krrish Dholakia
9909f44015 feat(utils.py): add native fireworks ai support 
addresses - https://github.com/BerriAI/litellm/issues/777, https://github.com/BerriAI/litellm/issues/2486
 2024-03-15 09:09:59 -07:00
Krrish Dholakia
a634424fb2 fix(utils.py): move to using litellm.modify_params to enable max output token trimming fix 2024-03-14 12:17:56 -07:00
Ishaan Jaff
5172fb1de9
Merge pull request #2474 from BerriAI/litellm_support_command_r 
[New-Model] Cohere/command-r
 2024-03-12 11:11:56 -07:00
ishaan-jaff
777cf094e5 (feat) use model json to get cohere_models 2024-03-12 10:53:26 -07:00
ishaan-jaff
042a71cdc7 (feat) v0 support command-r 2024-03-12 10:26:58 -07:00
ishaan-jaff
b193b01f40 (feat) support azure/gpt-instruct models 2024-03-12 09:30:15 -07:00
Krrish Dholakia
daa371ade9 fix(utils.py): add support for anthropic params in get_supported_openai_params 2024-03-08 23:06:40 -08:00
Krrish Dholakia
0e7b30bec9 fix(utils.py): return function name for ollama_chat function calls 2024-03-08 08:01:10 -08:00
Krish Dholakia
5b3459d759
Merge branch 'main' into litellm_claude_3_bedrock_access 2024-03-05 07:10:45 -08:00
Krrish Dholakia
f277b204a3 fix(init.py): expose 'get_model_params' function 2024-03-04 21:22:09 -08:00
Krrish Dholakia
0ac652a771 fix(bedrock.py): add claude 3 support 2024-03-04 17:15:47 -08:00
ishaan-jaff
9094be7fbd (feat) maintain support to Anthropic text completion 2024-03-04 11:13:14 -08:00
Ishaan Jaff
84415ef7b5
Merge pull request #2290 from ti3x/bedrock_mistral 
Add support for Bedrock Mistral models
 2024-03-04 08:42:47 -08:00
ishaan-jaff
fd9f8b7010 (docs) setting soft budgets 2024-03-02 13:05:00 -08:00
Tim Xia
b4dc7f0f17 Add AmazonMistralConfig 2024-03-01 23:14:00 -05:00
ishaan-jaff
56d20cd073 (test) supports_function_calling 2024-02-28 17:36:15 -08:00
Krrish Dholakia
0806aa8da1 fix(proxy_server.py): enable default new user params 2024-02-23 16:39:50 -08:00
ishaan-jaff
e80fcc2762 (feat) add groq ai 2024-02-23 10:40:46 -08:00
Krrish Dholakia
acae98fd50 feat(proxy_server.py): enable admin to set banned keywords on proxy 2024-02-22 18:30:42 -08:00
Krrish Dholakia
028f455ad0 feat(proxy_server.py): add support for blocked user lists (enterprise-only) 2024-02-22 17:51:31 -08:00
Krrish Dholakia
72bcd5a4af fix(presidio_pii_masking.py): enable user to pass their own ad hoc recognizers to presidio 2024-02-20 15:19:31 -08:00
Krish Dholakia
b41cdf598b
Merge branch 'main' into litellm_google_text_moderation 2024-02-17 22:10:26 -08:00
Krrish Dholakia
ddf0911c46 feat(google_text_moderation.py): allow user to use google text moderation for content mod on proxy 2024-02-17 18:36:29 -08:00
Krrish Dholakia
074d93cc97 feat(llama_guard.py): allow user to define custom unsafe content categories 2024-02-17 17:42:47 -08:00
Krrish Dholakia
2a4a6995ac feat(llama_guard.py): add llama guard support for content moderation + new async_moderation_hook endpoint 2024-02-16 18:45:25 -08:00
ishaan-jaff
3e90acb750 (feat) support headers for generic API logger 2024-02-15 13:50:01 -08:00
Krrish Dholakia
fe1fe70c64 fix(vertex_ai.py): map finish reason 2024-02-14 11:42:13 -08:00
Krrish Dholakia
f68b656040 feat(presidio_pii_masking.py): enable output parsing for pii masking 2024-02-13 21:36:57 -08:00
ishaan-jaff
047b2f9b1a (Feat) support max_user_budget 2024-02-06 15:13:59 -08:00
ishaan-jaff
a712596d46 (feat) upperbound_key_generate_params 2024-02-05 22:38:47 -08:00