Commit graph

14389 commits

Author SHA1 Message Date
Krrish Dholakia
ed5fc3d1f9 fix(utils.py): fix vertex anthropic streaming 2024-07-03 18:43:46 -07:00
Krish Dholakia
f4c3492f64
Merge pull request #4534 from BerriAI/revert-4531-litellm_vertex_anthropic_tools
Revert "fix(vertex_anthropic.py): Vertex Anthropic tool calling - native params "
2024-07-03 17:55:45 -07:00
Krish Dholakia
6c5c8bbb28
Revert "fix(vertex_anthropic.py): Vertex Anthropic tool calling - native params " 2024-07-03 17:55:37 -07:00
nick-rackauckas
ce595027ad Fix LiteLlm Granite Prompt template 2024-07-03 17:52:28 -07:00
Krish Dholakia
318077edea
Merge pull request #4531 from BerriAI/litellm_vertex_anthropic_tools
fix(vertex_anthropic.py): Vertex Anthropic tool calling - native params
2024-07-03 17:25:32 -07:00
Ishaan Jaff
5e5799b9b4
Merge pull request #4532 from BerriAI/litellm_control_lakera_per_call
[Feat] v2 - Control guardrails per LLM Call
2024-07-03 17:04:12 -07:00
Ishaan Jaff
97dab0449e
Merge pull request #4530 from BerriAI/doc_set_guardrails_config
Doc set guardrails on litellm config.yaml
2024-07-03 17:03:58 -07:00
Ishaan Jaff
96be4eaeec docs - guardrails 2024-07-03 17:03:44 -07:00
Ishaan Jaff
1028be6308 feat- control lakera ai per llm call 2024-07-03 16:34:23 -07:00
Krrish Dholakia
7007ace6c2 fix(vertex_anthropic.py): Updates the vertex anthropic endpoint to do tool calling with the anthropic api params 2024-07-03 15:28:31 -07:00
Ishaan Jaff
228997b074 docs - setup guardrails on config.yaml 2024-07-03 15:17:17 -07:00
Ishaan Jaff
80dd14d59e test - default on/off guardrails 2024-07-03 14:50:13 -07:00
Ishaan Jaff
b1e6cee000
Merge branch 'main' into litellm_allow_setting_guardrails_config 2024-07-03 14:21:51 -07:00
Ishaan Jaff
129c2e0c4f init guardrails on proxy 2024-07-03 14:18:12 -07:00
Ishaan Jaff
a2b6baab16 add new GuardrailItem type 2024-07-03 14:03:34 -07:00
Ishaan Jaff
50443d3d48 fix checks on litellm license 2024-07-03 14:02:07 -07:00
Krish Dholakia
944f22a089
Merge pull request #4499 from petermuller/main
Allow calling SageMaker endpoints from different regions
2024-07-03 13:09:21 -07:00
Krrish Dholakia
3d61a316cb fix(router.py): bump azure default api version
Allows 'tool_choice' to be passed to azure
2024-07-03 12:00:00 -07:00
andrewmjc
95dc480204 unit test 2024-07-03 12:23:26 -06:00
Krrish Dholakia
d18dc2648c fix(replicate.py): correctly handly invalid replicate response 2024-07-03 10:09:46 -07:00
Krrish Dholakia
c6962bda80 fix(user_api_key_auth.py): expose /health as an info route
this still requires key access. Allows users to check model health
2024-07-03 10:02:50 -07:00
Krrish Dholakia
606d04b05b fix(_service_logging.py): only trigger otel if in service_callback
Fixes https://github.com/BerriAI/litellm/issues/4511
2024-07-03 09:48:38 -07:00
Krish Dholakia
2116dbcdc1
Merge pull request #4089 from paneru-rajan/ollama-func-calls
Fix: Output Structure of Ollama chat
2024-07-03 08:57:31 -07:00
Krrish Dholakia
67433a04a2 test: fix test 2024-07-02 22:13:41 -07:00
Peter Muller
d8fc8252fa
Revert imports changes, update tests to match 2024-07-02 19:09:22 -07:00
Ishaan Jaff
3da8ce6a75 ci/cd run again 2024-07-02 18:39:53 -07:00
Krrish Dholakia
ac00639301 fix(azure.py): fix httpx call for dall e 3 2024-07-02 18:30:21 -07:00
Ishaan Jaff
540db53ccb docs switch guardrails on / off 2024-07-02 18:13:36 -07:00
Ishaan Jaff
b288835b47 doc secret detection 2024-07-02 18:10:41 -07:00
Ishaan Jaff
c30061fd09 bump: version 1.41.3 → 1.41.4 2024-07-02 18:03:04 -07:00
Ishaan Jaff
2dcf06ce7d
Merge pull request #4525 from BerriAI/litellm_control_lakera_per_llm_call
[Feat] Control Lakera AI per Request
2024-07-02 18:02:43 -07:00
Ishaan Jaff
0d852d7011
Merge pull request #4524 from BerriAI/litellm_allow_controlling_guardrails_per_key
[Enterprise] Check if Key should run secret_detection callback
2024-07-02 18:02:34 -07:00
Ishaan Jaff
62ebcc0bb5 doc controlling guardrail per api key 2024-07-02 18:01:21 -07:00
Krrish Dholakia
892ba62730 fix(router.py): fix mounting logic 2024-07-02 17:54:32 -07:00
Krish Dholakia
2d6b6662d4
Merge pull request #4502 from BerriAI/litellm_support_dynamic_rpm_limiting
feat(dynamic_rate_limiter.py): support dynamic rate limiting on rpm
2024-07-02 17:51:23 -07:00
Krish Dholakia
21d3a28e51
Merge branch 'main' into litellm_support_dynamic_rpm_limiting 2024-07-02 17:51:18 -07:00
Ishaan Jaff
23f8d23acb correct guardrail name 2024-07-02 17:50:23 -07:00
Ishaan Jaff
11d1f4e430 doc - control guradrail per api key 2024-07-02 17:50:09 -07:00
Krrish Dholakia
4b17f2dfdb test: skip bad test 2024-07-02 17:46:50 -07:00
Krrish Dholakia
0894439118 test(test_router.py): fix test 2024-07-02 17:45:33 -07:00
Ishaan Jaff
f61eb8dfa1 docs control lakera ai per request 2024-07-02 17:38:07 -07:00
Krrish Dholakia
0647278a69 refactor: remove custom transport logic
Not needed after azure dall-e-2 refactor
2024-07-02 17:35:27 -07:00
Ishaan Jaff
64e86c3305 docs control lakera ai per call 2024-07-02 17:34:48 -07:00
Ishaan Jaff
b6af67344c feat - control lakera per call 2024-07-02 17:34:05 -07:00
Krish Dholakia
d38f01e956
Merge branch 'main' into litellm_fix_httpx_transport 2024-07-02 17:17:43 -07:00
Krish Dholakia
f87535140c
Merge pull request #4523 from BerriAI/litellm_azure_img_gen_refactor
refactor(azure.py): move azure dall-e calls to httpx client
2024-07-02 17:15:41 -07:00
Krrish Dholakia
cf5334fe8a refactor(azure.py): refactor sync azure calls to httpx 2024-07-02 17:06:48 -07:00
Ishaan Jaff
9f8572e427 check if key does not want secret detection to run 2024-07-02 17:05:53 -07:00
Ishaan Jaff
174b2b69df
Merge pull request #4518 from BerriAI/litellm_fix_background_health_checks
[Fix-Proxy] Background health checks use deep copy of model list for _run_background_health_check
2024-07-02 16:42:34 -07:00
Ishaan Jaff
90a0db5618
Merge pull request #4519 from BerriAI/litellm_re_use_openai_azure_clients_whisper
[Fix+Test] /audio/transcriptions - use initialized OpenAI / Azure OpenAI clients
2024-07-02 16:42:22 -07:00