Commit graph

14195 commits

Author SHA1 Message Date
Ishaan Jaff
fdcdee8775 fix invite id flow 2024-07-04 15:40:49 -07:00
Ishaan Jaff
c3bbc4a692 fix invite link flow 2024-07-04 15:40:19 -07:00
Ishaan Jaff
fe15df26f2 fix invite link flow 2024-07-04 15:40:08 -07:00
Ishaan Jaff
a457aec761 add doc string for v1/model/info 2024-07-04 13:21:02 -07:00
Ishaan Jaff
12343650e4 feat - allow looking up model_id in model info 2024-07-04 13:13:42 -07:00
Krrish Dholakia
d4577fe476 fix(factory.py): fix linting 2024-07-04 08:21:19 -07:00
Krish Dholakia
3184640291
Merge pull request #4522 from andrewmjc/matchingToolMessageSpec
[Bug Fix] Use OpenAI Tool Response Spec When Converting To Gemini/VertexAI Tool Response
2024-07-04 08:03:38 -07:00
Krrish Dholakia
6650104443 bump: version 1.41.5 → 1.41.6 2024-07-03 22:24:16 -07:00
Krrish Dholakia
d66d35349f test(test_prompt_factory.py): fix test 2024-07-03 22:16:03 -07:00
Krrish Dholakia
a3e9bc4ae2 fix(aws_secret_manager.py): fix litellm license check 2024-07-03 22:07:48 -07:00
Krrish Dholakia
19c982d0f9 fix: linting fixes 2024-07-03 21:55:00 -07:00
Krish Dholakia
17869fc5e9
Merge pull request #4536 from BerriAI/litellm_anthropic_tool_calling_streaming_fix
*real* Anthropic tool calling + streaming support
2024-07-03 20:43:56 -07:00
Krish Dholakia
5e47970eed
Merge branch 'main' into litellm_anthropic_tool_calling_streaming_fix 2024-07-03 20:43:51 -07:00
Krrish Dholakia
2e5a81f280 fix(utils.py): stream_options working across all providers 2024-07-03 20:40:46 -07:00
Krrish Dholakia
8dbe0559dd fix(utils.py): stream_options fix 2024-07-03 19:57:34 -07:00
Krrish Dholakia
344268e053 fix(anthropic.py): support *real* anthropic tool calling + streaming
Parses each chunk and translates to openai format
2024-07-03 19:48:35 -07:00
Ishaan Jaff
e7122772d1 bump: version 1.41.4 → 1.41.5 2024-07-03 18:59:53 -07:00
Ishaan Jaff
046b9d8f66 fix lakera ai testing 2024-07-03 18:58:36 -07:00
Krish Dholakia
1078c0f77a
Merge pull request #4533 from UsableMachines/nick/fix-granite-prompt-template
Fix Granite Prompt template
2024-07-03 18:45:25 -07:00
Krrish Dholakia
ed5fc3d1f9 fix(utils.py): fix vertex anthropic streaming 2024-07-03 18:43:46 -07:00
Krish Dholakia
f4c3492f64
Merge pull request #4534 from BerriAI/revert-4531-litellm_vertex_anthropic_tools
Revert "fix(vertex_anthropic.py): Vertex Anthropic tool calling - native params "
2024-07-03 17:55:45 -07:00
Krish Dholakia
6c5c8bbb28
Revert "fix(vertex_anthropic.py): Vertex Anthropic tool calling - native params " 2024-07-03 17:55:37 -07:00
nick-rackauckas
ce595027ad Fix LiteLlm Granite Prompt template 2024-07-03 17:52:28 -07:00
Krish Dholakia
318077edea
Merge pull request #4531 from BerriAI/litellm_vertex_anthropic_tools
fix(vertex_anthropic.py): Vertex Anthropic tool calling - native params
2024-07-03 17:25:32 -07:00
Ishaan Jaff
5e5799b9b4
Merge pull request #4532 from BerriAI/litellm_control_lakera_per_call
[Feat] v2 - Control guardrails per LLM Call
2024-07-03 17:04:12 -07:00
Ishaan Jaff
97dab0449e
Merge pull request #4530 from BerriAI/doc_set_guardrails_config
Doc set guardrails on litellm config.yaml
2024-07-03 17:03:58 -07:00
Ishaan Jaff
96be4eaeec docs - guardrails 2024-07-03 17:03:44 -07:00
Ishaan Jaff
1028be6308 feat- control lakera ai per llm call 2024-07-03 16:34:23 -07:00
Krrish Dholakia
7007ace6c2 fix(vertex_anthropic.py): Updates the vertex anthropic endpoint to do tool calling with the anthropic api params 2024-07-03 15:28:31 -07:00
Ishaan Jaff
228997b074 docs - setup guardrails on config.yaml 2024-07-03 15:17:17 -07:00
Ishaan Jaff
80dd14d59e test - default on/off guardrails 2024-07-03 14:50:13 -07:00
Ishaan Jaff
b1e6cee000
Merge branch 'main' into litellm_allow_setting_guardrails_config 2024-07-03 14:21:51 -07:00
Ishaan Jaff
129c2e0c4f init guardrails on proxy 2024-07-03 14:18:12 -07:00
Ishaan Jaff
a2b6baab16 add new GuardrailItem type 2024-07-03 14:03:34 -07:00
Ishaan Jaff
50443d3d48 fix checks on litellm license 2024-07-03 14:02:07 -07:00
Krish Dholakia
944f22a089
Merge pull request #4499 from petermuller/main
Allow calling SageMaker endpoints from different regions
2024-07-03 13:09:21 -07:00
Krrish Dholakia
3d61a316cb fix(router.py): bump azure default api version
Allows 'tool_choice' to be passed to azure
2024-07-03 12:00:00 -07:00
andrewmjc
95dc480204 unit test 2024-07-03 12:23:26 -06:00
Krrish Dholakia
d18dc2648c fix(replicate.py): correctly handly invalid replicate response 2024-07-03 10:09:46 -07:00
Krrish Dholakia
c6962bda80 fix(user_api_key_auth.py): expose /health as an info route
this still requires key access. Allows users to check model health
2024-07-03 10:02:50 -07:00
Krrish Dholakia
606d04b05b fix(_service_logging.py): only trigger otel if in service_callback
Fixes https://github.com/BerriAI/litellm/issues/4511
2024-07-03 09:48:38 -07:00
Krish Dholakia
2116dbcdc1
Merge pull request #4089 from paneru-rajan/ollama-func-calls
Fix: Output Structure of Ollama chat
2024-07-03 08:57:31 -07:00
Krrish Dholakia
67433a04a2 test: fix test 2024-07-02 22:13:41 -07:00
Peter Muller
d8fc8252fa
Revert imports changes, update tests to match 2024-07-02 19:09:22 -07:00
Ishaan Jaff
3da8ce6a75 ci/cd run again 2024-07-02 18:39:53 -07:00
Krrish Dholakia
ac00639301 fix(azure.py): fix httpx call for dall e 3 2024-07-02 18:30:21 -07:00
Ishaan Jaff
540db53ccb docs switch guardrails on / off 2024-07-02 18:13:36 -07:00
Ishaan Jaff
b288835b47 doc secret detection 2024-07-02 18:10:41 -07:00
Ishaan Jaff
c30061fd09 bump: version 1.41.3 → 1.41.4 2024-07-02 18:03:04 -07:00
Ishaan Jaff
2dcf06ce7d
Merge pull request #4525 from BerriAI/litellm_control_lakera_per_llm_call
[Feat] Control Lakera AI per Request
2024-07-02 18:02:43 -07:00