Commit graph

10648 commits

Author SHA1 Message Date
Krish Dholakia
3971880af4 Merge branch 'main' into litellm_disable_storing_master_key_hash_in_db 2024-08-21 15:37:25 -07:00
Krrish Dholakia
664c40a4c7 fix(vertex_httpx.py): fix json schema call to pass in response_mime_type=="application/json" 2024-08-21 15:24:04 -07:00
Krish Dholakia
a583b95d85 Merge pull request #5308 from BerriAI/litellm_team_admin_permissions
feat(user_api_key_auth.py): allow team admin to add new members to team
2024-08-21 14:21:22 -07:00
Krrish Dholakia
ac5c6c8751 fix(litellm_pre_call_utils.py): handle dynamic keys via api correctly 2024-08-21 13:37:21 -07:00
Ishaan Jaff
b522ade709 docs semantic caching qdrant 2024-08-21 13:03:41 -07:00
Ishaan Jaff
b196f41d64 fix qdrant litellm on proxy 2024-08-21 12:52:29 -07:00
Krrish Dholakia
35a9f328c7 fix(internal_user_endpoints.py): pass in user api key dict value 2024-08-21 12:46:43 -07:00
Ishaan Jaff
8c83fb3f34 fixes for using qdrant with litellm proxy 2024-08-21 12:36:41 -07:00
Krrish Dholakia
9f83724697 feat(proxy_server.py): support disabling storing master key hash in db, for spend tracking 2024-08-21 12:35:37 -07:00
Ishaan Jaff
a39eff07df fix tg ai -deprecated model 2024-08-21 12:14:39 -07:00
Ishaan Jaff
0d812b0d81 fix qdrant semantic caching test 2024-08-21 12:11:49 -07:00
Ishaan Jaff
0f3274b074 fix drant url 2024-08-21 12:09:09 -07:00
Krrish Dholakia
07bd92b527 fix(vertex_httpx.py): Fix tool calling with empty param list
Fixes https://github.com/BerriAI/litellm/issues/5055
2024-08-21 09:03:34 -07:00
Ishaan Jaff
a34aeafdb5 Merge pull request #5018 from haadirakhangi/main
Qdrant Semantic Caching
2024-08-21 08:50:43 -07:00
Krrish Dholakia
a06d9d44a9 fix(utils.py): support openrouter streaming
Fixes https://github.com/BerriAI/litellm/issues/5080
2024-08-21 08:48:58 -07:00
Krrish Dholakia
748943f910 test(test_proxy_server.py): fix test to specify user role 2024-08-21 08:37:04 -07:00
Ishaan Jaff
9fc7d93049 fix groq/3.1 reasoning model 2024-08-21 08:22:26 -07:00
Krrish Dholakia
7eb474b87c feat(litellm_pre_call_utils.py): support passing tags/spend logs metadata from keys/team metadata to request 2024-08-21 08:13:36 -07:00
Krrish Dholakia
468768f19d test(test_completion.py): fix gemini rate limit error 2024-08-21 07:17:27 -07:00
Krrish Dholakia
8487f1cbe4 test(test_completion.py): fix test 2024-08-21 07:01:02 -07:00
Krrish Dholakia
77a6f597e0 fix(litellm_logging.py): add stricter check for special param being non none 2024-08-20 21:35:02 -07:00
Krrish Dholakia
0091f64ff1 fix(utils.py): ensure consistent cost calc b/w returned header and logged object 2024-08-20 19:01:20 -07:00
Ishaan Jaff
83fe4909f2 enforece guardrails per API Key as enterprise 2024-08-20 17:34:28 -07:00
Ishaan Jaff
5ad7da95b6 Merge pull request #5309 from BerriAI/litellm_new_guardrails_doc
[Docs]  - v2 Guardrails are now Free / Open Source
2024-08-20 17:29:28 -07:00
Ishaan Jaff
e8a803969a fix lakera ai tests 2024-08-20 17:28:18 -07:00
Ishaan Jaff
2f0bd38f3a support lakera ai category thresholds 2024-08-20 17:19:24 -07:00
Krrish Dholakia
e32a68c94b refactor(team_endpoints.py): refactor auth checks for team member endpoints to ui team admin to manage it 2024-08-20 16:57:18 -07:00
Ishaan Jaff
54cf835a51 docs move lakera to free 2024-08-20 16:38:37 -07:00
Ishaan Jaff
4a21434fc5 Merge pull request #5303 from BerriAI/litellm_make_lakera_free
[Feat-Proxy] Make Guardrails Free / OSS - Lakera AI, Aporia AI 🛡️
2024-08-20 16:33:50 -07:00
Krrish Dholakia
c305eb3321 feat(_types.py): allow team admin to delete member from team 2024-08-20 16:25:13 -07:00
Krrish Dholakia
0af1d602ca fix(litellm_pre_call_utils.py): only pass api_version if set 2024-08-20 16:00:46 -07:00
Ishaan Jaff
9e5751e18a Merge pull request #5302 from BerriAI/litellm_dont_cooldown_provider_deployments
[Fix Router] - Don't cooldown Default Provider deployment
2024-08-20 15:31:55 -07:00
Ishaan Jaff
cdbd245c3d working lakera ai during call hook 2024-08-20 14:39:04 -07:00
Ishaan Jaff
9d809e8404 fix make lakera ai free guardrail 2024-08-20 14:03:22 -07:00
Krrish Dholakia
64affd0d6b feat(user_api_key_auth.py): allow team admin to add new members to team 2024-08-20 14:01:12 -07:00
Ishaan Jaff
4665487558 rename lakera ai 2024-08-20 13:44:39 -07:00
Ishaan Jaff
7bffe2a0fa rename Aporia Guardrail 2024-08-20 13:42:55 -07:00
Ishaan Jaff
528bb3f7ac test test_using_default_working_fallback 2024-08-20 13:32:55 -07:00
Ishaan Jaff
581de720f9 fix router retries tests 2024-08-20 13:02:24 -07:00
Ishaan Jaff
a3ccba6d6b test router fallbacks test 2024-08-20 13:00:00 -07:00
Ishaan Jaff
0847ebc82d run test on sync function too 2024-08-20 12:57:22 -07:00
Ishaan Jaff
165e0e3ad1 fix run sync fallbacks 2024-08-20 12:55:36 -07:00
Ishaan Jaff
078fe97053 fix fallbacks dont recurse on the same fallback 2024-08-20 12:50:20 -07:00
Krrish Dholakia
5c1a5978f9 fix(azure.py): fix optional param elif statement 2024-08-20 12:24:51 -07:00
Ishaan Jaff
fb16ff2335 fix don't retry errors when no healthy deployments available 2024-08-20 12:17:05 -07:00
Ishaan Jaff
5e2f962ba3 test + never retry on 404 errors 2024-08-20 11:59:43 -07:00
Krish Dholakia
b1e9017841 Merge pull request #5284 from BerriAI/litellm_fix_azure_api_version
feat(azure.py): support dynamic azure api versions
2024-08-20 11:46:55 -07:00
Krish Dholakia
e49e454929 Merge pull request #5287 from BerriAI/litellm_fix_response_cost_cal
fix(cost_calculator.py): only override base model if custom pricing is set
2024-08-20 11:42:48 -07:00
Krish Dholakia
969b724615 Merge pull request #5296 from BerriAI/litellm_azure_json_schema_support
feat(azure.py): support 'json_schema' for older models
2024-08-20 11:41:38 -07:00
Krish Dholakia
85c5d4f8c2 Merge branch 'main' into litellm_fix_azure_api_version 2024-08-20 11:40:53 -07:00