Commit graph

3565 commits

Author SHA1 Message Date
Ishaan Jaff
7d55047ab9 add bedrock guardrails support 2024-08-22 16:09:55 -07:00
Krrish Dholakia
63cd94c32a fix: fix linting errors 2024-08-22 15:51:59 -07:00
Krrish Dholakia
8625663458 feat(proxy_server.py): support azure batch api endpoints 2024-08-22 15:21:43 -07:00
Ishaan Jaff
06a362d35f track litellm_request_latency_metric 2024-08-22 13:58:10 -07:00
Ishaan Jaff
08fa3f346a add new litellm params for client_id, tenant_id etc 2024-08-22 11:37:30 -07:00
Krish Dholakia
68cb5cae58
Merge branch 'main' into litellm_redis_cluster 2024-08-22 11:06:14 -07:00
Ishaan Jaff
8f657b40f5 use azure_ad_token_provider to init clients 2024-08-22 11:03:49 -07:00
Ishaan Jaff
a120135dd1 fix allow setting LiteLLM license as .env 2024-08-22 10:05:00 -07:00
Ishaan Jaff
cc8e6f1d44 fix allow setting license in config.yaml 2024-08-22 09:45:15 -07:00
Ishaan Jaff
2be984ebee add docstring for /embeddings and /completions 2024-08-22 09:30:47 -07:00
Ishaan Jaff
f6e80b0031 add doc string for /chat/completions swagger 2024-08-22 09:27:40 -07:00
Ishaan Jaff
374bef4326 fix /user/delete doc string 2024-08-22 09:09:51 -07:00
Ishaan Jaff
03c65c889a fix team_member_add 2024-08-21 19:10:37 -07:00
Ishaan Jaff
f0f1d50734 fix test_master_key_hashing 2024-08-21 17:56:09 -07:00
Ishaan Jaff
0ea1f367d7 use litellm proxy with vertex ai sdk 2024-08-21 17:47:01 -07:00
Ishaan Jaff
a174cbdd72
Merge branch 'main' into litellm_pass_through_vtx_multi_modal 2024-08-21 17:23:22 -07:00
Ishaan Jaff
bcc0f99476 fix pass through endpoints 2024-08-21 17:21:22 -07:00
Ishaan Jaff
0e1d3804ff refactor vertex endpoints to pass through all routes 2024-08-21 17:08:42 -07:00
Ishaan Jaff
f947cec7fc add test vtx embedding 2024-08-21 17:05:47 -07:00
Ishaan Jaff
e9537c6560 proxy - print embedding request when recieved 2024-08-21 17:00:18 -07:00
Krrish Dholakia
8a05ce77e9 feat(litellm_logging.py): add 'saved_cache_cost' to standard logging payload (s3) 2024-08-21 16:58:07 -07:00
Krrish Dholakia
0a42347a8d docs(users.md): add doc on setting max budget for internal users 2024-08-21 16:21:40 -07:00
Krish Dholakia
72169fd5c4
Merge branch 'main' into litellm_disable_storing_master_key_hash_in_db 2024-08-21 15:37:25 -07:00
Krrish Dholakia
e2d7539690 feat(caching.py): redis cluster support
Closes https://github.com/BerriAI/litellm/issues/4358
2024-08-21 15:01:52 -07:00
Krish Dholakia
509ae0ca71
Merge pull request #5308 from BerriAI/litellm_team_admin_permissions
feat(user_api_key_auth.py): allow team admin to add new members to team
2024-08-21 14:21:22 -07:00
Krrish Dholakia
7aec6f0f2a fix(litellm_pre_call_utils.py): handle dynamic keys via api correctly 2024-08-21 13:37:21 -07:00
Ishaan Jaff
d6493b0e7f docs semantic caching qdrant 2024-08-21 13:03:41 -07:00
Krrish Dholakia
83bed56b66 fix(internal_user_endpoints.py): pass in user api key dict value 2024-08-21 12:46:43 -07:00
Ishaan Jaff
c6dfd2d276 fixes for using qdrant with litellm proxy 2024-08-21 12:36:41 -07:00
Krrish Dholakia
89014dfc07 feat(proxy_server.py): support disabling storing master key hash in db, for spend tracking 2024-08-21 12:35:37 -07:00
Krrish Dholakia
5ba517819c test(test_proxy_server.py): fix test to specify user role 2024-08-21 08:37:04 -07:00
Krrish Dholakia
04fc0bd7b3 feat(litellm_pre_call_utils.py): support passing tags/spend logs metadata from keys/team metadata to request 2024-08-21 08:13:36 -07:00
Ishaan Jaff
cea7b73015 enforece guardrails per API Key as enterprise 2024-08-20 17:34:28 -07:00
Ishaan Jaff
225e75cafb
Merge pull request #5309 from BerriAI/litellm_new_guardrails_doc
[Docs]  - v2 Guardrails are now Free / Open Source
2024-08-20 17:29:28 -07:00
Ishaan Jaff
5bd94f64da fix lakera ai tests 2024-08-20 17:28:18 -07:00
Ishaan Jaff
8d2c529e55 support lakera ai category thresholds 2024-08-20 17:19:24 -07:00
Krrish Dholakia
a61f3e7656 refactor(team_endpoints.py): refactor auth checks for team member endpoints to ui team admin to manage it 2024-08-20 16:57:18 -07:00
Ishaan Jaff
30da63bd4f docs move lakera to free 2024-08-20 16:38:37 -07:00
Ishaan Jaff
befe041f00
Merge pull request #5303 from BerriAI/litellm_make_lakera_free
[Feat-Proxy] Make Guardrails Free / OSS - Lakera AI, Aporia AI 🛡️
2024-08-20 16:33:50 -07:00
Krrish Dholakia
19083a4d31 feat(_types.py): allow team admin to delete member from team 2024-08-20 16:25:13 -07:00
Krrish Dholakia
5f565806bd fix(litellm_pre_call_utils.py): only pass api_version if set 2024-08-20 16:00:46 -07:00
Ishaan Jaff
1fdebfb0b7 working lakera ai during call hook 2024-08-20 14:39:04 -07:00
Ishaan Jaff
1a142053e5 fix make lakera ai free guardrail 2024-08-20 14:03:22 -07:00
Krrish Dholakia
fa6c9bf42e feat(user_api_key_auth.py): allow team admin to add new members to team 2024-08-20 14:01:12 -07:00
Ishaan Jaff
cad0352f76 rename lakera ai 2024-08-20 13:44:39 -07:00
Ishaan Jaff
042350bd74 rename Aporia Guardrail 2024-08-20 13:42:55 -07:00
Krish Dholakia
409306b266
Merge branch 'main' into litellm_fix_azure_api_version 2024-08-20 11:40:53 -07:00
Krrish Dholakia
33deeda300 feat(ollama.py): support ollama /api/embed endpoint
Closes https://github.com/BerriAI/litellm/issues/5291
2024-08-20 09:10:08 -07:00
Krrish Dholakia
6f8840daa1 fix(proxy_server.py): fix invalid login message to not show passed in pwd
Closes https://github.com/BerriAI/litellm/issues/5290
2024-08-20 08:56:57 -07:00
Ishaan Jaff
9ef6ae2f7c
Merge pull request #4868 from msabramo/allow-not-displaying-feedback-box
Allow not displaying feedback box
2024-08-20 08:53:45 -07:00