Commit graph

3383 commits

Author SHA1 Message Date
Ishaan Jaff
d6493b0e7f docs semantic caching qdrant 2024-08-21 13:03:41 -07:00
Ishaan Jaff
c6dfd2d276 fixes for using qdrant with litellm proxy 2024-08-21 12:36:41 -07:00
Krrish Dholakia
04fc0bd7b3 feat(litellm_pre_call_utils.py): support passing tags/spend logs metadata from keys/team metadata to request 2024-08-21 08:13:36 -07:00
Ishaan Jaff
cea7b73015 enforece guardrails per API Key as enterprise 2024-08-20 17:34:28 -07:00
Ishaan Jaff
225e75cafb
Merge pull request #5309 from BerriAI/litellm_new_guardrails_doc
[Docs]  - v2 Guardrails are now Free / Open Source
2024-08-20 17:29:28 -07:00
Ishaan Jaff
5bd94f64da fix lakera ai tests 2024-08-20 17:28:18 -07:00
Ishaan Jaff
8d2c529e55 support lakera ai category thresholds 2024-08-20 17:19:24 -07:00
Ishaan Jaff
30da63bd4f docs move lakera to free 2024-08-20 16:38:37 -07:00
Ishaan Jaff
befe041f00
Merge pull request #5303 from BerriAI/litellm_make_lakera_free
[Feat-Proxy] Make Guardrails Free / OSS - Lakera AI, Aporia AI 🛡️
2024-08-20 16:33:50 -07:00
Krrish Dholakia
5f565806bd fix(litellm_pre_call_utils.py): only pass api_version if set 2024-08-20 16:00:46 -07:00
Ishaan Jaff
1fdebfb0b7 working lakera ai during call hook 2024-08-20 14:39:04 -07:00
Ishaan Jaff
1a142053e5 fix make lakera ai free guardrail 2024-08-20 14:03:22 -07:00
Ishaan Jaff
cad0352f76 rename lakera ai 2024-08-20 13:44:39 -07:00
Ishaan Jaff
042350bd74 rename Aporia Guardrail 2024-08-20 13:42:55 -07:00
Krish Dholakia
409306b266
Merge branch 'main' into litellm_fix_azure_api_version 2024-08-20 11:40:53 -07:00
Krrish Dholakia
33deeda300 feat(ollama.py): support ollama /api/embed endpoint
Closes https://github.com/BerriAI/litellm/issues/5291
2024-08-20 09:10:08 -07:00
Krrish Dholakia
6f8840daa1 fix(proxy_server.py): fix invalid login message to not show passed in pwd
Closes https://github.com/BerriAI/litellm/issues/5290
2024-08-20 08:56:57 -07:00
Ishaan Jaff
9ef6ae2f7c
Merge pull request #4868 from msabramo/allow-not-displaying-feedback-box
Allow not displaying feedback box
2024-08-20 08:53:45 -07:00
Ishaan Jaff
aceab2669f test guardrails with API Key 2024-08-20 08:40:00 -07:00
Ishaan Jaff
30e985d79c feat control guardrails per API Key 2024-08-20 08:16:28 -07:00
Krrish Dholakia
e747127e3b fix(pass_through_endpoints.py): fix query param pass through 2024-08-19 21:38:30 -07:00
Krrish Dholakia
a85a932e25 fix(litellm_pre_call_utils.py): handle no query params in request 2024-08-19 21:09:03 -07:00
Ishaan Jaff
cae51fc7fc fix _get_request_ip_address 2024-08-19 21:08:27 -07:00
Ishaan Jaff
1170b3a510 fix import error guardrails 2024-08-19 21:03:37 -07:00
Ishaan Jaff
3c1360f328 fix importing _ENTERPRISE_Aporia 2024-08-19 21:03:37 -07:00
Ishaan Jaff
9f927e0e4e add testing for aporia guardrails 2024-08-19 21:03:37 -07:00
Ishaan Jaff
c9d9c6444e fix aporia typo 2024-08-19 21:03:37 -07:00
Ishaan Jaff
eb9da06033 feat - guardrails v2 2024-08-19 21:03:37 -07:00
Ishaan Jaff
49a27320dc doc aporia_w_litellm 2024-08-19 21:03:37 -07:00
Ishaan Jaff
507fab06f8 run during_call_hook 2024-08-19 21:03:37 -07:00
Ishaan Jaff
b0f546d551 feat - return applied guardrails in response headers 2024-08-19 21:03:37 -07:00
Ishaan Jaff
edf0507399 feat - allow accessing data post success call 2024-08-19 21:03:37 -07:00
Ishaan Jaff
1998809f18 feat run aporia as post call success hook 2024-08-19 21:03:37 -07:00
Krrish Dholakia
2aba1f17cc feat(langfuse_endpoints.py): support team based logging for langfuse pass-through endpoints 2024-08-19 21:03:37 -07:00
Krrish Dholakia
c1a3d86fe4 feat(langfuse_endpoints.py): support langfuse pass through endpoints by default 2024-08-19 21:03:37 -07:00
Krrish Dholakia
5bde7b0c70 fix(proxy_cli.py): support database_host, database_username, database_password, database_name 2024-08-19 21:03:37 -07:00
Ishaan Jaff
b919a1a42e fix import error guardrails 2024-08-19 20:59:39 -07:00
Ishaan Jaff
c7b3978655
Merge pull request #5288 from BerriAI/litellm_aporia_refactor
[Feat] V2 aporia guardrails litellm
2024-08-19 20:41:45 -07:00
Ishaan Jaff
6f12f6dcf8 fix importing _ENTERPRISE_Aporia 2024-08-19 20:39:24 -07:00
Ishaan Jaff
0431600f7b add testing for aporia guardrails 2024-08-19 18:50:14 -07:00
Ishaan Jaff
ca9c81470b fix aporia typo 2024-08-19 18:34:45 -07:00
Ishaan Jaff
8cd1963c11 feat - guardrails v2 2024-08-19 18:24:20 -07:00
Krrish Dholakia
f9640d8a58 feat(langfuse_endpoints.py): support team based logging for langfuse pass-through endpoints 2024-08-19 17:58:39 -07:00
Krrish Dholakia
1701c48ad5 feat(langfuse_endpoints.py): support langfuse pass through endpoints by default 2024-08-19 17:28:34 -07:00
Krrish Dholakia
8ce8680a9a fix(proxy_cli.py): support database_host, database_username, database_password, database_name 2024-08-19 16:17:45 -07:00
Ishaan Jaff
b7d4031f89 doc aporia_w_litellm 2024-08-19 14:36:55 -07:00
Krrish Dholakia
49416e121c feat(azure.py): support dynamic api versions
Closes https://github.com/BerriAI/litellm/issues/5228
2024-08-19 12:17:43 -07:00
Ishaan Jaff
a0361b0e76 run during_call_hook 2024-08-19 12:07:46 -07:00
Ishaan Jaff
613bd1babd feat - return applied guardrails in response headers 2024-08-19 11:56:20 -07:00
Ishaan Jaff
4685b9909a feat - allow accessing data post success call 2024-08-19 11:35:33 -07:00