9 commits

Author	SHA1	Message	Date
Krrish Dholakia	e391e30285	refactor: replace 'traceback.print_exc()' with logging library ... allows error logs to be in json format for otel logging	2024-06-06 13:47:43 -07:00
Krrish Dholakia	d4d4550bb6	fix(proxy_server.py): fixes for making rejected responses work with streaming	2024-05-20 12:32:19 -07:00
Krrish Dholakia	8fb8d068fb	feat(proxy_server.py): refactor returning rejected message, to work with error logging ... log the rejected request as a failed call to langfuse/slack alerting	2024-05-20 11:14:36 -07:00
Krrish Dholakia	7bc76ddbc3	feat(llm_guard.py): enable key-specific llm guard check	2024-03-26 17:21:51 -07:00
Krrish Dholakia	b872644496	fix(prompt_injection_detection.py): fix type check	2024-03-21 08:56:13 -07:00
Krrish Dholakia	5cfabe9a09	fix: fix linting issue	2024-03-21 08:19:09 -07:00
Krrish Dholakia	e9cc6b4cc9	feat(proxy_server.py): enable llm api based prompt injection checks ... run user calls through an llm api to check for prompt injection attacks. This happens in parallel to th e actual llm call using `async_moderation_hook`	2024-03-20 22:43:42 -07:00
Krrish Dholakia	feb78b7819	fix(proxy_server.py): fix import	2024-03-20 19:15:06 -07:00
Krrish Dholakia	e9ff51aa70	fix(prompt_injection_detection.py): ensure combinations are actual phrases, not just 1-2 words ... reduces misflagging https://github.com/BerriAI/litellm/issues/2601	2024-03-20 19:09:38 -07:00

Renamed from enterprise/enterprise_hooks/prompt_injection_detection.py (Browse further)