phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

Merge branch 'main' into litellm_llamaguard_custom_categories

Browse source
This commit is contained in:
Krish Dholakia 2024-02-17 21:36:40 -08:00 • committed by GitHub
commit 038ba426ab
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
57 changed files with 585 additions and 364 deletions
Download patch file Download diff file Expand all files Collapse all files

7
enterprise/README.md
View file

@ -6,9 +6,4 @@ Code in this folder is licensed under a commercial license. Please review the [L
👉 **Using in an Enterprise / Need specific features ?** Meet with us [here](https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat?month=2024-02)
## Enterprise Features:
- Track, View spend per tag https://docs.litellm.ai/docs/proxy/spend
- Custom API / microservice callbacks
- Google Text Moderation API
See all Enterprise Features here 👉 [Docs](https://docs.litellm.ai/docs/proxy/enterprise)

1
enterprise/enterprise_hooks/llama_guard.py
View file

@ -110,7 +110,6 @@ class _ENTERPRISE_LlamaGuard(CustomLogger):
-1
] # get the last response - llama guard has a 4k token limit
self.set_custom_prompt_template(messages=[safety_check_messages])
# print(f"self.model: {self.model}")
response = await litellm.acompletion(
model=self.model,
messages=[safety_check_messages],