diff --git a/docs/my-website/docs/enterprise.md b/docs/my-website/docs/enterprise.md index 875aec57f..cfab07c22 100644 --- a/docs/my-website/docs/enterprise.md +++ b/docs/my-website/docs/enterprise.md @@ -2,26 +2,36 @@ For companies that need SSO, user management and professional support for LiteLLM Proxy :::info - +Interested in Enterprise? Schedule a meeting with us here 👉 [Talk to founders](https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat) ::: This covers: -- ✅ **Features under the [LiteLLM Commercial License (Content Mod, Custom Tags, etc.)](https://docs.litellm.ai/docs/proxy/enterprise)** -- ✅ [**Secure UI access with Single Sign-On**](../docs/proxy/ui.md#setup-ssoauth-for-ui) -- ✅ [**Audit Logs with retention policy**](../docs/proxy/enterprise.md#audit-logs) -- ✅ [**JWT-Auth**](../docs/proxy/token_auth.md) -- ✅ [**Control available public, private routes**](../docs/proxy/enterprise.md#control-available-public-private-routes) -- ✅ [**Guardrails, Content Moderation, PII Masking, Secret/API Key Masking**](../docs/proxy/enterprise.md#prompt-injection-detection---lakeraai) -- ✅ [**Prompt Injection Detection**](../docs/proxy/enterprise.md#prompt-injection-detection---lakeraai) -- ✅ [**Invite Team Members to access `/spend` Routes**](../docs/proxy/cost_tracking#allowing-non-proxy-admins-to-access-spend-endpoints) +- **Enterprise Features** + - **Security** + - ✅ [SSO for Admin UI](./ui.md#✨-enterprise-features) + - ✅ [Audit Logs with retention policy](#audit-logs) + - ✅ [JWT-Auth](../docs/proxy/token_auth.md) + - ✅ [Control available public, private routes](#control-available-public-private-routes) + - ✅ [[BETA] AWS Key Manager v2 - Key Decryption](#beta-aws-key-manager---key-decryption) + - ✅ [Use LiteLLM keys/authentication on Pass Through Endpoints](pass_through#✨-enterprise---use-litellm-keysauthentication-on-pass-through-endpoints) + - ✅ [Enforce Required Params for LLM Requests (ex. Reject requests missing ["metadata"]["generation_name"])](#enforce-required-params-for-llm-requests) + - **Spend Tracking** + - ✅ [Tracking Spend for Custom Tags](#tracking-spend-for-custom-tags) + - **Guardrails, PII Masking, Content Moderation** + - ✅ [Content Moderation with LLM Guard, LlamaGuard, Secret Detection, Google Text Moderations](#content-moderation) + - ✅ [Prompt Injection Detection (with LakeraAI API)](#prompt-injection-detection---lakeraai) + - ✅ Reject calls from Blocked User list + - ✅ Reject calls (incoming / outgoing) with Banned Keywords (e.g. competitors) + - **Custom Branding** + - ✅ [Custom Branding + Routes on Swagger Docs](#swagger-docs---custom-routes--branding) + - ✅ [Public Model Hub](../docs/proxy/enterprise.md#public-model-hub) + - ✅ [Custom Email Branding](../docs/proxy/email.md#customizing-email-branding) - ✅ **Feature Prioritization** - ✅ **Custom Integrations** - ✅ **Professional Support - Dedicated discord + slack** -- ✅ [**Custom Swagger**](../docs/proxy/enterprise.md#swagger-docs---custom-routes--branding) -- ✅ [**Public Model Hub**](../docs/proxy/enterprise.md#public-model-hub) -- ✅ [**Custom Email Branding**](../docs/proxy/email.md#customizing-email-branding) + diff --git a/docs/my-website/docs/proxy/enterprise.md b/docs/my-website/docs/proxy/enterprise.md index e4329f882..d580f58b6 100644 --- a/docs/my-website/docs/proxy/enterprise.md +++ b/docs/my-website/docs/proxy/enterprise.md @@ -11,17 +11,26 @@ To get a license, get in touch with us [here](https://calendly.com/d/4mp-gd3-k5k ::: Features: -- ✅ [SSO for Admin UI](./ui.md#✨-enterprise-features) -- ✅ [Audit Logs](#audit-logs) -- ✅ [Tracking Spend for Custom Tags](#tracking-spend-for-custom-tags) -- ✅ [Control available public, private routes](#control-available-public-private-routes) -- ✅ [Content Moderation with LLM Guard, LlamaGuard, Secret Detection, Google Text Moderations](#content-moderation) -- ✅ [Prompt Injection Detection (with LakeraAI API)](#prompt-injection-detection---lakeraai) -- ✅ [Custom Branding + Routes on Swagger Docs](#swagger-docs---custom-routes--branding) -- ✅ [Enforce Required Params for LLM Requests (ex. Reject requests missing ["metadata"]["generation_name"])](#enforce-required-params-for-llm-requests) -- ✅ Reject calls from Blocked User list -- ✅ Reject calls (incoming / outgoing) with Banned Keywords (e.g. competitors) -- [[BETA] AWS Key Manager v2 - Key Decryption](#beta-aws-key-manager---key-decryption) + +- **Security** + - ✅ [SSO for Admin UI](./ui.md#✨-enterprise-features) + - ✅ [Audit Logs with retention policy](#audit-logs) + - ✅ [JWT-Auth](../docs/proxy/token_auth.md) + - ✅ [Control available public, private routes](#control-available-public-private-routes) + - ✅ [[BETA] AWS Key Manager v2 - Key Decryption](#beta-aws-key-manager---key-decryption) + - ✅ [Use LiteLLM keys/authentication on Pass Through Endpoints](pass_through#✨-enterprise---use-litellm-keysauthentication-on-pass-through-endpoints) + - ✅ [Enforce Required Params for LLM Requests (ex. Reject requests missing ["metadata"]["generation_name"])](#enforce-required-params-for-llm-requests) +- **Spend Tracking** + - ✅ [Tracking Spend for Custom Tags](#tracking-spend-for-custom-tags) +- **Guardrails, PII Masking, Content Moderation** + - ✅ [Content Moderation with LLM Guard, LlamaGuard, Secret Detection, Google Text Moderations](#content-moderation) + - ✅ [Prompt Injection Detection (with LakeraAI API)](#prompt-injection-detection---lakeraai) + - ✅ Reject calls from Blocked User list + - ✅ Reject calls (incoming / outgoing) with Banned Keywords (e.g. competitors) +- **Custom Branding** + - ✅ [Custom Branding + Routes on Swagger Docs](#swagger-docs---custom-routes--branding) + - ✅ [Public Model Hub](../docs/proxy/enterprise.md#public-model-hub) + - ✅ [Custom Email Branding](../docs/proxy/email.md#customizing-email-branding) ## Audit Logs diff --git a/litellm/proxy/proxy_config.yaml b/litellm/proxy/proxy_config.yaml index 40e0386f4..88b778a6d 100644 --- a/litellm/proxy/proxy_config.yaml +++ b/litellm/proxy/proxy_config.yaml @@ -23,12 +23,14 @@ general_settings: pass_through_endpoints: - path: "/v1/rerank" target: "https://api.cohere.com/v1/rerank" + auth: true # 👈 Key change to use LiteLLM Auth / Keys headers: Authorization: "bearer os.environ/COHERE_API_KEY" content-type: application/json accept: application/json - path: "/api/public/ingestion" target: "https://us.cloud.langfuse.com/api/public/ingestion" + auth: true headers: LANGFUSE_PUBLIC_KEY: "os.environ/LANGFUSE_DEV_PUBLIC_KEY" LANGFUSE_SECRET_KEY: "os.environ/LANGFUSE_DEV_SK_KEY"