litellm/docs/my-website/docs/hosted.md

import Image from '@theme/IdealImage';

Hosted LiteLLM Proxy

LiteLLM maintains the proxy, so you can focus on your core products.

Get Onboarded

This is in alpha. Schedule a call with us, and we'll give you a hosted proxy within 30 minutes.

🚨 Schedule Call

Status: Alpha

Our proxy is already used in production by customers.

See our status page for live reliability

Benefits

• No Maintenance, No Infra: We'll maintain the proxy, and spin up any additional infrastructure (e.g.: separate server for spend logs) to make sure you can load balance + track spend across multiple LLM projects.
• Reliable: Our hosted proxy is tested on 1k requests per second, making it reliable for high load.
• Secure: LiteLLM is currently undergoing SOC-2 compliance, to make sure your data is as secure as possible.

Pricing

Pricing is based on usage. We can figure out a price that works for your team, on the call.

🚨 Schedule Call

Screenshots

1. Create keys

<Image img={require('../img/litellm_hosted_ui_create_key.png')} />

2. Add Models

<Image img={require('../img/litellm_hosted_ui_add_models.png')}/>

3. Track spend

<Image img={require('../img/litellm_hosted_usage_dashboard.png')} />

4. Configure load balancing

<Image img={require('../img/litellm_hosted_ui_router.png')} />

🚨 Schedule Call

Feature List

• Easy way to add/remove models
• 100% uptime even when models are added/removed
• custom callback webhooks
• your domain name with HTTPS
• Ability to create/delete User API keys
• Reasonable set monthly cost