forked from phoenix/litellm-mirror
66 lines
No EOL
2.2 KiB
Markdown
66 lines
No EOL
2.2 KiB
Markdown
import Image from '@theme/IdealImage';
|
|
|
|
# Hosted LiteLLM Proxy
|
|
|
|
LiteLLM maintains the proxy, so you can focus on your core products.
|
|
|
|
## [**Get Onboarded**](https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat)
|
|
|
|
This is in alpha. Schedule a call with us, and we'll give you a hosted proxy within 30 minutes.
|
|
|
|
[**🚨 Schedule Call**](https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat)
|
|
|
|
### **Status**: Alpha
|
|
|
|
Our proxy is already used in production by customers.
|
|
|
|
See our status page for [**live reliability**](https://status.litellm.ai/)
|
|
|
|
### **Benefits**
|
|
- **No Maintenance, No Infra**: We'll maintain the proxy, and spin up any additional infrastructure (e.g.: separate server for spend logs) to make sure you can load balance + track spend across multiple LLM projects.
|
|
- **Reliable**: Our hosted proxy is tested on 1k requests per second, making it reliable for high load.
|
|
- **Secure**: LiteLLM is currently undergoing SOC-2 compliance, to make sure your data is as secure as possible.
|
|
|
|
## Data Privacy & Security
|
|
|
|
You can find our [data privacy & security policy for cloud litellm here](../docs/data_security#litellm-cloud)
|
|
|
|
## Supported data regions for LiteLLM Cloud
|
|
|
|
You can find [supported data regions litellm here](../docs/data_security#supported-data-regions-for-litellm-cloud)
|
|
|
|
### Pricing
|
|
|
|
Pricing is based on usage. We can figure out a price that works for your team, on the call.
|
|
|
|
[**🚨 Schedule Call**](https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat)
|
|
|
|
## **Screenshots**
|
|
|
|
### 1. Create keys
|
|
|
|
<Image img={require('../img/litellm_hosted_ui_create_key.png')} />
|
|
|
|
### 2. Add Models
|
|
|
|
<Image img={require('../img/litellm_hosted_ui_add_models.png')}/>
|
|
|
|
### 3. Track spend
|
|
|
|
<Image img={require('../img/litellm_hosted_usage_dashboard.png')} />
|
|
|
|
|
|
### 4. Configure load balancing
|
|
|
|
<Image img={require('../img/litellm_hosted_ui_router.png')} />
|
|
|
|
#### [**🚨 Schedule Call**](https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat)
|
|
|
|
## Feature List
|
|
|
|
- Easy way to add/remove models
|
|
- 100% uptime even when models are added/removed
|
|
- custom callback webhooks
|
|
- your domain name with HTTPS
|
|
- Ability to create/delete User API keys
|
|
- Reasonable set monthly cost |