forked from phoenix/litellm-mirror
1.5 KiB
1.5 KiB
import Image from '@theme/IdealImage';
LiteLLM Client - Debugging Dashboard
LiteLLM offers a UI to:
- Add New LLMs - Store your API Keys, Model Configurations
- Debug your Call Logs
Once created, your dashboard is viewable at - admin.litellm.ai/<your_email>
👋 Tell us if you need better privacy controls
See our live dashboard 👉 admin.litellm.ai
<Image img={require('../../img/dashboard.png')} alt="Dashboard" />
Usage
Requirements
- Needs litellm>=0.1.438*
- Set
litellm.email
account. You can set your user email in 2 ways.- By setting it on the module -
litellm.email=<your_email>
. - By setting it as an environment variable -
os.environ["LITELLM_EMAIL"] = "your_email"
.
- By setting it on the module -
Code Setup
import litellm
## Setup for activating / using the litellm dashboard
litellm.email = "test_email@test.com"
Calling Completion() with the LiteLLM Dashboard
import litellm
from litellm import completion
## Setup for activating / using the litellm dashboard
litellm.email = "test_email@test.com"
user_message = "Hello, how are you?"
messages = [{ "content": user_message,"role": "user"}]
# openai call
response = completion(model="gpt-3.5-turbo", messages=[{"role": "user", "content": "Hi 👋 - i'm openai"}])
# bad request call
response = completion(model="chatgpt-test", messages=[{"role": "user", "content": "Hi 👋 - i'm a bad request"}])