litellm/docs/my-website/docs/debugging/hosted_debugging.md
2023-08-23 11:55:42 -07:00

1.5 KiB

import Image from '@theme/IdealImage';

LiteLLM Client - Debugging Dashboard

LiteLLM offers a UI to:

  • Add New LLMs - Store your API Keys, Model Configurations
  • Debug your Call Logs

Once created, your dashboard is viewable at - admin.litellm.ai/<your_email> 👋 Tell us if you need better privacy controls See our live dashboard 👉 admin.litellm.ai

<Image img={require('../../img/dashboard.png')} alt="Dashboard" />

Usage

Requirements

  1. Needs litellm>=0.1.438*
  2. Set litellm.email account. You can set your user email in 2 ways.
    • By setting it on the module - litellm.email=<your_email>.
    • By setting it as an environment variable - os.environ["LITELLM_EMAIL"] = "your_email".

Code Setup

 import litellm
 
 ## Setup for activating / using the litellm dashboard
 litellm.email = "test_email@test.com"

Calling Completion() with the LiteLLM Dashboard

import litellm
from litellm import completion

## Setup for activating / using the litellm dashboard
litellm.email = "test_email@test.com"

user_message = "Hello, how are you?"
messages = [{ "content": user_message,"role": "user"}]


# openai call
response = completion(model="gpt-3.5-turbo", messages=[{"role": "user", "content": "Hi 👋 - i'm openai"}])

# bad request call
response = completion(model="chatgpt-test", messages=[{"role": "user", "content": "Hi 👋 - i'm a bad request"}])