litellm/docs/my-website/docs/proxy/ui.md
2024-01-31 19:54:04 -08:00

3.1 KiB

import Image from '@theme/IdealImage'; import Tabs from '@theme/Tabs'; import TabItem from '@theme/TabItem';

[BETA] Admin UI

:::info

This is in beta, so things may change. If you have feedback, let us know

:::

Allow your users to create, view their own keys through a UI

<Image img={require('../../img/admin_ui_2.png')} />

Quick Start

1. Setup SSO/Auth for UI

Required .env variables on your Proxy

PROXY_BASE_URL="<your deployed proxy endpoint>" example PROXY_BASE_URL=https://litellm-production-7002.up.railway.app/

# for Google SSO Login
GOOGLE_CLIENT_ID=
GOOGLE_CLIENT_SECRET=
  • Set Redirect URL on your Oauth 2.0 Client on https://console.cloud.google.com/
    • Set a redirect url = <your proxy base url>/sso/callback
    https://litellm-production-7002.up.railway.app/sso/callback
    

Required .env variables on your Proxy

PROXY_BASE_URL="<your deployed proxy endpoint>" example PROXY_BASE_URL=https://litellm-production-7002.up.railway.app/

MICROSOFT_CLIENT_ID="84583a4d-"
MICROSOFT_CLIENT_SECRET="nbk8Q~"
MICROSOFT_TENANT="5a39737
  • Set Redirect URI on your App Registration on https://portal.azure.com/
    • Set a redirect url = <your proxy base url>/sso/callback
    http://localhost:4000/sso/callback
    

Set the following in your .env on the Proxy

PROXY_BASE_URL="<your deployed proxy endpoint>" example PROXY_BASE_URL=https://litellm-production-7002.up.railway.app/

UI_USERNAME=ishaan-litellm
UI_PASSWORD=langchain

On accessing the LiteLLM UI, you will be prompted to enter your username, password

2. Start Proxy Server

litellm --config proxy_config.yaml --port 4000

# start proxy on port 4000

Your Proxy Swagger is available on the root of the Proxy: http://localhost:4000/

<Image img={require('../../img/ui_link.png')} />