phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-24 18:24:20 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
litellm-mirror/docs/index.md
ishaan-jaff 6569b435d1 v2
2023-07-29 12:40:53 -07:00

1.4 KiB
Raw Blame History

🚅 litellm

a light 100 line package to simplify calling OpenAI, Azure, Cohere, Anthropic APIs

litellm manages:
  • Calling all LLM APIs using the OpenAI format - completion(model, messages)
  • Consistent output for all LLM APIs, text responses will always be available at ['choices'][0]['message']['content']
  • [Advanced] Automatically logging your output to Sentry, Posthog, Slack see liteLLM Client

Quick Start

Go directly to code: Getting Started Notebook

Installation

pip install litellm

Usage

from litellm import completion

## set ENV variables
os.environ["OPENAI_API_KEY"] = "openai key"
os.environ["COHERE_API_KEY"] = "cohere key"

messages = [{ "content": "Hello, how are you?","role": "user"}]

# openai call
response = completion(model="gpt-3.5-turbo", messages=messages)

# cohere call
response = completion("command-nightly", messages)

Need Help / Support : see troubleshooting

Why did we build liteLLM

  • Need for simplicity: Our code started to get extremely complicated managing & translating calls between Azure, OpenAI, Cohere

Support