+
+
+
+## Output at the end of this
+## Pre-requisites:
``` python
!pip install litellm
```
## Example Use Case 1 - Code Generator
-### For this use case enter your system prompt and questions
+### Enter your system prompt and questions
```` python
# enter your system prompt if you have one
system_prompt = """
@@ -50,7 +55,7 @@ questions = [
]
````
-## Running questions
+### Running questions
### Select from 100+ LLMs here: | + | Model | +Question | +Response | +ResponseTime | +Cost | +
|---|---|---|---|---|---|
| 0 | +togethercomputer/llama-2-70b-chat | +what is litellm? | +Litellm is a lightweight Python package that simplifies calling various AI API endpoints, including OpenAI, Azure, Cohere, Anthropic, and Hugging Face. It provides a convenient interface for making requests to these APIs, allowing developers to easily integrate them into their applications. With Litellm, developers can quickly and easily interact with multiple AI models and services, without having to handle the details of authentication, API calls, and response parsing. This makes it easier to build and deploy AI-powered applications, and can help developers save time and effort. | +13.479644 | +0.000870 | +
| 1 | +gpt-3.5-turbo | +what is litellm? | +litellm is a light package that provides a simplified interface for making API calls to various language models and APIs. It abstracts away the complexities of handling network requests, authentication, and response parsing, making it easier for developers to integrate powerful language models into their applications.\n\nWith litellm, you can quickly make API calls to models like OpenAI's GPT-3.5 Turbo, Azure's Text Analytics, Cohere's Command API, Anthropic's API, and Huggingface's models. It also supports additional functionality like conversational AI, summarization, translation, and more.\n\nBy using litellm, you can focus on your application logic without getting tangled in the details of API integration, allowing you to quickly build intelligent and conversational applications. | +8.324332 | +0.000566 | +
| 2 | +claude-instant-1.2 | +what is litellm? | +litellm is a Python library that simplifies calling various AI API endpoints like OpenAI, Azure, Cohere, Anthropic, and Huggingface. \n\nSome key things to know about litellm:\n\n- It provides a consistent interface for completing prompts and generating responses from different AI models through a single method called completion().\n\n- You specify the API (e.g. OpenAI, Cohere etc.) and model either by name or by setting environment variables before making the completion call.\n\n- This avoids having to use different SDKs or APIs for each provider and standardizes the call structure. \n\n- It handles things like setting headers, encoding inputs, parsing responses so the user doesn't have to deal with those details.\n\n- The goal is to make it easy to try different AI APIs and models without having to change code or learn different interfaces.\n\n- It's lightweight with no other dependencies required besides what's needed for each API (e.g. openai, azure SDKs etc.).\n\nSo in summary, litellm is a small library that provides a common way to interact with multiple conversational AI APIs through a single Python method, avoiding the need to directly use each provider's specific SDK. | +10.316488 | +0.001603 | +