forked from phoenix/litellm-mirror
61 lines
No EOL
1.5 KiB
Markdown
61 lines
No EOL
1.5 KiB
Markdown
import Image from '@theme/IdealImage';
|
||
|
||
# Weights & Biases - Logging LLM Input/Output
|
||
|
||
|
||
:::tip
|
||
|
||
This is community maintained, Please make an issue if you run into a bug
|
||
https://github.com/BerriAI/litellm
|
||
|
||
:::
|
||
|
||
|
||
Weights & Biases helps AI developers build better models faster https://wandb.ai
|
||
|
||
<Image img={require('../../img/wandb.png')} />
|
||
|
||
:::info
|
||
We want to learn how we can make the callbacks better! Meet the LiteLLM [founders](https://calendly.com/d/4mp-gd3-k5k/berriai-1-1-onboarding-litellm-hosted-version) or
|
||
join our [discord](https://discord.gg/wuPM9dRgDw)
|
||
:::
|
||
|
||
## Pre-Requisites
|
||
Ensure you have run `pip install wandb` for this integration
|
||
```shell
|
||
pip install wandb litellm
|
||
```
|
||
|
||
## Quick Start
|
||
Use just 2 lines of code, to instantly log your responses **across all providers** with Weights & Biases
|
||
|
||
```python
|
||
litellm.success_callback = ["wandb"]
|
||
```
|
||
```python
|
||
# pip install wandb
|
||
import litellm
|
||
import os
|
||
|
||
os.environ["WANDB_API_KEY"] = ""
|
||
# LLM API Keys
|
||
os.environ['OPENAI_API_KEY']=""
|
||
|
||
# set wandb as a callback, litellm will send the data to Weights & Biases
|
||
litellm.success_callback = ["wandb"]
|
||
|
||
# openai call
|
||
response = litellm.completion(
|
||
model="gpt-3.5-turbo",
|
||
messages=[
|
||
{"role": "user", "content": "Hi 👋 - i'm openai"}
|
||
]
|
||
)
|
||
```
|
||
|
||
## Support & Talk to Founders
|
||
|
||
- [Schedule Demo 👋](https://calendly.com/d/4mp-gd3-k5k/berriai-1-1-onboarding-litellm-hosted-version)
|
||
- [Community Discord 💭](https://discord.gg/wuPM9dRgDw)
|
||
- Our numbers 📞 +1 (770) 8783-106 / +1 (412) 618-6238
|
||
- Our emails ✉️ ishaan@berri.ai / krrish@berri.ai |