phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

Update readme.md

Browse source
This commit is contained in:
Ishaan Jaff 2023-08-30 20:13:10 -07:00 • committed by GitHub
parent 14d4c7ead2
commit de72df712e
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 2 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

5
cookbook/llm-ab-test-server/readme.md
View file

@ -27,6 +27,8 @@
<a href="https://litellm.ai/playground" target="_blank">Demo Website</a>
</h4>
![pika-1693451518986-1x](https://github.com/BerriAI/litellm/assets/29436595/1cbf29a3-5313-4f61-ad6e-481dd8737309)
LiteLLM allows you to call 100+ LLMs using completion
## This template server allows you to define LLMs with their A/B test ratios
@ -54,9 +56,6 @@ response = completion(model="claude-2", messages=messages)
This server allows you to view responses, costs and latency on your LiteLLM dashboard
### LiteLLM Client UI
![pika-1693023669579-1x](https://github.com/BerriAI/litellm/assets/29436595/86633e2f-eda0-4939-a588-84e4c100f36a)
# Using LiteLLM A/B Testing Server
## Setup