diff --git a/cookbook/llm-ab-test-server/readme.md b/cookbook/llm-ab-test-server/readme.md index cfb7f26e7..c778a64e6 100644 --- a/cookbook/llm-ab-test-server/readme.md +++ b/cookbook/llm-ab-test-server/readme.md @@ -28,7 +28,8 @@ LiteLLM allows you to call 100+ LLMs using completion -This template server allows you to define LLMs with their A/B test ratios + +## This template server allows you to define LLMs with their A/B test ratios ```python llm_dict = { @@ -51,7 +52,7 @@ response = completion(model="command-nightly", messages=messages) response = completion(model="claude-2", messages=messages) ``` -After calling `completion()` costs and latency can be viewed on the LiteLLM Client UI +This server allows you to view responses, costs and latency on your LiteLLM dashboard ### LiteLLM Client UI ![pika-1693023669579-1x](https://github.com/BerriAI/litellm/assets/29436595/86633e2f-eda0-4939-a588-84e4c100f36a)