From 54b9343395bde3db7b5a0d86bc6d3723d1099a30 Mon Sep 17 00:00:00 2001 From: Ishaan Jaff Date: Fri, 25 Aug 2023 21:42:26 -0700 Subject: [PATCH] Update readme.md --- cookbook/llm-ab-test-server/readme.md | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-) diff --git a/cookbook/llm-ab-test-server/readme.md b/cookbook/llm-ab-test-server/readme.md index cfb7f26e7..c778a64e6 100644 --- a/cookbook/llm-ab-test-server/readme.md +++ b/cookbook/llm-ab-test-server/readme.md @@ -28,7 +28,8 @@ LiteLLM allows you to call 100+ LLMs using completion -This template server allows you to define LLMs with their A/B test ratios + +## This template server allows you to define LLMs with their A/B test ratios ```python llm_dict = { @@ -51,7 +52,7 @@ response = completion(model="command-nightly", messages=messages) response = completion(model="claude-2", messages=messages) ``` -After calling `completion()` costs and latency can be viewed on the LiteLLM Client UI +This server allows you to view responses, costs and latency on your LiteLLM dashboard ### LiteLLM Client UI ![pika-1693023669579-1x](https://github.com/BerriAI/litellm/assets/29436595/86633e2f-eda0-4939-a588-84e4c100f36a)