diff --git a/docs/my-website/docs/tutorials/ab_test_llms.md b/docs/my-website/docs/tutorials/ab_test_llms.md index f961795ff..f274fc522 100644 --- a/docs/my-website/docs/tutorials/ab_test_llms.md +++ b/docs/my-website/docs/tutorials/ab_test_llms.md @@ -52,35 +52,6 @@ git clone https://github.com/BerriAI/litellm/ cd litellm/cookbook/llm-ab-test-server ``` -### Define LLMs with their A/B test ratios -In main.py set select the LLMs you want to AB test in `llm_dict` (and remember to set their API keys in the .env)! - -We support 5+ providers and 100+ LLMs: https://docs.litellm.ai/docs/completion/supported - -```python -llm_dict = { - "gpt-4": 0.2, - "together_ai/togethercomputer/llama-2-70b-chat": 0.4, - "claude-2": 0.2, - "claude-1.2": 0.2 -} -``` - -All models defined can be called with the same Input/Output format using litellm `completion` -```python -from litellm import completion -# SET API KEYS in .env - https://docs.litellm.ai/docs/completion/supported -os.environ["OPENAI_API_KEY"] = "" -os.environ["TOGETHERAI_API_KEY"] = "" -os.environ["ANTHROPIC_API_KEY"] = "" - -# openai call -response = completion(model="gpt-3.5-turbo", messages=messages) -# cohere call -response = completion(model="together_ai/togethercomputer/llama-2-70b-chat", messages=messages) -# anthropic -response = completion(model="claude-2", messages=messages) -``` ### Run the Server ```