phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

update docs

Browse source
This commit is contained in:
Krrish Dholakia 2023-09-01 07:39:52 -07:00
parent 9ccdbcbd6f
commit 290796db31
1 changed files with 2 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

5
docs/my-website/docs/tutorials/ab_test_llms.md
View file

@ -27,10 +27,9 @@ llm_dict = {
### Select LLM + Make Completion call ### Select LLM + Make Completion call
Use weighted selection, and call the model using litellm.completion Use weighted selection, and call the model using litellm.completion
```python ```python
from litellm import completion from litellm import completion_with_split_tests
selected_llm = random.choices(list(llm_dict.keys()), weights=list(llm_dict.values()))[0]
response = completion(model=selected_model, messages=[{ "content": "Hello, how are you?","role": "user"}]) response = completion_with_split_tests(model=llm_dict, messages=[{ "content": "Hello, how are you?","role": "user"}])
``` ```