phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

(docs) using auto evals

Browse source
This commit is contained in:
ishaan-jaff 2023-11-09 17:31:50 -08:00
parent 7ddd29da93
commit e355a0674f
1 changed files with 1 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

4
docs/my-website/docs/tutorials/eval_suites.md
View file

@ -239,7 +239,6 @@ See autoevals docs on the [supported evaluators](https://www.braintrustdata.com/
```python ```python
# auto evals imports # auto evals imports
from autoevals.llm import * from autoevals.llm import *
import openai
################### ###################
import litellm import litellm
@ -254,10 +253,9 @@ response = litellm.completion(
} }
], ],
) )
print(response)
# use the auto eval Factuality() evaluator # use the auto eval Factuality() evaluator
evaluator = Factuality() evaluator = Factuality()
openai.api_key = "" # set your openai api key for evaluator
result = evaluator( result = evaluator(
output=response.choices[0]["message"]["content"], # response from litellm.completion() output=response.choices[0]["message"]["content"], # response from litellm.completion()
expected="India", # expected output expected="India", # expected output