Commit graph

8 commits

Author SHA1 Message Date
Xi Yan
a15a4a4be2 rebase 2024-11-12 10:03:03 -05:00
Xi Yan
fd424e7900 util 2024-11-11 23:02:56 -05:00
Xi Yan
87dc116782 rename llm_as_judge, fix test 2024-11-11 22:57:51 -05:00
Xi Yan
e20dc8d133 impl rename 2024-11-11 22:41:54 -05:00
Xi Yan
ecf1932424 config rename 2024-11-11 22:41:15 -05:00
Xi Yan
8dee5faf0d rename meta-reference -> basic 2024-11-11 22:36:43 -05:00
Dinesh Yeduguru
0a3b3d5fb6
migrate scoring fns to resource (#422)
* fix after rebase

* remove print

---------

Co-authored-by: Dinesh Yeduguru <dineshyv@fb.com>
2024-11-11 17:28:48 -08:00
Xi Yan
b4416b72fd
Folder restructure for evals/datasets/scoring (#419)
* rename evals related stuff

* fix datasetio

* fix scoring test

* localfs -> LocalFS

* refactor scoring

* refactor scoring

* remove 8b_correctness scoring_fn from tests

* tests w/ eval params

* scoring fn braintrust fixture

* import
2024-11-11 17:35:40 -05:00