Xi Yan 6192bf43a4 [Evals API][10/n] API updates for EvalTaskDef + new test migration (#379) ... * wip * scoring fn api * eval api * eval task * evaluate api update * pre commit * unwrap context -> config * config field doc * typo * naming fix * separate benchmark / app eval * api name * rename * wip tests * wip * datasetio test * delete unused * fixture * scoring resolve * fix scoring register * scoring test pass * score batch * scoring fix * fix eval * test eval works * remove type ignore * api refactor * add default task_eval_id for routing * add eval_id for jobs * remove type ignore * only keep 1 run_eval * fix optional * register task required * register task required * delete old tests * delete old tests * fixture return impl		2024-11-07 21:24:12 -08:00
..
inline	[Evals API][10/n] API updates for EvalTaskDef + new test migration (#379)	2024-11-07 21:24:12 -08:00
registry	Add provider deprecation support; change directory structure (#397)	2024-11-07 13:04:53 -08:00
remote	fix together inference validator (#393)	2024-11-07 11:31:53 -08:00
tests	[Evals API][10/n] API updates for EvalTaskDef + new test migration (#379)	2024-11-07 21:24:12 -08:00
utils	remote::vllm now works with vision models	2024-11-06 16:07:17 -08:00
__init__.py	API Updates (#73)	2024-09-17 19:51:35 -07:00
datatypes.py	[Evals API][10/n] API updates for EvalTaskDef + new test migration (#379)	2024-11-07 21:24:12 -08:00