Xi Yan 6192bf43a4 [Evals API][10/n] API updates for EvalTaskDef + new test migration (#379) ... * wip * scoring fn api * eval api * eval task * evaluate api update * pre commit * unwrap context -> config * config field doc * typo * naming fix * separate benchmark / app eval * api name * rename * wip tests * wip * datasetio test * delete unused * fixture * scoring resolve * fix scoring register * scoring test pass * score batch * scoring fix * fix eval * test eval works * remove type ignore * api refactor * add default task_eval_id for routing * add eval_id for jobs * remove type ignore * only keep 1 run_eval * fix optional * register task required * register task required * delete old tests * delete old tests * fixture return impl		2024-11-07 21:24:12 -08:00
..
__init__.py	Remove "routing_table" and "routing_key" concepts for the user (#201)	2024-10-10 10:24:13 -07:00
conftest.py	Enable vision models for (Together, Fireworks, Meta-Reference, Ollama) (#376)	2024-11-05 16:22:33 -08:00
fixtures.py	[Evals API][10/n] API updates for EvalTaskDef + new test migration (#379)	2024-11-07 21:24:12 -08:00
pasta.jpeg	Enable vision models for (Together, Fireworks, Meta-Reference, Ollama) (#376)	2024-11-05 16:22:33 -08:00
test_prompt_adapter.py	Added tests for persistence (#274)	2024-10-22 19:41:46 -07:00
test_text_inference.py	rename test_inference -> test_text_inference	2024-11-06 16:12:50 -08:00
test_vision_inference.py	remote::vllm now works with vision models	2024-11-06 16:07:17 -08:00
utils.py	Enable vision models for (Together, Fireworks, Meta-Reference, Ollama) (#376)	2024-11-05 16:22:33 -08:00