llama-stack-mirror/llama_stack
Xi Yan 7b8748c53e
[Evals API][6/n] meta-reference llm as judge, registration for ScoringFnDefs (#330)
* wip scoring refactor

* llm as judge, move folders

* test full generation + eval

* extract score regex to llm context

* remove prints, cleanup braintrust in this branch

* change json -> class

* remove initialize

* address nits

* check identifier prefix

* udpate MANIFEST
2024-10-28 14:08:42 -07:00
..
apis [Evals API][6/n] meta-reference llm as judge, registration for ScoringFnDefs (#330) 2024-10-28 14:08:42 -07:00
cli fix broken --list-templates with adding build.yaml files for packaging (#327) 2024-10-25 12:51:22 -07:00
distribution Allow passing provider_registry to resolve_impls() 2024-10-28 11:58:16 -07:00
providers [Evals API][6/n] meta-reference llm as judge, registration for ScoringFnDefs (#330) 2024-10-28 14:08:42 -07:00
scripts Add a test for CLI, but not fully done so disabled 2024-09-19 13:27:07 -07:00
templates fix broken --list-templates with adding build.yaml files for packaging (#327) 2024-10-25 12:51:22 -07:00
__init__.py API Updates (#73) 2024-09-17 19:51:35 -07:00