Xi Yan 7b8748c53e [Evals API][6/n] meta-reference llm as judge, registration for ScoringFnDefs (#330) ... * wip scoring refactor * llm as judge, move folders * test full generation + eval * extract score regex to llm context * remove prints, cleanup braintrust in this branch * change json -> class * remove initialize * address nits * check identifier prefix * udpate MANIFEST		2024-10-28 14:08:42 -07:00
..
adapters	add vision instruct models for fireworks	2024-10-27 17:54:54 +00:00
impls	[Evals API][6/n] meta-reference llm as judge, registration for ScoringFnDefs (#330)	2024-10-28 14:08:42 -07:00
registry	[Evals API][6/n] meta-reference llm as judge, registration for ScoringFnDefs (#330)	2024-10-28 14:08:42 -07:00
tests	[Evals API][6/n] meta-reference llm as judge, registration for ScoringFnDefs (#330)	2024-10-28 14:08:42 -07:00
utils	completion() for tgi (#295)	2024-10-24 16:02:41 -07:00
__init__.py	API Updates (#73)	2024-09-17 19:51:35 -07:00
datatypes.py	[Evals API][4/n] evals with generation meta-reference impl (#303)	2024-10-25 13:12:39 -07:00