Xi Yan ed833bb758 [Evals API][7/n] braintrust scoring provider (#333) ... * wip scoring refactor * llm as judge, move folders * test full generation + eval * extract score regex to llm context * remove prints, cleanup braintrust in this branch * braintrust skeleton * datasetio test fix * braintrust provider * remove prints * dependencies * change json -> class * json -> class * remove initialize * address nits * check identifier prefix * braintrust scoring identifier check, rebase * udpate MANIFEST * manifest * remove braintrust scoring_fn * remove comments * tests * imports fix		2024-10-28 18:59:35 -07:00
..
__init__.py	API Updates (#73)	2024-09-17 19:51:35 -07:00
agents.py	Remove "routing_table" and "routing_key" concepts for the user (#201)	2024-10-10 10:24:13 -07:00
datasetio.py	[Evals API][2/n] datasets / datasetio meta-reference implementation (#288)	2024-10-22 16:12:16 -07:00
eval.py	[Evals API][4/n] evals with generation meta-reference impl (#303)	2024-10-25 13:12:39 -07:00
inference.py	New quantized models (#301)	2024-10-24 08:38:56 -07:00
memory.py	feat: Qdrant Vector index support (#221)	2024-10-22 12:50:19 -07:00
safety.py	Remove "routing_table" and "routing_key" concepts for the user (#201)	2024-10-10 10:24:13 -07:00
scoring.py	[Evals API][7/n] braintrust scoring provider (#333)	2024-10-28 18:59:35 -07:00
telemetry.py	provider_id => provider_type, adapter_id => adapter_type	2024-10-02 14:05:59 -07:00