Dinesh Yeduguru
|
1bcf484d83
|
precommit failures fixed
|
2024-11-04 09:37:23 -08:00 |
|
Dinesh Yeduguru
|
7696f31284
|
use annotate and field discriminator
|
2024-11-04 09:37:23 -08:00 |
|
Dinesh Yeduguru
|
63f45c1e27
|
linter fixes
|
2024-11-04 09:37:23 -08:00 |
|
Dinesh Yeduguru
|
8fe22230b8
|
persist registered objects with distribution
|
2024-11-04 09:37:23 -08:00 |
|
Xi Yan
|
cb84034567
|
[Evals API][3/n] scoring_functions / scoring meta-reference implementations (#296)
* wip
* dataset validation
* test_scoring
* cleanup
* clean up test
* comments
* error checking
* dataset client
* test client:
* datasetio client
* clean up
* basic scoring function works
* scorer wip
* equality scorer
* score batch impl
* score batch
* update scoring test
* refactor
* validate scorer input
* address comments
* add all rows scores to ScoringResult
* bugfix
* scoring function def rename
|
2024-10-24 14:52:30 -07:00 |
|
Xi Yan
|
821810657f
|
[Evals API][2/n] datasets / datasetio meta-reference implementation (#288)
* skeleton dataset / datasetio
* dataset datasetio
* config
* address comments
* delete dataset_utils
* address comments
* naming fix
|
2024-10-22 16:12:16 -07:00 |
|
Xi Yan
|
e45f121c77
|
[Evals API] [1/n] Initial API (#287)
* type system api
* datasets api
* fix
* datasetio api
* kill reward scoring
* scoring functions + evals
* move jobs, fix errors
|
2024-10-22 09:31:19 -07:00 |
|