13 commits

Author	SHA1	Message	Date
Xi Yan	be4f395032	full evals / full scoring flow	2024-10-15 10:17:45 -07:00
Xi Yan	9cc0a54f0b	rag correctness scorer w/ custom dataset	2024-10-15 00:42:03 -07:00
Xi Yan	ec6c63ba57	dataset accept file uploads	2024-10-14 23:36:15 -07:00
Xi Yan	fcb8dea1ef	scorer only api	2024-10-14 17:46:29 -07:00
Xi Yan	95fd53d292	registry refactor	2024-10-14 16:09:55 -07:00
Xi Yan	9c501d042b	cleanup hardcoded dataset registry	2024-10-14 14:19:15 -07:00
Xi Yan	a9210cd416	datasets api crud	2024-10-14 13:54:16 -07:00
Xi Yan	f046899a1c	datasets api	2024-10-14 13:16:39 -07:00
Xi Yan	18fe966e96	registry refactor	2024-10-14 00:12:46 -07:00
Xi Yan	a25aff290e	generator + scorer Api for MMLU	2024-10-13 23:27:02 -07:00
Xi Yan	9816c9aae6	wip add datatypes	2024-10-10 19:56:19 -07:00
Xi Yan	99ed1425fc	add dataset datatypes	2024-10-10 17:19:18 -07:00
Xi Yan	31c046dcdf	evals new rebase	2024-10-10 11:35:26 -07:00