Xi Yan c1d18283d2 feat(eval api): (2.2/n) delete eval / scoring / scoring_fn apis (#1700) ... # What does this PR do? - To make it easier, delete existing `eval/scoring/scoring_function` apis. There will be a bunch of broken impls here. The sequence is: 1. migrate benchmark graders 2. clean up existing scoring functions - Add a skeleton evaluation impl to make tests pass. ## Test Plan tested in following PRs [//]: # (## Documentation)		2025-03-19 11:04:23 -07:00
..
agents	chore: deprecate ToolResponseMessage in agent.resume API (#1566)	2025-03-12 12:10:21 -07:00
batch_inference	fix: solve ruff B008 warnings (#1444)	2025-03-06 16:48:35 -08:00
benchmarks	update	2025-03-19 09:49:53 -07:00
common	comments	2025-03-18 15:01:41 -07:00
datasetio	precommit	2025-03-17 17:08:21 -07:00
datasets	fix: return 4xx for non-existent resources in GET requests (#1635)	2025-03-18 14:06:53 -07:00
evaluation	update	2025-03-19 09:48:30 -07:00
files	fix: return 4xx for non-existent resources in GET requests (#1635)	2025-03-18 14:06:53 -07:00
graders	precommit	2025-03-18 20:48:03 -07:00
inference	feat(api): remove tool_name from ToolResponseMessage (#1599)	2025-03-12 19:41:48 -07:00
inspect	feat: add provider API for listing and inspecting provider info (#1429)	2025-03-13 15:07:21 -07:00
models	fix: return 4xx for non-existent resources in GET requests (#1635)	2025-03-18 14:06:53 -07:00
post_training	chore: fix mypy violations in post_training modules (#1548)	2025-03-18 14:58:16 -07:00
providers	fix: OpenAPI with provider get (#1627)	2025-03-13 19:56:32 -07:00
safety	chore: move all Llama Stack types from llama-models to llama-stack (#1098)	2025-02-14 09:10:59 -08:00
shields	fix: return 4xx for non-existent resources in GET requests (#1635)	2025-03-18 14:06:53 -07:00
synthetic_data_generation	chore: move all Llama Stack types from llama-models to llama-stack (#1098)	2025-02-14 09:10:59 -08:00
telemetry	feat: Add new compact MetricInResponse type (#1593)	2025-03-12 15:45:44 -07:00
tools	feat: tool outputs metadata (#1155)	2025-02-21 13:15:31 -08:00
vector_dbs	fix: return 4xx for non-existent resources in GET requests (#1635)	2025-03-18 14:06:53 -07:00
vector_io	chore: move all Llama Stack types from llama-models to llama-stack (#1098)	2025-02-14 09:10:59 -08:00
__init__.py	API Updates (#73)	2024-09-17 19:51:35 -07:00
datatypes.py	feat(eval api): (2.2/n) delete eval / scoring / scoring_fn apis (#1700)	2025-03-19 11:04:23 -07:00
resource.py	precommit	2025-03-16 19:40:18 -07:00
version.py	llama-stack version alpha -> v1	2025-01-15 05:58:09 -08:00