llama-stack/llama_stack/templates
Xi Yan c1d18283d2
feat(eval api): (2.2/n) delete eval / scoring / scoring_fn apis (#1700)
# What does this PR do?
- To make it easier, delete existing `eval/scoring/scoring_function`
apis. There will be a bunch of broken impls here. The sequence is:
1. migrate benchmark graders
2. clean up existing scoring functions

- Add a skeleton evaluation impl to make tests pass. 

## Test Plan
tested in following PRs

[//]: # (## Documentation)
2025-03-19 11:04:23 -07:00
..
bedrock feat(eval api): (2.2/n) delete eval / scoring / scoring_fn apis (#1700) 2025-03-19 11:04:23 -07:00
cerebras feat(eval api): (2.2/n) delete eval / scoring / scoring_fn apis (#1700) 2025-03-19 11:04:23 -07:00
ci-tests feat(eval api): (2.2/n) delete eval / scoring / scoring_fn apis (#1700) 2025-03-19 11:04:23 -07:00
dell feat(eval api): (2.2/n) delete eval / scoring / scoring_fn apis (#1700) 2025-03-19 11:04:23 -07:00
dev feat(eval api): (2.2/n) delete eval / scoring / scoring_fn apis (#1700) 2025-03-19 11:04:23 -07:00
experimental-post-training feat: [post training] support save hf safetensor format checkpoint (#845) 2025-02-25 23:29:08 -08:00
fireworks feat(eval api): (2.2/n) delete eval / scoring / scoring_fn apis (#1700) 2025-03-19 11:04:23 -07:00
groq feat(eval api): (2.2/n) delete eval / scoring / scoring_fn apis (#1700) 2025-03-19 11:04:23 -07:00
hf-endpoint feat(eval api): (2.2/n) delete eval / scoring / scoring_fn apis (#1700) 2025-03-19 11:04:23 -07:00
hf-serverless feat(eval api): (2.2/n) delete eval / scoring / scoring_fn apis (#1700) 2025-03-19 11:04:23 -07:00
meta-reference-gpu feat(eval api): (2.2/n) delete eval / scoring / scoring_fn apis (#1700) 2025-03-19 11:04:23 -07:00
meta-reference-quantized-gpu feat(eval api): (2.2/n) delete eval / scoring / scoring_fn apis (#1700) 2025-03-19 11:04:23 -07:00
nvidia feat(eval api): (2.2/n) delete eval / scoring / scoring_fn apis (#1700) 2025-03-19 11:04:23 -07:00
ollama feat(eval api): (2.2/n) delete eval / scoring / scoring_fn apis (#1700) 2025-03-19 11:04:23 -07:00
open-benchmark feat(eval api): (2.2/n) delete eval / scoring / scoring_fn apis (#1700) 2025-03-19 11:04:23 -07:00
passthrough feat(eval api): (2.2/n) delete eval / scoring / scoring_fn apis (#1700) 2025-03-19 11:04:23 -07:00
remote-vllm feat(eval api): (2.2/n) delete eval / scoring / scoring_fn apis (#1700) 2025-03-19 11:04:23 -07:00
sambanova feat(eval api): (2.2/n) delete eval / scoring / scoring_fn apis (#1700) 2025-03-19 11:04:23 -07:00
tgi feat(eval api): (2.2/n) delete eval / scoring / scoring_fn apis (#1700) 2025-03-19 11:04:23 -07:00
together feat(eval api): (2.2/n) delete eval / scoring / scoring_fn apis (#1700) 2025-03-19 11:04:23 -07:00
vllm-gpu feat(eval api): (2.2/n) delete eval / scoring / scoring_fn apis (#1700) 2025-03-19 11:04:23 -07:00
__init__.py Auto-generate distro yamls + docs (#468) 2024-11-18 14:57:06 -08:00
template.py feat(api): (1/n) datasets api clean up (#1573) 2025-03-17 16:55:45 -07:00