phoenix-oss/llama-stack
1
0
Fork 0
forked from phoenix-oss/llama-stack-mirror
Code Pull requests Releases Packages 2 Activity Actions

openapi gen

Browse source
This commit is contained in:
Xi Yan 2025-03-18 20:38:05 -07:00
parent 24d48b3692
commit 205a50f10b
2 changed files with 9 additions and 5 deletions
Download patch file Download diff file Expand all files Collapse all files

12
docs/_static/llama-stack-spec.yaml vendored
View file

@ -5924,10 +5924,14 @@ components:
title: EvaluationTask
description: >-
A task for evaluation. To specify a task, one of the following must be provided:
- `benchmark_id`: Run evaluation task against a benchmark_id - `dataset_id`
and `grader_ids`: Run evaluation task against a dataset_id and a list of grader_ids
- `data_source` and `grader_ids`: Run evaluation task against a data source
(e.g. rows, uri, etc.) and a list of grader_ids
- `benchmark_id`: Run evaluation task against a benchmark_id. Use this when
you have a curated dataset and have settled on the graders. - `dataset_id`
and `grader_ids`: Run evaluation task against a dataset_id and a list of grader_ids.
Use this when you have datasets and / or are iterating on your graders. -
`data_source` and `grader_ids`: Run evaluation task against a data source
(e.g. rows, uri, etc.) and a list of grader_ids. Prefer this when you are
early in your evaluation cycle and experimenting much more with your data
and graders.
GradeRequest:
type: object
properties: