phoenix-oss/llama-stack
1
0
Fork 0
forked from phoenix-oss/llama-stack-mirror
Code Pull requests Releases Packages 2 Activity Actions

openapi gen

Browse source
This commit is contained in:
Xi Yan 2025-03-18 20:38:05 -07:00
parent 24d48b3692
commit 205a50f10b
2 changed files with 9 additions and 5 deletions
Download patch file Download diff file Expand all files Collapse all files

2
docs/_static/llama-stack-spec.html vendored
View file

@ -8548,7 +8548,7 @@
}, },
"additionalProperties": false, "additionalProperties": false,
"title": "EvaluationTask", "title": "EvaluationTask",
"description": "A task for evaluation. To specify a task, one of the following must be provided: - `benchmark_id`: Run evaluation task against a benchmark_id - `dataset_id` and `grader_ids`: Run evaluation task against a dataset_id and a list of grader_ids - `data_source` and `grader_ids`: Run evaluation task against a data source (e.g. rows, uri, etc.) and a list of grader_ids" "description": "A task for evaluation. To specify a task, one of the following must be provided: - `benchmark_id`: Run evaluation task against a benchmark_id. Use this when you have a curated dataset and have settled on the graders. - `dataset_id` and `grader_ids`: Run evaluation task against a dataset_id and a list of grader_ids. Use this when you have datasets and / or are iterating on your graders. - `data_source` and `grader_ids`: Run evaluation task against a data source (e.g. rows, uri, etc.) and a list of grader_ids. Prefer this when you are early in your evaluation cycle and experimenting much more with your data and graders."
}, },
"GradeRequest": { "GradeRequest": {
"type": "object", "type": "object",

12
docs/_static/llama-stack-spec.yaml vendored
View file

@ -5924,10 +5924,14 @@ components:
title: EvaluationTask title: EvaluationTask
description: >- description: >-
A task for evaluation. To specify a task, one of the following must be provided: A task for evaluation. To specify a task, one of the following must be provided:
- `benchmark_id`: Run evaluation task against a benchmark_id - `dataset_id` - `benchmark_id`: Run evaluation task against a benchmark_id. Use this when
and `grader_ids`: Run evaluation task against a dataset_id and a list of grader_ids you have a curated dataset and have settled on the graders. - `dataset_id`
- `data_source` and `grader_ids`: Run evaluation task against a data source and `grader_ids`: Run evaluation task against a dataset_id and a list of grader_ids.
(e.g. rows, uri, etc.) and a list of grader_ids Use this when you have datasets and / or are iterating on your graders. -
`data_source` and `grader_ids`: Run evaluation task against a data source
(e.g. rows, uri, etc.) and a list of grader_ids. Prefer this when you are
early in your evaluation cycle and experimenting much more with your data
and graders.
GradeRequest: GradeRequest:
type: object type: object
properties: properties: