phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-08-07 11:08:20 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

rebase onto the dataset api fix , and pre-commit

Browse source
This commit is contained in:
Yang Yang 2025-03-19 12:51:55 -07:00
parent a550f17128
commit 7f80b1bbf2
2 changed files with 0 additions and 6 deletions
Download patch file Download diff file Expand all files Collapse all files

1
llama_stack/templates/open-benchmark/open_benchmark.py
View file

@ -205,7 +205,6 @@ def get_distribution_template() -> DistributionTemplate:
), ),
DatasetInput( DatasetInput(
dataset_id="docvqa", dataset_id="docvqa",
provider_id="huggingface",
purpose=DatasetPurpose.eval_messages_answer, purpose=DatasetPurpose.eval_messages_answer,
source=URIDataSource( source=URIDataSource(
uri="huggingface://datasets/llamastack/docvqa?split=val", uri="huggingface://datasets/llamastack/docvqa?split=val",

5
llama_stack/templates/open-benchmark/run.yaml
View file

@ -188,17 +188,12 @@ datasets:
uri: huggingface://datasets/llamastack/bfcl_v3?split=train uri: huggingface://datasets/llamastack/bfcl_v3?split=train
metadata: {} metadata: {}
dataset_id: bfcl dataset_id: bfcl
<<<<<<< HEAD
=======
provider_id: huggingface
- purpose: eval/messages-answer - purpose: eval/messages-answer
source: source:
type: uri type: uri
uri: huggingface://datasets/llamastack/docvqa?split=val uri: huggingface://datasets/llamastack/docvqa?split=val
metadata: {} metadata: {}
dataset_id: docvqa dataset_id: docvqa
provider_id: huggingface
>>>>>>> 81df5a4e (add DocVQA scoring)
scoring_fns: [] scoring_fns: []
benchmarks: benchmarks:
- dataset_id: simpleqa - dataset_id: simpleqa