llama-stack

phoenix-oss/llama-stack

Fork 0

forked from phoenix-oss/llama-stack-mirror

Commit graph

Author SHA1 Message Date

Author	SHA1	Message	Date
ehhuang	32e3da7392	test(verification): more tests, multiturn tool use tests (#1954 ) # What does this PR do? ## Test Plan (myenv) ➜ llama-stack python tests/verifications/generate_report.py --providers fireworks,together,openai --run-tests `f27f617629/tests/verifications/REPORT.md`	2025-04-14 18:45:22 -07:00
ehhuang	a4cc4b7e31	test(verification): add streaming tool calling test (#1933 ) # What does this PR do? ## Test Plan --- [//]: # (BEGIN SAPLING FOOTER) Stack created with [Sapling](https://sapling-scm.com). Best reviewed with [ReviewStack](https://reviewstack.dev/meta-llama/llama-stack/pull/1933). * #1934 * __->__ #1933	2025-04-10 16:58:06 -07:00
ehhuang	14146e4b3f	feat(verification): various improvements (#1921 ) # What does this PR do? - provider and their models now live in config.yaml - better distinguish different cases within a test - add model key to surface provider's model_id - include example command to rerun single test case ## Test Plan <img width="1173" alt="image" src="https://github.com/user-attachments/assets/b414baf0-c768-451f-8c3b-c2905cf36fac" />	2025-04-10 10:26:19 -07:00

ehhuang

32e3da7392

test(verification): more tests, multiturn tool use tests (#1954 )

# What does this PR do?


## Test Plan
(myenv) ➜ llama-stack python tests/verifications/generate_report.py
--providers fireworks,together,openai --run-tests

f27f617629/tests/verifications/REPORT.md

2025-04-14 18:45:22 -07:00

ehhuang

a4cc4b7e31

test(verification): add streaming tool calling test (#1933 )

# What does this PR do?


## Test Plan

---
[//]: # (BEGIN SAPLING FOOTER)
Stack created with [Sapling](https://sapling-scm.com). Best reviewed
with
[ReviewStack](https://reviewstack.dev/meta-llama/llama-stack/pull/1933).
* #1934
* __->__ #1933

2025-04-10 16:58:06 -07:00

ehhuang

14146e4b3f

feat(verification): various improvements (#1921 )

# What does this PR do?
- provider and their models now live in config.yaml
- better distinguish different cases within a test
- add model key to surface provider's model_id
- include example command to rerun single test case

## Test Plan
<img width="1173" alt="image"
src="https://github.com/user-attachments/assets/b414baf0-c768-451f-8c3b-c2905cf36fac"
/>

2025-04-10 10:26:19 -07:00

3 commits