5 commits

Author	SHA1	Message	Date
ehhuang	2fcb70b789	test(verification): overwrite test result instead of creating new ones (#1934) ... # What does this PR do? ## Test Plan (myenv) ➜ llama-stack python tests/verifications/generate_report.py --providers fireworks,together,openai --run-tests	2025-04-10 16:59:28 -07:00
ehhuang	a4cc4b7e31	test(verification): add streaming tool calling test (#1933) ... # What does this PR do? ## Test Plan --- [//]: # (BEGIN SAPLING FOOTER) Stack created with [Sapling](https://sapling-scm.com). Best reviewed with [ReviewStack](https://reviewstack.dev/meta-llama/llama-stack/pull/1933). * #1934 * __->__ #1933	2025-04-10 16:58:06 -07:00
Francisco Arceo	de6ec5803e	fix: Fix linter failures from #1921 (#1932) ... # What does this PR do? fix: Fix linter failures from #1921 Signed-off-by: Francisco Javier Arceo <farceo@redhat.com>	2025-04-10 10:37:31 -07:00
ehhuang	14146e4b3f	feat(verification): various improvements (#1921) ... # What does this PR do? - provider and their models now live in config.yaml - better distinguish different cases within a test - add model key to surface provider's model_id - include example command to rerun single test case ## Test Plan <img width="1173" alt="image" src="https://github.com/user-attachments/assets/b414baf0-c768-451f-8c3b-c2905cf36fac" />	2025-04-10 10:26:19 -07:00
ehhuang	bcbc56baa2	feat: adds test suite to verify provider's OAI compat endpoints (#1901) ... # What does this PR do? ## Test Plan pytest verifications/openai/test_chat_completion.py --provider together	2025-04-08 21:21:38 -07:00