5 commits

Author	SHA1	Message	Date
ehhuang	0ed41aafbf	test: add multi_image test (#1972) ... # What does this PR do? ## Test Plan pytest tests/verifications/openai_api/test_chat_completion.py --provider openai -k 'test_chat_multiple_images'	2025-04-17 12:51:42 -07:00
ehhuang	2976b5d992	fix: OAI compat endpoint for meta reference inference provider (#1962) ... Test plan: python tests/verifications/generate_report.py --providers fireworks,together,llama_meta_ref,openai Co-authored-by: Eric Huang <erichuang@fb.com>	2025-04-17 11:16:04 -07:00
ehhuang	32e3da7392	test(verification): more tests, multiturn tool use tests (#1954) ... # What does this PR do? ## Test Plan (myenv) ➜ llama-stack python tests/verifications/generate_report.py --providers fireworks,together,openai --run-tests f27f617629/tests/verifications/REPORT.md	2025-04-14 18:45:22 -07:00
ehhuang	a4cc4b7e31	test(verification): add streaming tool calling test (#1933) ... # What does this PR do? ## Test Plan --- [//]: # (BEGIN SAPLING FOOTER) Stack created with [Sapling](https://sapling-scm.com). Best reviewed with [ReviewStack](https://reviewstack.dev/meta-llama/llama-stack/pull/1933). * #1934 * __->__ #1933	2025-04-10 16:58:06 -07:00
ehhuang	14146e4b3f	feat(verification): various improvements (#1921) ... # What does this PR do? - provider and their models now live in config.yaml - better distinguish different cases within a test - add model key to surface provider's model_id - include example command to rerun single test case ## Test Plan <img width="1173" alt="image" src="https://github.com/user-attachments/assets/b414baf0-c768-451f-8c3b-c2905cf36fac" />	2025-04-10 10:26:19 -07:00