phoenix-oss/llama-stack
1
0
Fork 0
forked from phoenix-oss/llama-stack-mirror
Code Pull requests Releases Packages 2 Activity Actions
2000 commits 21 branches 64 tags 62 MiB
Commit graph

7 commits

Author SHA1 Message Date
ehhuang
0ed41aafbf
test: add multi_image test (#1972) 
# What does this PR do?


## Test Plan
pytest tests/verifications/openai_api/test_chat_completion.py --provider
openai -k 'test_chat_multiple_images'
 2025-04-17 12:51:42 -07:00
ehhuang
2976b5d992
fix: OAI compat endpoint for meta reference inference provider (#1962) 
Test plan:
python tests/verifications/generate_report.py --providers
fireworks,together,llama_meta_ref,openai

Co-authored-by: Eric Huang <erichuang@fb.com>
 2025-04-17 11:16:04 -07:00
ehhuang
8bd6665775
chore(verification): update README and reorganize generate_report.py (#1978) 
# What does this PR do?


## Test Plan
uv run --with-editable ".[dev]" python
tests/verifications/generate_report.py --run-tests
 2025-04-17 10:41:22 -07:00
ehhuang
32e3da7392
test(verification): more tests, multiturn tool use tests (#1954) 
# What does this PR do?


## Test Plan
(myenv) ➜ llama-stack python tests/verifications/generate_report.py
--providers fireworks,together,openai --run-tests

f27f617629/tests/verifications/REPORT.md
 2025-04-14 18:45:22 -07:00
ehhuang
2fcb70b789
test(verification): overwrite test result instead of creating new ones (#1934) 
# What does this PR do?


## Test Plan
(myenv) ➜ llama-stack python tests/verifications/generate_report.py
--providers fireworks,together,openai --run-tests
 2025-04-10 16:59:28 -07:00
ehhuang
14146e4b3f
feat(verification): various improvements (#1921) 
# What does this PR do?
- provider and their models now live in config.yaml
- better distinguish different cases within a test
- add model key to surface provider's model_id
- include example command to rerun single test case

## Test Plan
<img width="1173" alt="image"
src="https://github.com/user-attachments/assets/b414baf0-c768-451f-8c3b-c2905cf36fac"
/>
 2025-04-10 10:26:19 -07:00
ehhuang
bcbc56baa2
feat: adds test suite to verify provider's OAI compat endpoints (#1901) 
# What does this PR do?


## Test Plan
pytest verifications/openai/test_chat_completion.py --provider together
 2025-04-08 21:21:38 -07:00