llama-stack

phoenix-oss/llama-stack

Fork 0

forked from phoenix-oss/llama-stack-mirror

Commit graph

Author	SHA1	Message	Date
Ashwin Bharambe	6463ee7633	feat: allow using llama-stack-library-client from verifications (#2238 ) Having to run (and re-run) a server while running verifications can be annoying while you are iterating on code. This makes it so you can use the library client -- and because it is OpenAI client compatible, it all works. ## Test Plan ``` pytest -s -v tests/verifications/openai_api/test_responses.py \ --provider=stack:together \ --model meta-llama/Llama-4-Scout-17B-16E-Instruct ```	2025-05-23 11:43:41 -07:00
ehhuang	14146e4b3f	feat(verification): various improvements (#1921 ) # What does this PR do? - provider and their models now live in config.yaml - better distinguish different cases within a test - add model key to surface provider's model_id - include example command to rerun single test case ## Test Plan <img width="1173" alt="image" src="https://github.com/user-attachments/assets/b414baf0-c768-451f-8c3b-c2905cf36fac" />	2025-04-10 10:26:19 -07:00
ehhuang	bcbc56baa2	feat: adds test suite to verify provider's OAI compat endpoints (#1901 ) # What does this PR do? ## Test Plan pytest verifications/openai/test_chat_completion.py --provider together	2025-04-08 21:21:38 -07:00

Author

SHA1

Message

Date

Ashwin Bharambe

6463ee7633

feat: allow using llama-stack-library-client from verifications (#2238 )

Having to run (and re-run) a server while running verifications can be
annoying while you are iterating on code. This makes it so you can use
the library client -- and because it is OpenAI client compatible, it all
works.

## Test Plan

```
pytest -s -v tests/verifications/openai_api/test_responses.py \
   --provider=stack:together \
   --model meta-llama/Llama-4-Scout-17B-16E-Instruct
```

2025-05-23 11:43:41 -07:00

ehhuang

14146e4b3f

feat(verification): various improvements (#1921 )

# What does this PR do?
- provider and their models now live in config.yaml
- better distinguish different cases within a test
- add model key to surface provider's model_id
- include example command to rerun single test case

## Test Plan
<img width="1173" alt="image"
src="https://github.com/user-attachments/assets/b414baf0-c768-451f-8c3b-c2905cf36fac"
/>

2025-04-10 10:26:19 -07:00

ehhuang

bcbc56baa2

feat: adds test suite to verify provider's OAI compat endpoints (#1901 )

# What does this PR do?


## Test Plan
pytest verifications/openai/test_chat_completion.py --provider together

2025-04-08 21:21:38 -07:00

3 commits