phoenix-oss/llama-stack
1
0
Fork 0
forked from phoenix-oss/llama-stack-mirror
Code Pull requests Releases Packages 2 Activity Actions

docs: Update readme for integration tests (#1846)

Browse source 
# What does this PR do?
Update README for integration tests

Signed-off-by: Francisco Javier Arceo <farceo@redhat.com>
This commit is contained in:
Francisco Arceo 2025-03-31 14:00:02 -06:00 • committed by GitHub
parent 9b478f3756
commit 60430da48a
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 5 additions and 5 deletions
Download patch file Download diff file Expand all files Collapse all files

10
tests/integration/README.md
View file

@ -36,7 +36,7 @@ Experimental, under development, options:
Run all text inference tests with the `together` distribution: Run all text inference tests with the `together` distribution:
```bash ```bash
pytest -s -v tests/api/inference/test_text_inference.py \ pytest -s -v tests/integration/inference/test_text_inference.py \
--stack-config=together \ --stack-config=together \
--text-model=meta-llama/Llama-3.1-8B-Instruct --text-model=meta-llama/Llama-3.1-8B-Instruct
``` ```
@ -44,7 +44,7 @@ pytest -s -v tests/api/inference/test_text_inference.py \
Run all text inference tests with the `together` distribution and `meta-llama/Llama-3.1-8B-Instruct`: Run all text inference tests with the `together` distribution and `meta-llama/Llama-3.1-8B-Instruct`:
```bash ```bash
pytest -s -v tests/api/inference/test_text_inference.py \ pytest -s -v tests/integration/inference/test_text_inference.py \
--stack-config=together \ --stack-config=together \
--text-model=meta-llama/Llama-3.1-8B-Instruct --text-model=meta-llama/Llama-3.1-8B-Instruct
``` ```
@ -57,7 +57,7 @@ VISION_MODELS=meta-llama/Llama-3.2-11B-Vision-Instruct
EMBEDDING_MODELS=all-MiniLM-L6-v2 EMBEDDING_MODELS=all-MiniLM-L6-v2
export TOGETHER_API_KEY=<together_api_key> export TOGETHER_API_KEY=<together_api_key>
pytest -s -v tests/api/inference/ \ pytest -s -v tests/integration/inference/ \
--stack-config=together \ --stack-config=together \
--text-model=$TEXT_MODELS \ --text-model=$TEXT_MODELS \
--vision-model=$VISION_MODELS \ --vision-model=$VISION_MODELS \
@ -69,7 +69,7 @@ Same thing but instead of using the distribution, use an adhoc stack with just o
```bash ```bash
export FIREWORKS_API_KEY=<fireworks_api_key> export FIREWORKS_API_KEY=<fireworks_api_key>
pytest -s -v tests/api/inference/ \ pytest -s -v tests/integration/inference/ \
--stack-config=inference=fireworks \ --stack-config=inference=fireworks \
--text-model=$TEXT_MODELS \ --text-model=$TEXT_MODELS \
--vision-model=$VISION_MODELS \ --vision-model=$VISION_MODELS \
@ -81,7 +81,7 @@ Running Vector IO tests for a number of embedding models:
```bash ```bash
EMBEDDING_MODELS=all-MiniLM-L6-v2 EMBEDDING_MODELS=all-MiniLM-L6-v2
pytest -s -v tests/api/vector_io/ \ pytest -s -v tests/integration/vector_io/ \
--stack-config=inference=sentence-transformers,vector_io=sqlite-vec \ --stack-config=inference=sentence-transformers,vector_io=sqlite-vec \
--embedding-model=$EMBEDDING_MODELS --embedding-model=$EMBEDDING_MODELS
``` ```