phoenix-oss/llama-stack
1
0
Fork 0
forked from phoenix-oss/llama-stack-mirror
Code Pull requests Releases Packages 2 Activity Actions

rename test_inference -> test_text_inference

Browse source
This commit is contained in:
Ashwin Bharambe 2024-11-06 16:12:50 -08:00
parent 3b54ce3499
commit 7c340f0236
2 changed files with 4 additions and 4 deletions
Download patch file Download diff file Expand all files Collapse all files

6
llama_stack/providers/tests/README.md
View file

@ -28,21 +28,21 @@ We have the following orthogonal parametrizations (pytest "marks") for inference
If you want to run a test with the llama_8b model with fireworks, you can use:
```bash
pytest -s -v llama_stack/providers/tests/inference/test_inference.py \
pytest -s -v llama_stack/providers/tests/inference/test_text_inference.py \
-m "fireworks and llama_8b" \
--env FIREWORKS_API_KEY=<...>
```
You can make it more complex to run both llama_8b and llama_3b on Fireworks, but only llama_3b with Ollama:
```bash
pytest -s -v llama_stack/providers/tests/inference/test_inference.py \
pytest -s -v llama_stack/providers/tests/inference/test_text_inference.py \
-m "fireworks or (ollama and llama_3b)" \
--env FIREWORKS_API_KEY=<...>
```
Finally, you can override the model completely by doing:
```bash
pytest -s -v llama_stack/providers/tests/inference/test_inference.py \
pytest -s -v llama_stack/providers/tests/inference/test_text_inference.py \
-m fireworks \
--inference-model "Llama3.1-70B-Instruct" \
--env FIREWORKS_API_KEY=<...>

2
llama_stack/providers/tests/inference/test_inference.py → llama_stack/providers/tests/inference/test_text_inference.py
View file

@ -19,7 +19,7 @@ from .utils import group_chunks
# How to run this test:
#
# pytest -v -s llama_stack/providers/tests/inference/test_inference.py
# pytest -v -s llama_stack/providers/tests/inference/test_text_inference.py
# -m "(fireworks or ollama) and llama_3b"
# --env FIREWORKS_API_KEY=<your_api_key>